00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v23.11" build number 975 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3642 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.100 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.100 The recommended git tool is: git 00:00:00.101 using credential 00000000-0000-0000-0000-000000000002 00:00:00.102 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.159 Fetching changes from the remote Git repository 00:00:00.160 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.194 Using shallow fetch with depth 1 00:00:00.194 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.194 > git --version # timeout=10 00:00:00.234 > git --version # 'git version 2.39.2' 00:00:00.234 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.258 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.258 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.867 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.878 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.889 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.889 > git config core.sparsecheckout # timeout=10 00:00:05.900 > git read-tree -mu HEAD # timeout=10 00:00:05.914 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.931 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.931 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:06.009 [Pipeline] Start of Pipeline 00:00:06.024 [Pipeline] library 00:00:06.026 Loading library shm_lib@master 00:00:06.026 Library shm_lib@master is cached. Copying from home. 00:00:06.043 [Pipeline] node 00:00:06.051 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.052 [Pipeline] { 00:00:06.059 [Pipeline] catchError 00:00:06.060 [Pipeline] { 00:00:06.071 [Pipeline] wrap 00:00:06.079 [Pipeline] { 00:00:06.086 [Pipeline] stage 00:00:06.088 [Pipeline] { (Prologue) 00:00:06.316 [Pipeline] sh 00:00:06.591 + logger -p user.info -t JENKINS-CI 00:00:06.607 [Pipeline] echo 00:00:06.608 Node: GP11 00:00:06.614 [Pipeline] sh 00:00:06.900 [Pipeline] setCustomBuildProperty 00:00:06.910 [Pipeline] echo 00:00:06.911 Cleanup processes 00:00:06.915 [Pipeline] sh 00:00:07.191 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.191 1372412 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.200 [Pipeline] sh 00:00:07.472 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.472 ++ grep -v 'sudo pgrep' 00:00:07.472 ++ awk '{print $1}' 00:00:07.472 + sudo kill -9 00:00:07.472 + true 00:00:07.481 [Pipeline] cleanWs 00:00:07.488 [WS-CLEANUP] Deleting project workspace... 00:00:07.488 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.494 [WS-CLEANUP] done 00:00:07.497 [Pipeline] setCustomBuildProperty 00:00:07.507 [Pipeline] sh 00:00:07.778 + sudo git config --global --replace-all safe.directory '*' 00:00:07.865 [Pipeline] httpRequest 00:00:08.234 [Pipeline] echo 00:00:08.236 Sorcerer 10.211.164.20 is alive 00:00:08.245 [Pipeline] retry 00:00:08.247 [Pipeline] { 00:00:08.260 [Pipeline] httpRequest 00:00:08.263 HttpMethod: GET 00:00:08.263 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.264 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.284 Response Code: HTTP/1.1 200 OK 00:00:08.284 Success: Status code 200 is in the accepted range: 200,404 00:00:08.285 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:17.850 [Pipeline] } 00:00:17.868 [Pipeline] // retry 00:00:17.876 [Pipeline] sh 00:00:18.156 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:18.171 [Pipeline] httpRequest 00:00:18.565 [Pipeline] echo 00:00:18.567 Sorcerer 10.211.164.20 is alive 00:00:18.577 [Pipeline] retry 00:00:18.579 [Pipeline] { 00:00:18.594 [Pipeline] httpRequest 00:00:18.598 HttpMethod: GET 00:00:18.599 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:18.599 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:18.623 Response Code: HTTP/1.1 200 OK 00:00:18.623 Success: Status code 200 is in the accepted range: 200,404 00:00:18.624 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:21.790 [Pipeline] } 00:01:21.807 [Pipeline] // retry 00:01:21.815 [Pipeline] sh 00:01:22.095 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:24.635 [Pipeline] sh 00:01:24.945 + git -C spdk log --oneline -n5 00:01:24.945 c13c99a5e test: Various fixes for Fedora40 00:01:24.945 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:24.945 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:24.945 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:24.945 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:24.963 [Pipeline] withCredentials 00:01:24.972 > git --version # timeout=10 00:01:24.986 > git --version # 'git version 2.39.2' 00:01:25.000 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:25.002 [Pipeline] { 00:01:25.012 [Pipeline] retry 00:01:25.014 [Pipeline] { 00:01:25.029 [Pipeline] sh 00:01:25.309 + git ls-remote http://dpdk.org/git/dpdk-stable v23.11 00:01:25.321 [Pipeline] } 00:01:25.339 [Pipeline] // retry 00:01:25.344 [Pipeline] } 00:01:25.361 [Pipeline] // withCredentials 00:01:25.371 [Pipeline] httpRequest 00:01:25.726 [Pipeline] echo 00:01:25.728 Sorcerer 10.211.164.20 is alive 00:01:25.737 [Pipeline] retry 00:01:25.739 [Pipeline] { 00:01:25.752 [Pipeline] httpRequest 00:01:25.756 HttpMethod: GET 00:01:25.756 URL: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:25.757 Sending request to url: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:25.759 Response Code: HTTP/1.1 200 OK 00:01:25.759 Success: Status code 200 is in the accepted range: 200,404 00:01:25.760 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:28.960 [Pipeline] } 00:01:28.979 [Pipeline] // retry 00:01:28.987 [Pipeline] sh 00:01:29.269 + tar --no-same-owner -xf dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:30.656 [Pipeline] sh 00:01:30.940 + git -C dpdk log --oneline -n5 00:01:30.940 eeb0605f11 version: 23.11.0 00:01:30.940 238778122a doc: update release notes for 23.11 00:01:30.940 46aa6b3cfc doc: fix description of RSS features 00:01:30.940 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:30.940 7e421ae345 devtools: support skipping forbid rule check 00:01:30.950 [Pipeline] } 00:01:30.966 [Pipeline] // stage 00:01:30.977 [Pipeline] stage 00:01:30.979 [Pipeline] { (Prepare) 00:01:30.998 [Pipeline] writeFile 00:01:31.014 [Pipeline] sh 00:01:31.296 + logger -p user.info -t JENKINS-CI 00:01:31.308 [Pipeline] sh 00:01:31.590 + logger -p user.info -t JENKINS-CI 00:01:31.602 [Pipeline] sh 00:01:31.885 + cat autorun-spdk.conf 00:01:31.885 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:31.885 SPDK_TEST_NVMF=1 00:01:31.885 SPDK_TEST_NVME_CLI=1 00:01:31.885 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:31.885 SPDK_TEST_NVMF_NICS=e810 00:01:31.885 SPDK_TEST_VFIOUSER=1 00:01:31.885 SPDK_RUN_UBSAN=1 00:01:31.885 NET_TYPE=phy 00:01:31.885 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:31.885 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:31.891 RUN_NIGHTLY=1 00:01:31.897 [Pipeline] readFile 00:01:31.924 [Pipeline] withEnv 00:01:31.926 [Pipeline] { 00:01:31.939 [Pipeline] sh 00:01:32.222 + set -ex 00:01:32.222 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:32.222 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:32.222 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:32.222 ++ SPDK_TEST_NVMF=1 00:01:32.222 ++ SPDK_TEST_NVME_CLI=1 00:01:32.222 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:32.222 ++ SPDK_TEST_NVMF_NICS=e810 00:01:32.222 ++ SPDK_TEST_VFIOUSER=1 00:01:32.222 ++ SPDK_RUN_UBSAN=1 00:01:32.222 ++ NET_TYPE=phy 00:01:32.222 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:32.222 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:32.222 ++ RUN_NIGHTLY=1 00:01:32.222 + case $SPDK_TEST_NVMF_NICS in 00:01:32.222 + DRIVERS=ice 00:01:32.222 + [[ tcp == \r\d\m\a ]] 00:01:32.222 + [[ -n ice ]] 00:01:32.222 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:32.222 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:32.222 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:32.222 rmmod: ERROR: Module irdma is not currently loaded 00:01:32.222 rmmod: ERROR: Module i40iw is not currently loaded 00:01:32.222 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:32.222 + true 00:01:32.222 + for D in $DRIVERS 00:01:32.222 + sudo modprobe ice 00:01:32.222 + exit 0 00:01:32.232 [Pipeline] } 00:01:32.247 [Pipeline] // withEnv 00:01:32.252 [Pipeline] } 00:01:32.265 [Pipeline] // stage 00:01:32.275 [Pipeline] catchError 00:01:32.276 [Pipeline] { 00:01:32.290 [Pipeline] timeout 00:01:32.290 Timeout set to expire in 1 hr 0 min 00:01:32.292 [Pipeline] { 00:01:32.306 [Pipeline] stage 00:01:32.309 [Pipeline] { (Tests) 00:01:32.323 [Pipeline] sh 00:01:32.605 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:32.605 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:32.605 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:32.605 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:32.605 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:32.605 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:32.605 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:32.605 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:32.605 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:32.605 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:32.605 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:32.605 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:32.605 + source /etc/os-release 00:01:32.605 ++ NAME='Fedora Linux' 00:01:32.605 ++ VERSION='39 (Cloud Edition)' 00:01:32.605 ++ ID=fedora 00:01:32.605 ++ VERSION_ID=39 00:01:32.605 ++ VERSION_CODENAME= 00:01:32.605 ++ PLATFORM_ID=platform:f39 00:01:32.605 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:32.605 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:32.605 ++ LOGO=fedora-logo-icon 00:01:32.605 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:32.605 ++ HOME_URL=https://fedoraproject.org/ 00:01:32.605 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:32.605 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:32.605 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:32.605 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:32.605 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:32.605 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:32.605 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:32.605 ++ SUPPORT_END=2024-11-12 00:01:32.605 ++ VARIANT='Cloud Edition' 00:01:32.605 ++ VARIANT_ID=cloud 00:01:32.605 + uname -a 00:01:32.605 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:32.605 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:33.539 Hugepages 00:01:33.539 node hugesize free / total 00:01:33.539 node0 1048576kB 0 / 0 00:01:33.539 node0 2048kB 0 / 0 00:01:33.539 node1 1048576kB 0 / 0 00:01:33.540 node1 2048kB 0 / 0 00:01:33.540 00:01:33.540 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:33.540 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:33.540 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:33.540 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:33.540 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:33.540 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:33.540 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:33.540 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:33.540 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:33.540 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:33.540 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:33.540 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:33.540 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:33.540 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:33.540 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:33.540 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:33.540 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:33.540 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:33.540 + rm -f /tmp/spdk-ld-path 00:01:33.540 + source autorun-spdk.conf 00:01:33.540 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:33.540 ++ SPDK_TEST_NVMF=1 00:01:33.540 ++ SPDK_TEST_NVME_CLI=1 00:01:33.540 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:33.540 ++ SPDK_TEST_NVMF_NICS=e810 00:01:33.540 ++ SPDK_TEST_VFIOUSER=1 00:01:33.540 ++ SPDK_RUN_UBSAN=1 00:01:33.540 ++ NET_TYPE=phy 00:01:33.540 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:33.540 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:33.540 ++ RUN_NIGHTLY=1 00:01:33.540 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:33.540 + [[ -n '' ]] 00:01:33.540 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:33.540 + for M in /var/spdk/build-*-manifest.txt 00:01:33.540 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:33.540 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:33.540 + for M in /var/spdk/build-*-manifest.txt 00:01:33.540 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:33.540 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:33.540 + for M in /var/spdk/build-*-manifest.txt 00:01:33.540 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:33.540 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:33.540 ++ uname 00:01:33.540 + [[ Linux == \L\i\n\u\x ]] 00:01:33.540 + sudo dmesg -T 00:01:33.799 + sudo dmesg --clear 00:01:33.799 + dmesg_pid=1373129 00:01:33.799 + [[ Fedora Linux == FreeBSD ]] 00:01:33.799 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:33.799 + sudo dmesg -Tw 00:01:33.799 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:33.799 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:33.799 + [[ -x /usr/src/fio-static/fio ]] 00:01:33.799 + export FIO_BIN=/usr/src/fio-static/fio 00:01:33.799 + FIO_BIN=/usr/src/fio-static/fio 00:01:33.799 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:33.799 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:33.799 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:33.799 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:33.799 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:33.799 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:33.799 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:33.799 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:33.799 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:33.799 Test configuration: 00:01:33.799 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:33.799 SPDK_TEST_NVMF=1 00:01:33.799 SPDK_TEST_NVME_CLI=1 00:01:33.799 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:33.799 SPDK_TEST_NVMF_NICS=e810 00:01:33.799 SPDK_TEST_VFIOUSER=1 00:01:33.799 SPDK_RUN_UBSAN=1 00:01:33.799 NET_TYPE=phy 00:01:33.799 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:33.799 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:33.799 RUN_NIGHTLY=1 15:47:57 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:33.799 15:47:57 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:33.799 15:47:57 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:33.799 15:47:57 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:33.799 15:47:57 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:33.799 15:47:57 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:33.799 15:47:57 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:33.799 15:47:57 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:33.799 15:47:57 -- paths/export.sh@5 -- $ export PATH 00:01:33.799 15:47:57 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:33.799 15:47:57 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:33.799 15:47:57 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:33.799 15:47:57 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731941277.XXXXXX 00:01:33.799 15:47:57 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731941277.5i8dhR 00:01:33.799 15:47:57 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:33.799 15:47:57 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:01:33.799 15:47:57 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:33.799 15:47:57 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:33.799 15:47:57 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:33.799 15:47:57 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:33.799 15:47:57 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:33.799 15:47:57 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:33.799 15:47:57 -- common/autotest_common.sh@10 -- $ set +x 00:01:33.799 15:47:57 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:33.799 15:47:57 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:33.799 15:47:57 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:33.799 15:47:57 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:33.799 15:47:57 -- spdk/autobuild.sh@16 -- $ date -u 00:01:33.799 Mon Nov 18 02:47:57 PM UTC 2024 00:01:33.799 15:47:57 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:33.799 LTS-67-gc13c99a5e 00:01:33.799 15:47:57 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:33.799 15:47:57 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:33.799 15:47:57 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:33.799 15:47:57 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:33.799 15:47:57 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:33.799 15:47:57 -- common/autotest_common.sh@10 -- $ set +x 00:01:33.799 ************************************ 00:01:33.799 START TEST ubsan 00:01:33.799 ************************************ 00:01:33.799 15:47:57 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:33.799 using ubsan 00:01:33.799 00:01:33.799 real 0m0.000s 00:01:33.799 user 0m0.000s 00:01:33.799 sys 0m0.000s 00:01:33.799 15:47:57 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:33.799 15:47:57 -- common/autotest_common.sh@10 -- $ set +x 00:01:33.799 ************************************ 00:01:33.799 END TEST ubsan 00:01:33.799 ************************************ 00:01:33.799 15:47:57 -- spdk/autobuild.sh@27 -- $ '[' -n v23.11 ']' 00:01:33.799 15:47:57 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:33.799 15:47:57 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:33.799 15:47:57 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:33.799 15:47:57 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:33.799 15:47:57 -- common/autotest_common.sh@10 -- $ set +x 00:01:33.799 ************************************ 00:01:33.799 START TEST build_native_dpdk 00:01:33.799 ************************************ 00:01:33.799 15:47:57 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:33.799 15:47:57 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:33.799 15:47:57 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:33.799 15:47:57 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:33.799 15:47:57 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:33.799 15:47:57 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:33.799 15:47:57 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:33.799 15:47:57 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:33.799 15:47:57 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:33.799 15:47:57 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:33.799 15:47:57 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:33.799 15:47:57 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:33.799 15:47:57 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:33.799 15:47:57 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:33.799 15:47:57 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:33.799 15:47:57 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:33.799 15:47:57 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:33.799 15:47:57 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:33.799 15:47:57 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:33.799 15:47:57 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:33.799 15:47:57 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:33.799 eeb0605f11 version: 23.11.0 00:01:33.799 238778122a doc: update release notes for 23.11 00:01:33.799 46aa6b3cfc doc: fix description of RSS features 00:01:33.799 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:33.799 7e421ae345 devtools: support skipping forbid rule check 00:01:33.799 15:47:57 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:33.799 15:47:57 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:33.799 15:47:57 -- common/autobuild_common.sh@87 -- $ dpdk_ver=23.11.0 00:01:33.799 15:47:57 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:33.799 15:47:57 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:33.800 15:47:57 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:33.800 15:47:57 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:33.800 15:47:57 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:33.800 15:47:57 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:33.800 15:47:57 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:33.800 15:47:57 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:33.800 15:47:57 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:33.800 15:47:57 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:33.800 15:47:57 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:33.800 15:47:57 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:33.800 15:47:57 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:33.800 15:47:57 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:33.800 15:47:57 -- common/autobuild_common.sh@169 -- $ lt 23.11.0 21.11.0 00:01:33.800 15:47:57 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 21.11.0 00:01:33.800 15:47:57 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:33.800 15:47:57 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:33.800 15:47:57 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:33.800 15:47:57 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:33.800 15:47:57 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:33.800 15:47:57 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:33.800 15:47:57 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:33.800 15:47:57 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:33.800 15:47:57 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:33.800 15:47:57 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:33.800 15:47:57 -- scripts/common.sh@343 -- $ case "$op" in 00:01:33.800 15:47:57 -- scripts/common.sh@344 -- $ : 1 00:01:33.800 15:47:57 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:33.800 15:47:57 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:33.800 15:47:57 -- scripts/common.sh@364 -- $ decimal 23 00:01:33.800 15:47:57 -- scripts/common.sh@352 -- $ local d=23 00:01:33.800 15:47:57 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:33.800 15:47:57 -- scripts/common.sh@354 -- $ echo 23 00:01:33.800 15:47:57 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:33.800 15:47:57 -- scripts/common.sh@365 -- $ decimal 21 00:01:33.800 15:47:57 -- scripts/common.sh@352 -- $ local d=21 00:01:33.800 15:47:57 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:33.800 15:47:57 -- scripts/common.sh@354 -- $ echo 21 00:01:33.800 15:47:57 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:33.800 15:47:57 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:33.800 15:47:57 -- scripts/common.sh@366 -- $ return 1 00:01:33.800 15:47:57 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:33.800 patching file config/rte_config.h 00:01:33.800 Hunk #1 succeeded at 60 (offset 1 line). 00:01:33.800 15:47:57 -- common/autobuild_common.sh@176 -- $ lt 23.11.0 24.07.0 00:01:33.800 15:47:57 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 24.07.0 00:01:33.800 15:47:57 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:33.800 15:47:57 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:33.800 15:47:57 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:33.800 15:47:57 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:33.800 15:47:57 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:33.800 15:47:57 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:33.800 15:47:57 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:33.800 15:47:57 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:33.800 15:47:57 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:33.800 15:47:57 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:33.800 15:47:57 -- scripts/common.sh@343 -- $ case "$op" in 00:01:33.800 15:47:57 -- scripts/common.sh@344 -- $ : 1 00:01:33.800 15:47:57 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:33.800 15:47:57 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:33.800 15:47:57 -- scripts/common.sh@364 -- $ decimal 23 00:01:33.800 15:47:57 -- scripts/common.sh@352 -- $ local d=23 00:01:33.800 15:47:57 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:33.800 15:47:57 -- scripts/common.sh@354 -- $ echo 23 00:01:33.800 15:47:57 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:33.800 15:47:57 -- scripts/common.sh@365 -- $ decimal 24 00:01:33.800 15:47:57 -- scripts/common.sh@352 -- $ local d=24 00:01:33.800 15:47:57 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:33.800 15:47:57 -- scripts/common.sh@354 -- $ echo 24 00:01:33.800 15:47:57 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:33.800 15:47:57 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:33.800 15:47:57 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:33.800 15:47:57 -- scripts/common.sh@367 -- $ return 0 00:01:33.800 15:47:57 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:33.800 patching file lib/pcapng/rte_pcapng.c 00:01:33.800 15:47:57 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:33.800 15:47:57 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:33.800 15:47:57 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:33.800 15:47:57 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:33.800 15:47:57 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:37.991 The Meson build system 00:01:37.991 Version: 1.5.0 00:01:37.991 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:37.991 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:37.991 Build type: native build 00:01:37.991 Program cat found: YES (/usr/bin/cat) 00:01:37.991 Project name: DPDK 00:01:37.991 Project version: 23.11.0 00:01:37.991 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:37.991 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:37.991 Host machine cpu family: x86_64 00:01:37.991 Host machine cpu: x86_64 00:01:37.991 Message: ## Building in Developer Mode ## 00:01:37.991 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:37.991 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:37.991 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:37.991 Program python3 found: YES (/usr/bin/python3) 00:01:37.991 Program cat found: YES (/usr/bin/cat) 00:01:37.991 config/meson.build:113: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:37.991 Compiler for C supports arguments -march=native: YES 00:01:37.991 Checking for size of "void *" : 8 00:01:37.991 Checking for size of "void *" : 8 (cached) 00:01:37.991 Library m found: YES 00:01:37.991 Library numa found: YES 00:01:37.991 Has header "numaif.h" : YES 00:01:37.991 Library fdt found: NO 00:01:37.991 Library execinfo found: NO 00:01:37.991 Has header "execinfo.h" : YES 00:01:37.991 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:37.991 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:37.991 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:37.991 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:37.991 Run-time dependency openssl found: YES 3.1.1 00:01:37.991 Run-time dependency libpcap found: YES 1.10.4 00:01:37.991 Has header "pcap.h" with dependency libpcap: YES 00:01:37.991 Compiler for C supports arguments -Wcast-qual: YES 00:01:37.991 Compiler for C supports arguments -Wdeprecated: YES 00:01:37.991 Compiler for C supports arguments -Wformat: YES 00:01:37.991 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:37.991 Compiler for C supports arguments -Wformat-security: NO 00:01:37.991 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:37.991 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:37.991 Compiler for C supports arguments -Wnested-externs: YES 00:01:37.991 Compiler for C supports arguments -Wold-style-definition: YES 00:01:37.991 Compiler for C supports arguments -Wpointer-arith: YES 00:01:37.991 Compiler for C supports arguments -Wsign-compare: YES 00:01:37.991 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:37.991 Compiler for C supports arguments -Wundef: YES 00:01:37.991 Compiler for C supports arguments -Wwrite-strings: YES 00:01:37.991 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:37.991 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:37.991 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:37.991 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:37.991 Program objdump found: YES (/usr/bin/objdump) 00:01:37.991 Compiler for C supports arguments -mavx512f: YES 00:01:37.991 Checking if "AVX512 checking" compiles: YES 00:01:37.991 Fetching value of define "__SSE4_2__" : 1 00:01:37.991 Fetching value of define "__AES__" : 1 00:01:37.991 Fetching value of define "__AVX__" : 1 00:01:37.991 Fetching value of define "__AVX2__" : (undefined) 00:01:37.991 Fetching value of define "__AVX512BW__" : (undefined) 00:01:37.991 Fetching value of define "__AVX512CD__" : (undefined) 00:01:37.991 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:37.991 Fetching value of define "__AVX512F__" : (undefined) 00:01:37.991 Fetching value of define "__AVX512VL__" : (undefined) 00:01:37.991 Fetching value of define "__PCLMUL__" : 1 00:01:37.991 Fetching value of define "__RDRND__" : 1 00:01:37.991 Fetching value of define "__RDSEED__" : (undefined) 00:01:37.991 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:37.991 Fetching value of define "__znver1__" : (undefined) 00:01:37.991 Fetching value of define "__znver2__" : (undefined) 00:01:37.991 Fetching value of define "__znver3__" : (undefined) 00:01:37.991 Fetching value of define "__znver4__" : (undefined) 00:01:37.991 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:37.991 Message: lib/log: Defining dependency "log" 00:01:37.991 Message: lib/kvargs: Defining dependency "kvargs" 00:01:37.991 Message: lib/telemetry: Defining dependency "telemetry" 00:01:37.991 Checking for function "getentropy" : NO 00:01:37.991 Message: lib/eal: Defining dependency "eal" 00:01:37.991 Message: lib/ring: Defining dependency "ring" 00:01:37.991 Message: lib/rcu: Defining dependency "rcu" 00:01:37.991 Message: lib/mempool: Defining dependency "mempool" 00:01:37.991 Message: lib/mbuf: Defining dependency "mbuf" 00:01:37.991 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:37.991 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:37.991 Compiler for C supports arguments -mpclmul: YES 00:01:37.991 Compiler for C supports arguments -maes: YES 00:01:37.991 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:37.991 Compiler for C supports arguments -mavx512bw: YES 00:01:37.991 Compiler for C supports arguments -mavx512dq: YES 00:01:37.991 Compiler for C supports arguments -mavx512vl: YES 00:01:37.991 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:37.991 Compiler for C supports arguments -mavx2: YES 00:01:37.991 Compiler for C supports arguments -mavx: YES 00:01:37.991 Message: lib/net: Defining dependency "net" 00:01:37.991 Message: lib/meter: Defining dependency "meter" 00:01:37.991 Message: lib/ethdev: Defining dependency "ethdev" 00:01:37.991 Message: lib/pci: Defining dependency "pci" 00:01:37.991 Message: lib/cmdline: Defining dependency "cmdline" 00:01:37.991 Message: lib/metrics: Defining dependency "metrics" 00:01:37.991 Message: lib/hash: Defining dependency "hash" 00:01:37.991 Message: lib/timer: Defining dependency "timer" 00:01:37.991 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:37.991 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:37.991 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:37.991 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:37.991 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:37.991 Message: lib/acl: Defining dependency "acl" 00:01:37.991 Message: lib/bbdev: Defining dependency "bbdev" 00:01:37.991 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:37.991 Run-time dependency libelf found: YES 0.191 00:01:37.991 Message: lib/bpf: Defining dependency "bpf" 00:01:37.991 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:37.991 Message: lib/compressdev: Defining dependency "compressdev" 00:01:37.991 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:37.991 Message: lib/distributor: Defining dependency "distributor" 00:01:37.991 Message: lib/dmadev: Defining dependency "dmadev" 00:01:37.991 Message: lib/efd: Defining dependency "efd" 00:01:37.991 Message: lib/eventdev: Defining dependency "eventdev" 00:01:37.991 Message: lib/dispatcher: Defining dependency "dispatcher" 00:01:37.991 Message: lib/gpudev: Defining dependency "gpudev" 00:01:37.991 Message: lib/gro: Defining dependency "gro" 00:01:37.991 Message: lib/gso: Defining dependency "gso" 00:01:37.991 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:37.991 Message: lib/jobstats: Defining dependency "jobstats" 00:01:37.991 Message: lib/latencystats: Defining dependency "latencystats" 00:01:37.992 Message: lib/lpm: Defining dependency "lpm" 00:01:37.992 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:37.992 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:37.992 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:37.992 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:37.992 Message: lib/member: Defining dependency "member" 00:01:37.992 Message: lib/pcapng: Defining dependency "pcapng" 00:01:37.992 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:37.992 Message: lib/power: Defining dependency "power" 00:01:37.992 Message: lib/rawdev: Defining dependency "rawdev" 00:01:37.992 Message: lib/regexdev: Defining dependency "regexdev" 00:01:37.992 Message: lib/mldev: Defining dependency "mldev" 00:01:37.992 Message: lib/rib: Defining dependency "rib" 00:01:37.992 Message: lib/reorder: Defining dependency "reorder" 00:01:37.992 Message: lib/sched: Defining dependency "sched" 00:01:37.992 Message: lib/security: Defining dependency "security" 00:01:37.992 Message: lib/stack: Defining dependency "stack" 00:01:37.992 Has header "linux/userfaultfd.h" : YES 00:01:37.992 Has header "linux/vduse.h" : YES 00:01:37.992 Message: lib/vhost: Defining dependency "vhost" 00:01:37.992 Message: lib/ipsec: Defining dependency "ipsec" 00:01:37.992 Message: lib/pdcp: Defining dependency "pdcp" 00:01:37.992 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:37.992 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:37.992 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:37.992 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:37.992 Message: lib/fib: Defining dependency "fib" 00:01:37.992 Message: lib/port: Defining dependency "port" 00:01:37.992 Message: lib/pdump: Defining dependency "pdump" 00:01:37.992 Message: lib/table: Defining dependency "table" 00:01:37.992 Message: lib/pipeline: Defining dependency "pipeline" 00:01:37.992 Message: lib/graph: Defining dependency "graph" 00:01:37.992 Message: lib/node: Defining dependency "node" 00:01:39.892 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:39.892 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:39.892 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:39.892 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:39.892 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:39.892 Compiler for C supports arguments -Wno-unused-value: YES 00:01:39.892 Compiler for C supports arguments -Wno-format: YES 00:01:39.892 Compiler for C supports arguments -Wno-format-security: YES 00:01:39.892 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:39.892 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:39.892 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:39.892 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:39.892 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:39.892 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:39.892 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:39.892 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:39.892 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:39.892 Has header "sys/epoll.h" : YES 00:01:39.892 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:39.892 Configuring doxy-api-html.conf using configuration 00:01:39.892 Configuring doxy-api-man.conf using configuration 00:01:39.892 Program mandb found: YES (/usr/bin/mandb) 00:01:39.892 Program sphinx-build found: NO 00:01:39.892 Configuring rte_build_config.h using configuration 00:01:39.892 Message: 00:01:39.892 ================= 00:01:39.892 Applications Enabled 00:01:39.892 ================= 00:01:39.892 00:01:39.892 apps: 00:01:39.892 dumpcap, graph, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, 00:01:39.892 test-crypto-perf, test-dma-perf, test-eventdev, test-fib, test-flow-perf, test-gpudev, test-mldev, test-pipeline, 00:01:39.892 test-pmd, test-regex, test-sad, test-security-perf, 00:01:39.892 00:01:39.892 Message: 00:01:39.892 ================= 00:01:39.892 Libraries Enabled 00:01:39.892 ================= 00:01:39.892 00:01:39.892 libs: 00:01:39.892 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:39.892 net, meter, ethdev, pci, cmdline, metrics, hash, timer, 00:01:39.892 acl, bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, 00:01:39.892 dmadev, efd, eventdev, dispatcher, gpudev, gro, gso, ip_frag, 00:01:39.892 jobstats, latencystats, lpm, member, pcapng, power, rawdev, regexdev, 00:01:39.892 mldev, rib, reorder, sched, security, stack, vhost, ipsec, 00:01:39.892 pdcp, fib, port, pdump, table, pipeline, graph, node, 00:01:39.892 00:01:39.892 00:01:39.892 Message: 00:01:39.892 =============== 00:01:39.892 Drivers Enabled 00:01:39.892 =============== 00:01:39.892 00:01:39.892 common: 00:01:39.892 00:01:39.892 bus: 00:01:39.892 pci, vdev, 00:01:39.892 mempool: 00:01:39.892 ring, 00:01:39.892 dma: 00:01:39.892 00:01:39.892 net: 00:01:39.892 i40e, 00:01:39.892 raw: 00:01:39.892 00:01:39.892 crypto: 00:01:39.892 00:01:39.892 compress: 00:01:39.892 00:01:39.892 regex: 00:01:39.892 00:01:39.892 ml: 00:01:39.892 00:01:39.892 vdpa: 00:01:39.892 00:01:39.892 event: 00:01:39.892 00:01:39.892 baseband: 00:01:39.892 00:01:39.892 gpu: 00:01:39.892 00:01:39.892 00:01:39.892 Message: 00:01:39.892 ================= 00:01:39.892 Content Skipped 00:01:39.892 ================= 00:01:39.892 00:01:39.892 apps: 00:01:39.892 00:01:39.892 libs: 00:01:39.892 00:01:39.892 drivers: 00:01:39.892 common/cpt: not in enabled drivers build config 00:01:39.892 common/dpaax: not in enabled drivers build config 00:01:39.892 common/iavf: not in enabled drivers build config 00:01:39.892 common/idpf: not in enabled drivers build config 00:01:39.892 common/mvep: not in enabled drivers build config 00:01:39.892 common/octeontx: not in enabled drivers build config 00:01:39.892 bus/auxiliary: not in enabled drivers build config 00:01:39.892 bus/cdx: not in enabled drivers build config 00:01:39.892 bus/dpaa: not in enabled drivers build config 00:01:39.892 bus/fslmc: not in enabled drivers build config 00:01:39.892 bus/ifpga: not in enabled drivers build config 00:01:39.892 bus/platform: not in enabled drivers build config 00:01:39.892 bus/vmbus: not in enabled drivers build config 00:01:39.892 common/cnxk: not in enabled drivers build config 00:01:39.892 common/mlx5: not in enabled drivers build config 00:01:39.892 common/nfp: not in enabled drivers build config 00:01:39.892 common/qat: not in enabled drivers build config 00:01:39.892 common/sfc_efx: not in enabled drivers build config 00:01:39.892 mempool/bucket: not in enabled drivers build config 00:01:39.892 mempool/cnxk: not in enabled drivers build config 00:01:39.892 mempool/dpaa: not in enabled drivers build config 00:01:39.892 mempool/dpaa2: not in enabled drivers build config 00:01:39.892 mempool/octeontx: not in enabled drivers build config 00:01:39.892 mempool/stack: not in enabled drivers build config 00:01:39.892 dma/cnxk: not in enabled drivers build config 00:01:39.892 dma/dpaa: not in enabled drivers build config 00:01:39.892 dma/dpaa2: not in enabled drivers build config 00:01:39.892 dma/hisilicon: not in enabled drivers build config 00:01:39.892 dma/idxd: not in enabled drivers build config 00:01:39.892 dma/ioat: not in enabled drivers build config 00:01:39.892 dma/skeleton: not in enabled drivers build config 00:01:39.892 net/af_packet: not in enabled drivers build config 00:01:39.892 net/af_xdp: not in enabled drivers build config 00:01:39.892 net/ark: not in enabled drivers build config 00:01:39.892 net/atlantic: not in enabled drivers build config 00:01:39.892 net/avp: not in enabled drivers build config 00:01:39.892 net/axgbe: not in enabled drivers build config 00:01:39.892 net/bnx2x: not in enabled drivers build config 00:01:39.892 net/bnxt: not in enabled drivers build config 00:01:39.892 net/bonding: not in enabled drivers build config 00:01:39.892 net/cnxk: not in enabled drivers build config 00:01:39.892 net/cpfl: not in enabled drivers build config 00:01:39.892 net/cxgbe: not in enabled drivers build config 00:01:39.893 net/dpaa: not in enabled drivers build config 00:01:39.893 net/dpaa2: not in enabled drivers build config 00:01:39.893 net/e1000: not in enabled drivers build config 00:01:39.893 net/ena: not in enabled drivers build config 00:01:39.893 net/enetc: not in enabled drivers build config 00:01:39.893 net/enetfec: not in enabled drivers build config 00:01:39.893 net/enic: not in enabled drivers build config 00:01:39.893 net/failsafe: not in enabled drivers build config 00:01:39.893 net/fm10k: not in enabled drivers build config 00:01:39.893 net/gve: not in enabled drivers build config 00:01:39.893 net/hinic: not in enabled drivers build config 00:01:39.893 net/hns3: not in enabled drivers build config 00:01:39.893 net/iavf: not in enabled drivers build config 00:01:39.893 net/ice: not in enabled drivers build config 00:01:39.893 net/idpf: not in enabled drivers build config 00:01:39.893 net/igc: not in enabled drivers build config 00:01:39.893 net/ionic: not in enabled drivers build config 00:01:39.893 net/ipn3ke: not in enabled drivers build config 00:01:39.893 net/ixgbe: not in enabled drivers build config 00:01:39.893 net/mana: not in enabled drivers build config 00:01:39.893 net/memif: not in enabled drivers build config 00:01:39.893 net/mlx4: not in enabled drivers build config 00:01:39.893 net/mlx5: not in enabled drivers build config 00:01:39.893 net/mvneta: not in enabled drivers build config 00:01:39.893 net/mvpp2: not in enabled drivers build config 00:01:39.893 net/netvsc: not in enabled drivers build config 00:01:39.893 net/nfb: not in enabled drivers build config 00:01:39.893 net/nfp: not in enabled drivers build config 00:01:39.893 net/ngbe: not in enabled drivers build config 00:01:39.893 net/null: not in enabled drivers build config 00:01:39.893 net/octeontx: not in enabled drivers build config 00:01:39.893 net/octeon_ep: not in enabled drivers build config 00:01:39.893 net/pcap: not in enabled drivers build config 00:01:39.893 net/pfe: not in enabled drivers build config 00:01:39.893 net/qede: not in enabled drivers build config 00:01:39.893 net/ring: not in enabled drivers build config 00:01:39.893 net/sfc: not in enabled drivers build config 00:01:39.893 net/softnic: not in enabled drivers build config 00:01:39.893 net/tap: not in enabled drivers build config 00:01:39.893 net/thunderx: not in enabled drivers build config 00:01:39.893 net/txgbe: not in enabled drivers build config 00:01:39.893 net/vdev_netvsc: not in enabled drivers build config 00:01:39.893 net/vhost: not in enabled drivers build config 00:01:39.893 net/virtio: not in enabled drivers build config 00:01:39.893 net/vmxnet3: not in enabled drivers build config 00:01:39.893 raw/cnxk_bphy: not in enabled drivers build config 00:01:39.893 raw/cnxk_gpio: not in enabled drivers build config 00:01:39.893 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:39.893 raw/ifpga: not in enabled drivers build config 00:01:39.893 raw/ntb: not in enabled drivers build config 00:01:39.893 raw/skeleton: not in enabled drivers build config 00:01:39.893 crypto/armv8: not in enabled drivers build config 00:01:39.893 crypto/bcmfs: not in enabled drivers build config 00:01:39.893 crypto/caam_jr: not in enabled drivers build config 00:01:39.893 crypto/ccp: not in enabled drivers build config 00:01:39.893 crypto/cnxk: not in enabled drivers build config 00:01:39.893 crypto/dpaa_sec: not in enabled drivers build config 00:01:39.893 crypto/dpaa2_sec: not in enabled drivers build config 00:01:39.893 crypto/ipsec_mb: not in enabled drivers build config 00:01:39.893 crypto/mlx5: not in enabled drivers build config 00:01:39.893 crypto/mvsam: not in enabled drivers build config 00:01:39.893 crypto/nitrox: not in enabled drivers build config 00:01:39.893 crypto/null: not in enabled drivers build config 00:01:39.893 crypto/octeontx: not in enabled drivers build config 00:01:39.893 crypto/openssl: not in enabled drivers build config 00:01:39.893 crypto/scheduler: not in enabled drivers build config 00:01:39.893 crypto/uadk: not in enabled drivers build config 00:01:39.893 crypto/virtio: not in enabled drivers build config 00:01:39.893 compress/isal: not in enabled drivers build config 00:01:39.893 compress/mlx5: not in enabled drivers build config 00:01:39.893 compress/octeontx: not in enabled drivers build config 00:01:39.893 compress/zlib: not in enabled drivers build config 00:01:39.893 regex/mlx5: not in enabled drivers build config 00:01:39.893 regex/cn9k: not in enabled drivers build config 00:01:39.893 ml/cnxk: not in enabled drivers build config 00:01:39.893 vdpa/ifc: not in enabled drivers build config 00:01:39.893 vdpa/mlx5: not in enabled drivers build config 00:01:39.893 vdpa/nfp: not in enabled drivers build config 00:01:39.893 vdpa/sfc: not in enabled drivers build config 00:01:39.893 event/cnxk: not in enabled drivers build config 00:01:39.893 event/dlb2: not in enabled drivers build config 00:01:39.893 event/dpaa: not in enabled drivers build config 00:01:39.893 event/dpaa2: not in enabled drivers build config 00:01:39.893 event/dsw: not in enabled drivers build config 00:01:39.893 event/opdl: not in enabled drivers build config 00:01:39.893 event/skeleton: not in enabled drivers build config 00:01:39.893 event/sw: not in enabled drivers build config 00:01:39.893 event/octeontx: not in enabled drivers build config 00:01:39.893 baseband/acc: not in enabled drivers build config 00:01:39.893 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:39.893 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:39.893 baseband/la12xx: not in enabled drivers build config 00:01:39.893 baseband/null: not in enabled drivers build config 00:01:39.893 baseband/turbo_sw: not in enabled drivers build config 00:01:39.893 gpu/cuda: not in enabled drivers build config 00:01:39.893 00:01:39.893 00:01:39.893 Build targets in project: 220 00:01:39.893 00:01:39.893 DPDK 23.11.0 00:01:39.893 00:01:39.893 User defined options 00:01:39.893 libdir : lib 00:01:39.893 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:39.893 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:39.893 c_link_args : 00:01:39.893 enable_docs : false 00:01:39.893 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:39.893 enable_kmods : false 00:01:39.893 machine : native 00:01:39.893 tests : false 00:01:39.893 00:01:39.893 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:39.893 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:39.893 15:48:03 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:39.893 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:40.159 [1/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:40.159 [2/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:40.159 [3/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:40.159 [4/710] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:40.159 [5/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:40.159 [6/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:40.159 [7/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:40.159 [8/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:40.159 [9/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:40.159 [10/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:40.159 [11/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:40.159 [12/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:40.159 [13/710] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:40.159 [14/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:40.159 [15/710] Linking static target lib/librte_kvargs.a 00:01:40.422 [16/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:40.422 [17/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:40.422 [18/710] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:40.422 [19/710] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:40.422 [20/710] Linking static target lib/librte_log.a 00:01:40.422 [21/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:40.684 [22/710] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.943 [23/710] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.208 [24/710] Linking target lib/librte_log.so.24.0 00:01:41.208 [25/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:41.208 [26/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:41.208 [27/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:41.208 [28/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:41.208 [29/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:41.208 [30/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:41.208 [31/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:41.208 [32/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:41.208 [33/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:41.208 [34/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:41.208 [35/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:41.208 [36/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:41.208 [37/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:41.208 [38/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:41.208 [39/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:41.208 [40/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:41.208 [41/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:41.208 [42/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:41.208 [43/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:41.473 [44/710] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:41.473 [45/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:41.473 [46/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:41.473 [47/710] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:41.473 [48/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:41.473 [49/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:41.473 [50/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:41.473 [51/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:41.473 [52/710] Linking target lib/librte_kvargs.so.24.0 00:01:41.473 [53/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:41.473 [54/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:41.473 [55/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:41.473 [56/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:41.473 [57/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:41.473 [58/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:41.473 [59/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:41.473 [60/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:41.473 [61/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:41.473 [62/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:41.473 [63/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:41.734 [64/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:41.734 [65/710] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:41.734 [66/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:41.734 [67/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:41.996 [68/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:41.996 [69/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:41.996 [70/710] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:41.996 [71/710] Linking static target lib/librte_pci.a 00:01:41.996 [72/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:41.996 [73/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:41.996 [74/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:41.996 [75/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:42.257 [76/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:42.257 [77/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:42.257 [78/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:42.257 [79/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:42.257 [80/710] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.257 [81/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:42.257 [82/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:42.257 [83/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:42.257 [84/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:42.257 [85/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:42.518 [86/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:42.518 [87/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:42.518 [88/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:42.518 [89/710] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:42.518 [90/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:42.518 [91/710] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:42.518 [92/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:42.518 [93/710] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:42.518 [94/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:42.518 [95/710] Linking static target lib/librte_ring.a 00:01:42.518 [96/710] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:42.518 [97/710] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:42.518 [98/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:42.518 [99/710] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:42.518 [100/710] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:42.779 [101/710] Linking static target lib/librte_meter.a 00:01:42.779 [102/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:42.779 [103/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:42.779 [104/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:42.779 [105/710] Linking static target lib/librte_telemetry.a 00:01:42.779 [106/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:42.779 [107/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:42.779 [108/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:42.779 [109/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:42.779 [110/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:42.779 [111/710] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:42.779 [112/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:42.779 [113/710] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:43.040 [114/710] Linking static target lib/librte_eal.a 00:01:43.040 [115/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:43.040 [116/710] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.040 [117/710] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.040 [118/710] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:43.040 [119/710] Linking static target lib/librte_net.a 00:01:43.040 [120/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:43.040 [121/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:43.040 [122/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:43.040 [123/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:43.303 [124/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:43.303 [125/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:43.303 [126/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:43.303 [127/710] Linking static target lib/librte_cmdline.a 00:01:43.303 [128/710] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.303 [129/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:43.303 [130/710] Linking static target lib/librte_mempool.a 00:01:43.303 [131/710] Linking target lib/librte_telemetry.so.24.0 00:01:43.303 [132/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:43.565 [133/710] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.565 [134/710] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:43.565 [135/710] Linking static target lib/librte_cfgfile.a 00:01:43.565 [136/710] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:43.565 [137/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:43.565 [138/710] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:43.565 [139/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:43.565 [140/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:43.565 [141/710] Linking static target lib/librte_metrics.a 00:01:43.565 [142/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:43.830 [143/710] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:43.830 [144/710] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:43.830 [145/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:44.095 [146/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:44.095 [147/710] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:44.095 [148/710] Linking static target lib/librte_bitratestats.a 00:01:44.095 [149/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:44.095 [150/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:44.095 [151/710] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:44.095 [152/710] Linking static target lib/librte_rcu.a 00:01:44.095 [153/710] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.095 [154/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:44.095 [155/710] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:44.358 [156/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:44.358 [157/710] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:44.358 [158/710] Linking static target lib/librte_timer.a 00:01:44.358 [159/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:44.358 [160/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:44.358 [161/710] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.358 [162/710] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.358 [163/710] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.358 [164/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:44.621 [165/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:44.621 [166/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:44.621 [167/710] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.621 [168/710] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:44.621 [169/710] Linking static target lib/librte_bbdev.a 00:01:44.621 [170/710] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.621 [171/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:44.621 [172/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:44.885 [173/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:44.885 [174/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:44.885 [175/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:44.885 [176/710] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.885 [177/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:44.885 [178/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:44.885 [179/710] Linking static target lib/librte_compressdev.a 00:01:44.885 [180/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:45.148 [181/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:45.148 [182/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:45.148 [183/710] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:45.410 [184/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:45.410 [185/710] Linking static target lib/librte_distributor.a 00:01:45.410 [186/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:45.674 [187/710] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.674 [188/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:45.674 [189/710] Linking static target lib/librte_dmadev.a 00:01:45.674 [190/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:45.674 [191/710] Linking static target lib/librte_bpf.a 00:01:45.674 [192/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:45.674 [193/710] Compiling C object lib/librte_dispatcher.a.p/dispatcher_rte_dispatcher.c.o 00:01:45.674 [194/710] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:45.674 [195/710] Linking static target lib/librte_dispatcher.a 00:01:45.674 [196/710] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:45.674 [197/710] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.674 [198/710] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.937 [199/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp6.c.o 00:01:45.937 [200/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:45.937 [201/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:45.937 [202/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:45.937 [203/710] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:45.937 [204/710] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:45.937 [205/710] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:45.937 [206/710] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:45.937 [207/710] Linking static target lib/librte_gpudev.a 00:01:45.937 [208/710] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:45.937 [209/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:46.196 [210/710] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:46.196 [211/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:46.196 [212/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:46.196 [213/710] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:46.196 [214/710] Linking static target lib/librte_gro.a 00:01:46.196 [215/710] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.196 [216/710] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.196 [217/710] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:46.196 [218/710] Linking static target lib/librte_jobstats.a 00:01:46.464 [219/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:46.464 [220/710] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:46.464 [221/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_dma_adapter.c.o 00:01:46.464 [222/710] Generating lib/dispatcher.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.464 [223/710] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.725 [224/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:46.725 [225/710] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:46.725 [226/710] Linking static target lib/librte_latencystats.a 00:01:46.725 [227/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:46.725 [228/710] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:46.725 [229/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:46.725 [230/710] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:46.985 [231/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:46.985 [232/710] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.985 [233/710] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:46.985 [234/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:46.985 [235/710] Linking static target lib/librte_ip_frag.a 00:01:46.985 [236/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:46.985 [237/710] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:46.985 [238/710] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.248 [239/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:47.248 [240/710] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:47.248 [241/710] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:47.248 [242/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:47.248 [243/710] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:47.513 [244/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev_pmd.c.o 00:01:47.513 [245/710] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.513 [246/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils.c.o 00:01:47.513 [247/710] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.776 [248/710] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:47.776 [249/710] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:47.776 [250/710] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:47.776 [251/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:47.776 [252/710] Linking static target lib/librte_regexdev.a 00:01:47.777 [253/710] Linking static target lib/librte_gso.a 00:01:47.777 [254/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar_bfloat16.c.o 00:01:47.777 [255/710] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:47.777 [256/710] Linking static target lib/librte_rawdev.a 00:01:47.777 [257/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev.c.o 00:01:47.777 [258/710] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:48.037 [259/710] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:48.037 [260/710] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:48.037 [261/710] Linking static target lib/librte_efd.a 00:01:48.037 [262/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar.c.o 00:01:48.037 [263/710] Linking static target lib/librte_mldev.a 00:01:48.037 [264/710] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.037 [265/710] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:48.037 [266/710] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:48.037 [267/710] Linking static target lib/librte_pcapng.a 00:01:48.037 [268/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:48.037 [269/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:48.037 [270/710] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:48.300 [271/710] Linking static target lib/acl/libavx2_tmp.a 00:01:48.300 [272/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:48.300 [273/710] Linking static target lib/librte_lpm.a 00:01:48.300 [274/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:48.300 [275/710] Linking static target lib/librte_stack.a 00:01:48.300 [276/710] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:48.300 [277/710] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:48.300 [278/710] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:48.300 [279/710] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.300 [280/710] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:48.564 [281/710] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.564 [282/710] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:48.564 [283/710] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.564 [284/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:48.564 [285/710] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:48.564 [286/710] Linking static target lib/librte_hash.a 00:01:48.564 [287/710] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.564 [288/710] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:48.564 [289/710] Linking static target lib/acl/libavx512_tmp.a 00:01:48.564 [290/710] Linking static target lib/librte_acl.a 00:01:48.826 [291/710] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:48.826 [292/710] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:48.826 [293/710] Linking static target lib/librte_reorder.a 00:01:48.826 [294/710] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.826 [295/710] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:48.826 [296/710] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:48.826 [297/710] Linking static target lib/librte_power.a 00:01:48.826 [298/710] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.826 [299/710] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:49.087 [300/710] Linking static target lib/librte_security.a 00:01:49.087 [301/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:49.087 [302/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:49.087 [303/710] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:49.087 [304/710] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.087 [305/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:49.353 [306/710] Linking static target lib/librte_rib.a 00:01:49.353 [307/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:49.353 [308/710] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.353 [309/710] Linking static target lib/librte_mbuf.a 00:01:49.353 [310/710] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:49.353 [311/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:49.353 [312/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_reorder.c.o 00:01:49.353 [313/710] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.353 [314/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_crypto.c.o 00:01:49.353 [315/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_ctrl_pdu.c.o 00:01:49.353 [316/710] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:49.614 [317/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_cnt.c.o 00:01:49.614 [318/710] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.614 [319/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:49.614 [320/710] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:49.614 [321/710] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:49.614 [322/710] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:49.614 [323/710] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:49.614 [324/710] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:49.614 [325/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:49.614 [326/710] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.882 [327/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:49.882 [328/710] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.882 [329/710] Generating lib/mldev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.142 [330/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:50.142 [331/710] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.142 [332/710] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:50.142 [333/710] Compiling C object lib/librte_pdcp.a.p/pdcp_rte_pdcp.c.o 00:01:50.400 [334/710] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:50.400 [335/710] Linking static target lib/librte_member.a 00:01:50.400 [336/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:50.663 [337/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:50.663 [338/710] Linking static target lib/librte_cryptodev.a 00:01:50.663 [339/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:50.663 [340/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:50.663 [341/710] Linking static target lib/librte_eventdev.a 00:01:50.663 [342/710] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:50.663 [343/710] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:50.663 [344/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:50.925 [345/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:50.925 [346/710] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:50.925 [347/710] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:50.925 [348/710] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:50.925 [349/710] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.925 [350/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:50.925 [351/710] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:50.925 [352/710] Linking static target lib/librte_ethdev.a 00:01:50.925 [353/710] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:50.925 [354/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:50.925 [355/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:50.925 [356/710] Linking static target lib/librte_sched.a 00:01:50.925 [357/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:50.925 [358/710] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:50.925 [359/710] Linking static target lib/librte_fib.a 00:01:51.184 [360/710] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:51.184 [361/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:51.184 [362/710] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:51.184 [363/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:51.184 [364/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:51.184 [365/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:51.445 [366/710] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:51.445 [367/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:51.445 [368/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:51.445 [369/710] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:51.445 [370/710] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.705 [371/710] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.705 [372/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:51.705 [373/710] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:51.968 [374/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:51.968 [375/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:51.968 [376/710] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:51.968 [377/710] Linking static target lib/librte_pdump.a 00:01:52.227 [378/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:52.227 [379/710] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:52.227 [380/710] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:52.227 [381/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_worker.c.o 00:01:52.227 [382/710] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:52.227 [383/710] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:52.227 [384/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:52.227 [385/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:52.227 [386/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:52.227 [387/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:52.227 [388/710] Compiling C object lib/librte_graph.a.p/graph_graph_pcap.c.o 00:01:52.227 [389/710] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:52.494 [390/710] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.494 [391/710] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:52.494 [392/710] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.494 [393/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:52.494 [394/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:52.494 [395/710] Linking static target lib/librte_ipsec.a 00:01:52.494 [396/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:52.494 [397/710] Linking static target lib/librte_table.a 00:01:52.757 [398/710] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:52.757 [399/710] Compiling C object lib/librte_node.a.p/node_kernel_tx.c.o 00:01:52.757 [400/710] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:53.019 [401/710] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.019 [402/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:53.286 [403/710] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:53.286 [404/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:53.548 [405/710] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:53.548 [406/710] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:53.548 [407/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:53.548 [408/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:53.548 [409/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:53.548 [410/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:53.548 [411/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ipsec.c.o 00:01:53.548 [412/710] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:53.815 [413/710] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.815 [414/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:53.815 [415/710] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:53.815 [416/710] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.815 [417/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:53.815 [418/710] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.815 [419/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:53.815 [420/710] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:53.815 [421/710] Linking target lib/librte_eal.so.24.0 00:01:54.096 [422/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:54.096 [423/710] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:54.096 [424/710] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:54.096 [425/710] Linking static target drivers/librte_bus_vdev.a 00:01:54.096 [426/710] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:54.383 [427/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:54.383 [428/710] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:54.383 [429/710] Linking target lib/librte_ring.so.24.0 00:01:54.383 [430/710] Linking target lib/librte_meter.so.24.0 00:01:54.383 [431/710] Linking target lib/librte_pci.so.24.0 00:01:54.383 [432/710] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:54.383 [433/710] Linking target lib/librte_timer.so.24.0 00:01:54.383 [434/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_model_mcore_dispatch.c.o 00:01:54.671 [435/710] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:54.671 [436/710] Compiling C object lib/librte_node.a.p/node_ip4_reassembly.c.o 00:01:54.671 [437/710] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:54.671 [438/710] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:54.671 [439/710] Linking target lib/librte_rcu.so.24.0 00:01:54.671 [440/710] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.671 [441/710] Linking target lib/librte_mempool.so.24.0 00:01:54.671 [442/710] Linking target lib/librte_acl.so.24.0 00:01:54.671 [443/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:54.671 [444/710] Compiling C object lib/librte_node.a.p/node_kernel_rx.c.o 00:01:54.671 [445/710] Linking target lib/librte_cfgfile.so.24.0 00:01:54.671 [446/710] Linking target lib/librte_dmadev.so.24.0 00:01:54.671 [447/710] Linking static target lib/librte_port.a 00:01:54.671 [448/710] Linking target lib/librte_jobstats.so.24.0 00:01:54.671 [449/710] Linking static target lib/librte_graph.a 00:01:54.671 [450/710] Linking target lib/librte_rawdev.so.24.0 00:01:54.671 [451/710] Linking target lib/librte_stack.so.24.0 00:01:54.671 [452/710] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:54.671 [453/710] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:54.671 [454/710] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:54.671 [455/710] Linking static target drivers/librte_bus_pci.a 00:01:54.671 [456/710] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:54.948 [457/710] Linking target drivers/librte_bus_vdev.so.24.0 00:01:54.948 [458/710] Compiling C object app/dpdk-graph.p/graph_cli.c.o 00:01:54.948 [459/710] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:54.948 [460/710] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:54.948 [461/710] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:54.948 [462/710] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:54.948 [463/710] Generating symbol file lib/librte_acl.so.24.0.p/librte_acl.so.24.0.symbols 00:01:54.948 [464/710] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:54.948 [465/710] Linking target lib/librte_mbuf.so.24.0 00:01:54.948 [466/710] Linking target lib/librte_rib.so.24.0 00:01:54.948 [467/710] Compiling C object app/dpdk-graph.p/graph_conn.c.o 00:01:54.948 [468/710] Compiling C object app/dpdk-graph.p/graph_ethdev_rx.c.o 00:01:54.948 [469/710] Generating symbol file drivers/librte_bus_vdev.so.24.0.p/librte_bus_vdev.so.24.0.symbols 00:01:55.212 [470/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:55.212 [471/710] Compiling C object app/dpdk-graph.p/graph_ip4_route.c.o 00:01:55.212 [472/710] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:55.212 [473/710] Generating symbol file lib/librte_rib.so.24.0.p/librte_rib.so.24.0.symbols 00:01:55.212 [474/710] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:55.212 [475/710] Linking target lib/librte_bbdev.so.24.0 00:01:55.212 [476/710] Linking target lib/librte_net.so.24.0 00:01:55.212 [477/710] Linking target lib/librte_compressdev.so.24.0 00:01:55.212 [478/710] Linking target lib/librte_cryptodev.so.24.0 00:01:55.212 [479/710] Compiling C object app/dpdk-graph.p/graph_ip6_route.c.o 00:01:55.477 [480/710] Linking target lib/librte_gpudev.so.24.0 00:01:55.477 [481/710] Linking target lib/librte_distributor.so.24.0 00:01:55.477 [482/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:55.477 [483/710] Compiling C object app/dpdk-graph.p/graph_ethdev.c.o 00:01:55.477 [484/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:55.477 [485/710] Compiling C object app/dpdk-graph.p/graph_graph.c.o 00:01:55.477 [486/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:55.477 [487/710] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:55.477 [488/710] Linking target lib/librte_regexdev.so.24.0 00:01:55.477 [489/710] Linking target lib/librte_mldev.so.24.0 00:01:55.477 [490/710] Linking target lib/librte_reorder.so.24.0 00:01:55.477 [491/710] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.477 [492/710] Linking target lib/librte_sched.so.24.0 00:01:55.477 [493/710] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:55.477 [494/710] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:55.477 [495/710] Linking target lib/librte_fib.so.24.0 00:01:55.477 [496/710] Linking static target drivers/librte_mempool_ring.a 00:01:55.477 [497/710] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.477 [498/710] Linking target lib/librte_hash.so.24.0 00:01:55.477 [499/710] Linking target lib/librte_cmdline.so.24.0 00:01:55.477 [500/710] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:55.477 [501/710] Linking target drivers/librte_mempool_ring.so.24.0 00:01:55.740 [502/710] Linking target drivers/librte_bus_pci.so.24.0 00:01:55.740 [503/710] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:55.740 [504/710] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.740 [505/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:55.740 [506/710] Linking target lib/librte_security.so.24.0 00:01:55.740 [507/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:55.740 [508/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_recycle_mbufs_vec_common.c.o 00:01:55.740 [509/710] Generating symbol file lib/librte_reorder.so.24.0.p/librte_reorder.so.24.0.symbols 00:01:55.740 [510/710] Generating symbol file lib/librte_sched.so.24.0.p/librte_sched.so.24.0.symbols 00:01:55.740 [511/710] Compiling C object lib/librte_node.a.p/node_ip4_local.c.o 00:01:55.740 [512/710] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:55.740 [513/710] Generating symbol file drivers/librte_bus_pci.so.24.0.p/librte_bus_pci.so.24.0.symbols 00:01:55.999 [514/710] Linking target lib/librte_efd.so.24.0 00:01:55.999 [515/710] Generating symbol file lib/librte_security.so.24.0.p/librte_security.so.24.0.symbols 00:01:55.999 [516/710] Linking target lib/librte_lpm.so.24.0 00:01:55.999 [517/710] Linking target lib/librte_member.so.24.0 00:01:55.999 [518/710] Linking target lib/librte_ipsec.so.24.0 00:01:55.999 [519/710] Compiling C object app/dpdk-graph.p/graph_main.c.o 00:01:55.999 [520/710] Compiling C object app/dpdk-graph.p/graph_mempool.c.o 00:01:55.999 [521/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:55.999 [522/710] Compiling C object app/dpdk-graph.p/graph_l3fwd.c.o 00:01:56.261 [523/710] Generating symbol file lib/librte_lpm.so.24.0.p/librte_lpm.so.24.0.symbols 00:01:56.261 [524/710] Generating symbol file lib/librte_ipsec.so.24.0.p/librte_ipsec.so.24.0.symbols 00:01:56.261 [525/710] Compiling C object app/dpdk-graph.p/graph_utils.c.o 00:01:56.522 [526/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:56.522 [527/710] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:56.522 [528/710] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:56.522 [529/710] Compiling C object lib/librte_node.a.p/node_udp4_input.c.o 00:01:56.522 [530/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:56.522 [531/710] Compiling C object app/dpdk-graph.p/graph_neigh.c.o 00:01:56.780 [532/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:56.780 [533/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:57.043 [534/710] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:57.043 [535/710] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:57.043 [536/710] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:57.043 [537/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:57.043 [538/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:57.043 [539/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:57.043 [540/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:57.304 [541/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:57.304 [542/710] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:57.566 [543/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:57.566 [544/710] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:57.566 [545/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:57.566 [546/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:57.832 [547/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:57.832 [548/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:57.832 [549/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:57.832 [550/710] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:57.832 [551/710] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:57.832 [552/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_main.c.o 00:01:57.832 [553/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:57.832 [554/710] Compiling C object lib/librte_node.a.p/node_ip6_lookup.c.o 00:01:57.832 [555/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:57.832 [556/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_test.c.o 00:01:58.097 [557/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:58.360 [558/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_parser.c.o 00:01:58.360 [559/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:58.360 [560/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:58.620 [561/710] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.620 [562/710] Linking target lib/librte_ethdev.so.24.0 00:01:58.883 [563/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:58.883 [564/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:58.883 [565/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:58.883 [566/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_main.c.o 00:01:58.883 [567/710] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:59.144 [568/710] Linking target lib/librte_metrics.so.24.0 00:01:59.144 [569/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_common.c.o 00:01:59.144 [570/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:59.144 [571/710] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:59.144 [572/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_device_ops.c.o 00:01:59.144 [573/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:59.144 [574/710] Linking target lib/librte_bpf.so.24.0 00:01:59.144 [575/710] Linking target lib/librte_eventdev.so.24.0 00:01:59.144 [576/710] Linking target lib/librte_gro.so.24.0 00:01:59.144 [577/710] Linking target lib/librte_gso.so.24.0 00:01:59.144 [578/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:59.144 [579/710] Linking target lib/librte_ip_frag.so.24.0 00:01:59.144 [580/710] Generating symbol file lib/librte_metrics.so.24.0.p/librte_metrics.so.24.0.symbols 00:01:59.144 [581/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_options.c.o 00:01:59.409 [582/710] Linking target lib/librte_pcapng.so.24.0 00:01:59.409 [583/710] Linking target lib/librte_power.so.24.0 00:01:59.409 [584/710] Linking target lib/librte_latencystats.so.24.0 00:01:59.409 [585/710] Linking target lib/librte_bitratestats.so.24.0 00:01:59.409 [586/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_ops.c.o 00:01:59.409 [587/710] Generating symbol file lib/librte_bpf.so.24.0.p/librte_bpf.so.24.0.symbols 00:01:59.409 [588/710] Generating symbol file lib/librte_eventdev.so.24.0.p/librte_eventdev.so.24.0.symbols 00:01:59.409 [589/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_ordered.c.o 00:01:59.409 [590/710] Generating symbol file lib/librte_ip_frag.so.24.0.p/librte_ip_frag.so.24.0.symbols 00:01:59.671 [591/710] Linking target lib/librte_dispatcher.so.24.0 00:01:59.671 [592/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_interleave.c.o 00:01:59.671 [593/710] Generating symbol file lib/librte_pcapng.so.24.0.p/librte_pcapng.so.24.0.symbols 00:01:59.671 [594/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_benchmark.c.o 00:01:59.671 [595/710] Linking target lib/librte_port.so.24.0 00:01:59.671 [596/710] Linking target lib/librte_pdump.so.24.0 00:01:59.671 [597/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_stats.c.o 00:01:59.671 [598/710] Linking target lib/librte_graph.so.24.0 00:01:59.671 [599/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:59.671 [600/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:59.671 [601/710] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:59.936 [602/710] Generating symbol file lib/librte_port.so.24.0.p/librte_port.so.24.0.symbols 00:01:59.936 [603/710] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:59.936 [604/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_process.c.o 00:01:59.936 [605/710] Linking static target lib/librte_pdcp.a 00:01:59.936 [606/710] Generating symbol file lib/librte_graph.so.24.0.p/librte_graph.so.24.0.symbols 00:01:59.936 [607/710] Linking target lib/librte_table.so.24.0 00:01:59.936 [608/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:59.936 [609/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:59.936 [610/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_common.c.o 00:02:00.199 [611/710] Generating symbol file lib/librte_table.so.24.0.p/librte_table.so.24.0.symbols 00:02:00.199 [612/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:02:00.199 [613/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:02:00.199 [614/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:02:00.461 [615/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:02:00.461 [616/710] Generating lib/pdcp.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.461 [617/710] Linking target lib/librte_pdcp.so.24.0 00:02:00.461 [618/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:02:00.724 [619/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:02:00.724 [620/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:02:00.724 [621/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:02:00.724 [622/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:02:00.724 [623/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:02:00.987 [624/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:02:00.987 [625/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:02:00.987 [626/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_cman.c.o 00:02:00.987 [627/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:02:00.987 [628/710] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:02:00.987 [629/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:02:00.987 [630/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:02:01.558 [631/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:02:01.558 [632/710] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:02:01.558 [633/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:02:01.558 [634/710] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:02:01.558 [635/710] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:02:01.558 [636/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:02:01.558 [637/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:02:01.558 [638/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:02:01.559 [639/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:02:01.559 [640/710] Compiling C object app/dpdk-testpmd.p/test-pmd_recycle_mbufs.c.o 00:02:01.817 [641/710] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:02:01.817 [642/710] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:02:01.817 [643/710] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:02:02.076 [644/710] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:02:02.076 [645/710] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:02:02.076 [646/710] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:02:02.334 [647/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:02:02.334 [648/710] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:02:02.334 [649/710] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:02:02.334 [650/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:02:02.334 [651/710] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:02:02.592 [652/710] Linking static target drivers/libtmp_rte_net_i40e.a 00:02:02.592 [653/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:02:02.592 [654/710] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:02:02.850 [655/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:02:02.850 [656/710] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:02:02.850 [657/710] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:02:03.108 [658/710] Compiling C object drivers/librte_net_i40e.so.24.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:03.108 [659/710] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:03.108 [660/710] Linking static target drivers/librte_net_i40e.a 00:02:03.108 [661/710] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:02:03.108 [662/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:02:03.108 [663/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:02:03.366 [664/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:02:03.366 [665/710] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:02:03.624 [666/710] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.624 [667/710] Linking target drivers/librte_net_i40e.so.24.0 00:02:03.882 [668/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:02:03.882 [669/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:02:04.141 [670/710] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:02:04.141 [671/710] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:02:04.706 [672/710] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:02:04.706 [673/710] Compiling C object lib/librte_node.a.p/node_ip6_rewrite.c.o 00:02:04.706 [674/710] Linking static target lib/librte_node.a 00:02:04.963 [675/710] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.963 [676/710] Linking target lib/librte_node.so.24.0 00:02:05.896 [677/710] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:02:05.896 [678/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_common.c.o 00:02:06.154 [679/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:02:07.527 [680/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:08.462 [681/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:12.647 [682/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:44.714 [683/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:44.714 [684/710] Linking static target lib/librte_vhost.a 00:02:45.280 [685/710] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:45.537 [686/710] Linking target lib/librte_vhost.so.24.0 00:02:57.743 [687/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:57.743 [688/710] Linking static target lib/librte_pipeline.a 00:02:57.743 [689/710] Linking target app/dpdk-pdump 00:02:57.743 [690/710] Linking target app/dpdk-test-cmdline 00:02:57.743 [691/710] Linking target app/dpdk-dumpcap 00:02:57.743 [692/710] Linking target app/dpdk-test-gpudev 00:02:57.743 [693/710] Linking target app/dpdk-test-regex 00:02:57.743 [694/710] Linking target app/dpdk-test-security-perf 00:02:57.743 [695/710] Linking target app/dpdk-test-acl 00:02:57.743 [696/710] Linking target app/dpdk-graph 00:02:57.743 [697/710] Linking target app/dpdk-proc-info 00:02:57.743 [698/710] Linking target app/dpdk-test-fib 00:02:57.743 [699/710] Linking target app/dpdk-test-crypto-perf 00:02:57.743 [700/710] Linking target app/dpdk-test-compress-perf 00:02:57.743 [701/710] Linking target app/dpdk-test-dma-perf 00:02:57.743 [702/710] Linking target app/dpdk-test-sad 00:02:57.743 [703/710] Linking target app/dpdk-test-pipeline 00:02:57.743 [704/710] Linking target app/dpdk-test-flow-perf 00:02:57.743 [705/710] Linking target app/dpdk-test-mldev 00:02:57.743 [706/710] Linking target app/dpdk-test-bbdev 00:02:57.743 [707/710] Linking target app/dpdk-test-eventdev 00:02:57.743 [708/710] Linking target app/dpdk-testpmd 00:02:59.643 [709/710] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:59.643 [710/710] Linking target lib/librte_pipeline.so.24.0 00:02:59.643 15:49:23 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:59.901 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:59.901 [0/1] Installing files. 00:03:00.163 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:03:00.164 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:03:00.165 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec_sa.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.166 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:03:00.167 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:00.168 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:03:00.169 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:03:00.169 Installing lib/librte_log.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.169 Installing lib/librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.169 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.169 Installing lib/librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.169 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.169 Installing lib/librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.428 Installing lib/librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_dispatcher.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_mldev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.429 Installing lib/librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_pdcp.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing lib/librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.998 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.999 Installing drivers/librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:00.999 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.999 Installing drivers/librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:00.999 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.999 Installing drivers/librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:00.999 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:00.999 Installing drivers/librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:03:00.999 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-graph to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-dma-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-mldev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/log/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:00.999 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lock_annotations.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_stdatomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.000 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_dtls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_pdcp_hdr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.001 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_dma_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dispatcher/rte_dispatcher.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.002 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_mcore_dispatch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_rtc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip6_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_udp4_input_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/dpdk-cmdline-gen.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-rss-flows.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:03:01.003 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:03:01.003 Installing symlink pointing to librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so.24 00:03:01.003 Installing symlink pointing to librte_log.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so 00:03:01.003 Installing symlink pointing to librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.24 00:03:01.003 Installing symlink pointing to librte_kvargs.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:03:01.003 Installing symlink pointing to librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.24 00:03:01.003 Installing symlink pointing to librte_telemetry.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:03:01.004 Installing symlink pointing to librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.24 00:03:01.004 Installing symlink pointing to librte_eal.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:03:01.004 Installing symlink pointing to librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.24 00:03:01.004 Installing symlink pointing to librte_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:03:01.004 Installing symlink pointing to librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.24 00:03:01.004 Installing symlink pointing to librte_rcu.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:03:01.004 Installing symlink pointing to librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.24 00:03:01.004 Installing symlink pointing to librte_mempool.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:03:01.004 Installing symlink pointing to librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.24 00:03:01.004 Installing symlink pointing to librte_mbuf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:03:01.004 Installing symlink pointing to librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.24 00:03:01.004 Installing symlink pointing to librte_net.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:03:01.004 Installing symlink pointing to librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.24 00:03:01.004 Installing symlink pointing to librte_meter.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:03:01.004 Installing symlink pointing to librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.24 00:03:01.004 Installing symlink pointing to librte_ethdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:03:01.004 Installing symlink pointing to librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.24 00:03:01.004 Installing symlink pointing to librte_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:03:01.004 Installing symlink pointing to librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.24 00:03:01.004 Installing symlink pointing to librte_cmdline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:03:01.004 Installing symlink pointing to librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.24 00:03:01.004 Installing symlink pointing to librte_metrics.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:03:01.004 Installing symlink pointing to librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.24 00:03:01.004 Installing symlink pointing to librte_hash.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:03:01.004 Installing symlink pointing to librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.24 00:03:01.004 Installing symlink pointing to librte_timer.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:03:01.004 Installing symlink pointing to librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.24 00:03:01.004 Installing symlink pointing to librte_acl.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:03:01.004 Installing symlink pointing to librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.24 00:03:01.004 Installing symlink pointing to librte_bbdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:03:01.004 Installing symlink pointing to librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.24 00:03:01.004 Installing symlink pointing to librte_bitratestats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:03:01.004 Installing symlink pointing to librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.24 00:03:01.004 Installing symlink pointing to librte_bpf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:03:01.004 Installing symlink pointing to librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.24 00:03:01.004 Installing symlink pointing to librte_cfgfile.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:03:01.004 Installing symlink pointing to librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.24 00:03:01.004 Installing symlink pointing to librte_compressdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:03:01.004 Installing symlink pointing to librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.24 00:03:01.004 Installing symlink pointing to librte_cryptodev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:03:01.004 Installing symlink pointing to librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.24 00:03:01.004 Installing symlink pointing to librte_distributor.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:03:01.004 Installing symlink pointing to librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.24 00:03:01.004 Installing symlink pointing to librte_dmadev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:03:01.004 Installing symlink pointing to librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.24 00:03:01.004 Installing symlink pointing to librte_efd.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:03:01.004 Installing symlink pointing to librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.24 00:03:01.004 Installing symlink pointing to librte_eventdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:03:01.004 Installing symlink pointing to librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so.24 00:03:01.004 Installing symlink pointing to librte_dispatcher.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so 00:03:01.004 Installing symlink pointing to librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.24 00:03:01.004 Installing symlink pointing to librte_gpudev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:03:01.004 Installing symlink pointing to librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.24 00:03:01.004 Installing symlink pointing to librte_gro.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:03:01.004 Installing symlink pointing to librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.24 00:03:01.004 Installing symlink pointing to librte_gso.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:03:01.004 Installing symlink pointing to librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.24 00:03:01.004 Installing symlink pointing to librte_ip_frag.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:03:01.004 Installing symlink pointing to librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.24 00:03:01.004 Installing symlink pointing to librte_jobstats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:03:01.004 Installing symlink pointing to librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.24 00:03:01.004 Installing symlink pointing to librte_latencystats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:03:01.005 Installing symlink pointing to librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.24 00:03:01.005 Installing symlink pointing to librte_lpm.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:03:01.005 Installing symlink pointing to librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.24 00:03:01.005 Installing symlink pointing to librte_member.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:03:01.005 Installing symlink pointing to librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.24 00:03:01.005 Installing symlink pointing to librte_pcapng.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:03:01.005 Installing symlink pointing to librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.24 00:03:01.005 Installing symlink pointing to librte_power.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:03:01.005 Installing symlink pointing to librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.24 00:03:01.005 Installing symlink pointing to librte_rawdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:03:01.005 Installing symlink pointing to librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.24 00:03:01.005 Installing symlink pointing to librte_regexdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:03:01.005 './librte_bus_pci.so' -> 'dpdk/pmds-24.0/librte_bus_pci.so' 00:03:01.005 './librte_bus_pci.so.24' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24' 00:03:01.005 './librte_bus_pci.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24.0' 00:03:01.005 './librte_bus_vdev.so' -> 'dpdk/pmds-24.0/librte_bus_vdev.so' 00:03:01.005 './librte_bus_vdev.so.24' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24' 00:03:01.005 './librte_bus_vdev.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24.0' 00:03:01.005 './librte_mempool_ring.so' -> 'dpdk/pmds-24.0/librte_mempool_ring.so' 00:03:01.005 './librte_mempool_ring.so.24' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24' 00:03:01.005 './librte_mempool_ring.so.24.0' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24.0' 00:03:01.005 './librte_net_i40e.so' -> 'dpdk/pmds-24.0/librte_net_i40e.so' 00:03:01.005 './librte_net_i40e.so.24' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24' 00:03:01.005 './librte_net_i40e.so.24.0' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24.0' 00:03:01.005 Installing symlink pointing to librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so.24 00:03:01.005 Installing symlink pointing to librte_mldev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so 00:03:01.005 Installing symlink pointing to librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.24 00:03:01.005 Installing symlink pointing to librte_rib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:03:01.005 Installing symlink pointing to librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.24 00:03:01.005 Installing symlink pointing to librte_reorder.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:03:01.005 Installing symlink pointing to librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.24 00:03:01.005 Installing symlink pointing to librte_sched.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:03:01.005 Installing symlink pointing to librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.24 00:03:01.005 Installing symlink pointing to librte_security.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:03:01.005 Installing symlink pointing to librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.24 00:03:01.005 Installing symlink pointing to librte_stack.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:03:01.005 Installing symlink pointing to librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.24 00:03:01.005 Installing symlink pointing to librte_vhost.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:03:01.005 Installing symlink pointing to librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.24 00:03:01.005 Installing symlink pointing to librte_ipsec.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:03:01.005 Installing symlink pointing to librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so.24 00:03:01.005 Installing symlink pointing to librte_pdcp.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so 00:03:01.005 Installing symlink pointing to librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.24 00:03:01.005 Installing symlink pointing to librte_fib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:03:01.005 Installing symlink pointing to librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.24 00:03:01.005 Installing symlink pointing to librte_port.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:03:01.005 Installing symlink pointing to librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.24 00:03:01.005 Installing symlink pointing to librte_pdump.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:03:01.005 Installing symlink pointing to librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.24 00:03:01.005 Installing symlink pointing to librte_table.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:03:01.005 Installing symlink pointing to librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.24 00:03:01.005 Installing symlink pointing to librte_pipeline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:03:01.005 Installing symlink pointing to librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.24 00:03:01.005 Installing symlink pointing to librte_graph.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:03:01.005 Installing symlink pointing to librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.24 00:03:01.005 Installing symlink pointing to librte_node.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:03:01.005 Installing symlink pointing to librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24 00:03:01.005 Installing symlink pointing to librte_bus_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:03:01.005 Installing symlink pointing to librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24 00:03:01.005 Installing symlink pointing to librte_bus_vdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:03:01.005 Installing symlink pointing to librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24 00:03:01.005 Installing symlink pointing to librte_mempool_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:03:01.005 Installing symlink pointing to librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24 00:03:01.005 Installing symlink pointing to librte_net_i40e.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:03:01.005 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-24.0' 00:03:01.005 15:49:24 -- common/autobuild_common.sh@192 -- $ uname -s 00:03:01.005 15:49:24 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:03:01.005 15:49:24 -- common/autobuild_common.sh@203 -- $ cat 00:03:01.005 15:49:24 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:01.005 00:03:01.005 real 1m27.227s 00:03:01.005 user 18m2.203s 00:03:01.005 sys 2m9.114s 00:03:01.005 15:49:24 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:01.005 15:49:24 -- common/autotest_common.sh@10 -- $ set +x 00:03:01.005 ************************************ 00:03:01.005 END TEST build_native_dpdk 00:03:01.005 ************************************ 00:03:01.005 15:49:24 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:03:01.005 15:49:24 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:03:01.005 15:49:24 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:03:01.005 15:49:24 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:03:01.005 15:49:24 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:03:01.005 15:49:24 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:03:01.005 15:49:24 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:03:01.005 15:49:24 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:03:01.263 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:03:01.263 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:03:01.263 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:03:01.263 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:03:01.546 Using 'verbs' RDMA provider 00:03:11.820 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:19.930 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:20.188 Creating mk/config.mk...done. 00:03:20.188 Creating mk/cc.flags.mk...done. 00:03:20.188 Type 'make' to build. 00:03:20.188 15:49:43 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:20.188 15:49:43 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:20.188 15:49:43 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:20.188 15:49:43 -- common/autotest_common.sh@10 -- $ set +x 00:03:20.188 ************************************ 00:03:20.188 START TEST make 00:03:20.188 ************************************ 00:03:20.188 15:49:43 -- common/autotest_common.sh@1114 -- $ make -j48 00:03:20.451 make[1]: Nothing to be done for 'all'. 00:03:22.375 The Meson build system 00:03:22.375 Version: 1.5.0 00:03:22.375 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:22.375 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:22.375 Build type: native build 00:03:22.375 Project name: libvfio-user 00:03:22.375 Project version: 0.0.1 00:03:22.375 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:22.375 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:22.375 Host machine cpu family: x86_64 00:03:22.375 Host machine cpu: x86_64 00:03:22.375 Run-time dependency threads found: YES 00:03:22.375 Library dl found: YES 00:03:22.375 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:22.375 Run-time dependency json-c found: YES 0.17 00:03:22.375 Run-time dependency cmocka found: YES 1.1.7 00:03:22.375 Program pytest-3 found: NO 00:03:22.375 Program flake8 found: NO 00:03:22.375 Program misspell-fixer found: NO 00:03:22.375 Program restructuredtext-lint found: NO 00:03:22.375 Program valgrind found: YES (/usr/bin/valgrind) 00:03:22.375 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:22.375 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:22.375 Compiler for C supports arguments -Wwrite-strings: YES 00:03:22.375 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:22.375 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:22.375 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:22.375 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:22.375 Build targets in project: 8 00:03:22.375 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:22.375 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:22.375 00:03:22.375 libvfio-user 0.0.1 00:03:22.375 00:03:22.375 User defined options 00:03:22.375 buildtype : debug 00:03:22.375 default_library: shared 00:03:22.375 libdir : /usr/local/lib 00:03:22.375 00:03:22.375 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:22.955 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:22.955 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:22.955 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:22.955 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:22.955 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:22.955 [5/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:23.217 [6/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:23.217 [7/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:23.218 [8/37] Compiling C object samples/null.p/null.c.o 00:03:23.218 [9/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:23.218 [10/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:23.218 [11/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:23.218 [12/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:23.218 [13/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:23.218 [14/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:23.218 [15/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:23.218 [16/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:23.218 [17/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:23.218 [18/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:23.218 [19/37] Compiling C object samples/server.p/server.c.o 00:03:23.218 [20/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:23.218 [21/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:23.218 [22/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:23.218 [23/37] Compiling C object samples/client.p/client.c.o 00:03:23.218 [24/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:23.218 [25/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:23.218 [26/37] Linking target samples/client 00:03:23.218 [27/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:23.480 [28/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:23.480 [29/37] Linking target test/unit_tests 00:03:23.480 [30/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:23.480 [31/37] Linking target lib/libvfio-user.so.0.0.1 00:03:23.744 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:23.744 [33/37] Linking target samples/null 00:03:23.744 [34/37] Linking target samples/server 00:03:23.744 [35/37] Linking target samples/lspci 00:03:23.744 [36/37] Linking target samples/shadow_ioeventfd_server 00:03:23.744 [37/37] Linking target samples/gpio-pci-idio-16 00:03:23.744 INFO: autodetecting backend as ninja 00:03:23.744 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:24.006 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:24.579 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:24.837 ninja: no work to do. 00:03:37.036 CC lib/ut_mock/mock.o 00:03:37.036 CC lib/log/log.o 00:03:37.036 CC lib/log/log_flags.o 00:03:37.036 CC lib/log/log_deprecated.o 00:03:37.036 CC lib/ut/ut.o 00:03:37.036 LIB libspdk_ut_mock.a 00:03:37.036 LIB libspdk_log.a 00:03:37.036 SO libspdk_ut_mock.so.5.0 00:03:37.036 LIB libspdk_ut.a 00:03:37.036 SO libspdk_log.so.6.1 00:03:37.036 SO libspdk_ut.so.1.0 00:03:37.036 SYMLINK libspdk_ut_mock.so 00:03:37.036 SYMLINK libspdk_ut.so 00:03:37.036 SYMLINK libspdk_log.so 00:03:37.036 CC lib/ioat/ioat.o 00:03:37.036 CXX lib/trace_parser/trace.o 00:03:37.036 CC lib/dma/dma.o 00:03:37.036 CC lib/util/base64.o 00:03:37.036 CC lib/util/bit_array.o 00:03:37.036 CC lib/util/cpuset.o 00:03:37.036 CC lib/util/crc16.o 00:03:37.036 CC lib/util/crc32.o 00:03:37.036 CC lib/util/crc32c.o 00:03:37.036 CC lib/util/crc32_ieee.o 00:03:37.036 CC lib/util/crc64.o 00:03:37.036 CC lib/util/dif.o 00:03:37.036 CC lib/util/fd.o 00:03:37.036 CC lib/util/file.o 00:03:37.036 CC lib/util/hexlify.o 00:03:37.036 CC lib/util/iov.o 00:03:37.036 CC lib/util/math.o 00:03:37.036 CC lib/util/pipe.o 00:03:37.036 CC lib/util/strerror_tls.o 00:03:37.036 CC lib/util/string.o 00:03:37.036 CC lib/util/uuid.o 00:03:37.036 CC lib/util/fd_group.o 00:03:37.036 CC lib/util/xor.o 00:03:37.036 CC lib/util/zipf.o 00:03:37.036 CC lib/vfio_user/host/vfio_user_pci.o 00:03:37.036 CC lib/vfio_user/host/vfio_user.o 00:03:37.036 LIB libspdk_dma.a 00:03:37.036 SO libspdk_dma.so.3.0 00:03:37.036 SYMLINK libspdk_dma.so 00:03:37.036 LIB libspdk_ioat.a 00:03:37.036 SO libspdk_ioat.so.6.0 00:03:37.036 LIB libspdk_vfio_user.a 00:03:37.036 SO libspdk_vfio_user.so.4.0 00:03:37.036 SYMLINK libspdk_ioat.so 00:03:37.036 SYMLINK libspdk_vfio_user.so 00:03:37.036 LIB libspdk_util.a 00:03:37.036 SO libspdk_util.so.8.0 00:03:37.036 SYMLINK libspdk_util.so 00:03:37.036 CC lib/json/json_parse.o 00:03:37.036 CC lib/conf/conf.o 00:03:37.036 CC lib/json/json_util.o 00:03:37.036 CC lib/idxd/idxd.o 00:03:37.036 CC lib/vmd/vmd.o 00:03:37.036 CC lib/json/json_write.o 00:03:37.036 CC lib/vmd/led.o 00:03:37.036 CC lib/rdma/common.o 00:03:37.036 CC lib/env_dpdk/env.o 00:03:37.036 CC lib/idxd/idxd_user.o 00:03:37.036 CC lib/env_dpdk/memory.o 00:03:37.036 CC lib/rdma/rdma_verbs.o 00:03:37.036 CC lib/idxd/idxd_kernel.o 00:03:37.036 CC lib/env_dpdk/pci.o 00:03:37.036 CC lib/env_dpdk/init.o 00:03:37.036 CC lib/env_dpdk/threads.o 00:03:37.036 CC lib/env_dpdk/pci_ioat.o 00:03:37.036 CC lib/env_dpdk/pci_virtio.o 00:03:37.036 CC lib/env_dpdk/pci_vmd.o 00:03:37.036 CC lib/env_dpdk/pci_idxd.o 00:03:37.036 CC lib/env_dpdk/pci_event.o 00:03:37.036 CC lib/env_dpdk/sigbus_handler.o 00:03:37.036 CC lib/env_dpdk/pci_dpdk.o 00:03:37.036 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:37.036 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:37.036 LIB libspdk_trace_parser.a 00:03:37.036 SO libspdk_trace_parser.so.4.0 00:03:37.036 LIB libspdk_conf.a 00:03:37.036 SO libspdk_conf.so.5.0 00:03:37.036 SYMLINK libspdk_trace_parser.so 00:03:37.036 SYMLINK libspdk_conf.so 00:03:37.036 LIB libspdk_json.a 00:03:37.036 LIB libspdk_rdma.a 00:03:37.036 SO libspdk_rdma.so.5.0 00:03:37.036 SO libspdk_json.so.5.1 00:03:37.036 SYMLINK libspdk_rdma.so 00:03:37.036 SYMLINK libspdk_json.so 00:03:37.036 CC lib/jsonrpc/jsonrpc_server.o 00:03:37.036 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:37.036 CC lib/jsonrpc/jsonrpc_client.o 00:03:37.036 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:37.036 LIB libspdk_idxd.a 00:03:37.036 SO libspdk_idxd.so.11.0 00:03:37.294 SYMLINK libspdk_idxd.so 00:03:37.294 LIB libspdk_vmd.a 00:03:37.294 SO libspdk_vmd.so.5.0 00:03:37.294 SYMLINK libspdk_vmd.so 00:03:37.294 LIB libspdk_jsonrpc.a 00:03:37.294 SO libspdk_jsonrpc.so.5.1 00:03:37.294 SYMLINK libspdk_jsonrpc.so 00:03:37.553 CC lib/rpc/rpc.o 00:03:37.811 LIB libspdk_rpc.a 00:03:37.811 SO libspdk_rpc.so.5.0 00:03:37.811 SYMLINK libspdk_rpc.so 00:03:37.811 CC lib/trace/trace.o 00:03:37.811 CC lib/notify/notify.o 00:03:37.811 CC lib/trace/trace_flags.o 00:03:37.811 CC lib/sock/sock.o 00:03:37.811 CC lib/notify/notify_rpc.o 00:03:37.811 CC lib/trace/trace_rpc.o 00:03:37.811 CC lib/sock/sock_rpc.o 00:03:38.069 LIB libspdk_notify.a 00:03:38.069 SO libspdk_notify.so.5.0 00:03:38.069 LIB libspdk_trace.a 00:03:38.069 SYMLINK libspdk_notify.so 00:03:38.069 SO libspdk_trace.so.9.0 00:03:38.069 SYMLINK libspdk_trace.so 00:03:38.328 LIB libspdk_sock.a 00:03:38.328 CC lib/thread/thread.o 00:03:38.328 CC lib/thread/iobuf.o 00:03:38.328 SO libspdk_sock.so.8.0 00:03:38.328 SYMLINK libspdk_sock.so 00:03:38.328 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:38.328 CC lib/nvme/nvme_ctrlr.o 00:03:38.328 CC lib/nvme/nvme_fabric.o 00:03:38.328 CC lib/nvme/nvme_ns_cmd.o 00:03:38.328 CC lib/nvme/nvme_ns.o 00:03:38.328 CC lib/nvme/nvme_pcie_common.o 00:03:38.328 CC lib/nvme/nvme_pcie.o 00:03:38.328 CC lib/nvme/nvme_qpair.o 00:03:38.328 CC lib/nvme/nvme.o 00:03:38.328 CC lib/nvme/nvme_quirks.o 00:03:38.328 CC lib/nvme/nvme_transport.o 00:03:38.328 CC lib/nvme/nvme_discovery.o 00:03:38.328 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:38.328 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:38.328 CC lib/nvme/nvme_tcp.o 00:03:38.328 CC lib/nvme/nvme_opal.o 00:03:38.328 CC lib/nvme/nvme_io_msg.o 00:03:38.328 CC lib/nvme/nvme_poll_group.o 00:03:38.328 CC lib/nvme/nvme_zns.o 00:03:38.328 CC lib/nvme/nvme_cuse.o 00:03:38.328 CC lib/nvme/nvme_vfio_user.o 00:03:38.328 CC lib/nvme/nvme_rdma.o 00:03:38.586 LIB libspdk_env_dpdk.a 00:03:38.586 SO libspdk_env_dpdk.so.13.0 00:03:38.844 SYMLINK libspdk_env_dpdk.so 00:03:39.778 LIB libspdk_thread.a 00:03:39.778 SO libspdk_thread.so.9.0 00:03:40.036 SYMLINK libspdk_thread.so 00:03:40.036 CC lib/vfu_tgt/tgt_endpoint.o 00:03:40.036 CC lib/init/json_config.o 00:03:40.036 CC lib/blob/blobstore.o 00:03:40.036 CC lib/vfu_tgt/tgt_rpc.o 00:03:40.036 CC lib/init/subsystem.o 00:03:40.036 CC lib/blob/request.o 00:03:40.036 CC lib/virtio/virtio.o 00:03:40.036 CC lib/accel/accel.o 00:03:40.036 CC lib/blob/zeroes.o 00:03:40.036 CC lib/init/subsystem_rpc.o 00:03:40.036 CC lib/accel/accel_rpc.o 00:03:40.036 CC lib/virtio/virtio_vhost_user.o 00:03:40.036 CC lib/blob/blob_bs_dev.o 00:03:40.036 CC lib/init/rpc.o 00:03:40.036 CC lib/virtio/virtio_vfio_user.o 00:03:40.036 CC lib/accel/accel_sw.o 00:03:40.036 CC lib/virtio/virtio_pci.o 00:03:40.294 LIB libspdk_init.a 00:03:40.294 SO libspdk_init.so.4.0 00:03:40.294 SYMLINK libspdk_init.so 00:03:40.553 LIB libspdk_virtio.a 00:03:40.553 LIB libspdk_vfu_tgt.a 00:03:40.553 SO libspdk_vfu_tgt.so.2.0 00:03:40.553 SO libspdk_virtio.so.6.0 00:03:40.553 SYMLINK libspdk_vfu_tgt.so 00:03:40.553 SYMLINK libspdk_virtio.so 00:03:40.553 CC lib/event/app.o 00:03:40.553 CC lib/event/reactor.o 00:03:40.553 CC lib/event/log_rpc.o 00:03:40.553 CC lib/event/app_rpc.o 00:03:40.553 CC lib/event/scheduler_static.o 00:03:40.811 LIB libspdk_nvme.a 00:03:40.811 SO libspdk_nvme.so.12.0 00:03:40.811 LIB libspdk_event.a 00:03:41.069 SO libspdk_event.so.12.0 00:03:41.069 SYMLINK libspdk_event.so 00:03:41.069 SYMLINK libspdk_nvme.so 00:03:41.069 LIB libspdk_accel.a 00:03:41.069 SO libspdk_accel.so.14.0 00:03:41.327 SYMLINK libspdk_accel.so 00:03:41.327 CC lib/bdev/bdev.o 00:03:41.327 CC lib/bdev/bdev_rpc.o 00:03:41.327 CC lib/bdev/bdev_zone.o 00:03:41.327 CC lib/bdev/part.o 00:03:41.327 CC lib/bdev/scsi_nvme.o 00:03:43.230 LIB libspdk_blob.a 00:03:43.231 SO libspdk_blob.so.10.1 00:03:43.231 SYMLINK libspdk_blob.so 00:03:43.231 CC lib/blobfs/blobfs.o 00:03:43.231 CC lib/blobfs/tree.o 00:03:43.231 CC lib/lvol/lvol.o 00:03:43.797 LIB libspdk_blobfs.a 00:03:43.797 SO libspdk_blobfs.so.9.0 00:03:43.797 LIB libspdk_bdev.a 00:03:43.797 SO libspdk_bdev.so.14.0 00:03:43.797 SYMLINK libspdk_blobfs.so 00:03:43.797 LIB libspdk_lvol.a 00:03:44.062 SO libspdk_lvol.so.9.1 00:03:44.062 SYMLINK libspdk_bdev.so 00:03:44.062 SYMLINK libspdk_lvol.so 00:03:44.062 CC lib/scsi/dev.o 00:03:44.062 CC lib/nbd/nbd.o 00:03:44.062 CC lib/ublk/ublk.o 00:03:44.062 CC lib/nvmf/ctrlr.o 00:03:44.062 CC lib/scsi/lun.o 00:03:44.062 CC lib/nvmf/ctrlr_discovery.o 00:03:44.062 CC lib/ftl/ftl_core.o 00:03:44.062 CC lib/ublk/ublk_rpc.o 00:03:44.062 CC lib/scsi/port.o 00:03:44.062 CC lib/nvmf/ctrlr_bdev.o 00:03:44.062 CC lib/ftl/ftl_init.o 00:03:44.062 CC lib/nbd/nbd_rpc.o 00:03:44.062 CC lib/nvmf/subsystem.o 00:03:44.062 CC lib/ftl/ftl_layout.o 00:03:44.062 CC lib/scsi/scsi.o 00:03:44.062 CC lib/nvmf/nvmf.o 00:03:44.062 CC lib/ftl/ftl_debug.o 00:03:44.062 CC lib/scsi/scsi_bdev.o 00:03:44.062 CC lib/nvmf/nvmf_rpc.o 00:03:44.062 CC lib/ftl/ftl_io.o 00:03:44.062 CC lib/scsi/scsi_pr.o 00:03:44.062 CC lib/nvmf/transport.o 00:03:44.062 CC lib/scsi/scsi_rpc.o 00:03:44.062 CC lib/nvmf/tcp.o 00:03:44.062 CC lib/ftl/ftl_sb.o 00:03:44.062 CC lib/ftl/ftl_l2p.o 00:03:44.062 CC lib/nvmf/vfio_user.o 00:03:44.062 CC lib/scsi/task.o 00:03:44.062 CC lib/ftl/ftl_l2p_flat.o 00:03:44.062 CC lib/nvmf/rdma.o 00:03:44.062 CC lib/ftl/ftl_nv_cache.o 00:03:44.062 CC lib/ftl/ftl_band.o 00:03:44.062 CC lib/ftl/ftl_band_ops.o 00:03:44.062 CC lib/ftl/ftl_writer.o 00:03:44.062 CC lib/ftl/ftl_rq.o 00:03:44.062 CC lib/ftl/ftl_reloc.o 00:03:44.062 CC lib/ftl/ftl_l2p_cache.o 00:03:44.062 CC lib/ftl/ftl_p2l.o 00:03:44.062 CC lib/ftl/mngt/ftl_mngt.o 00:03:44.062 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:44.062 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:44.062 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:44.062 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:44.062 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:44.062 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:44.062 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:44.062 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:44.062 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:44.322 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:44.322 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:44.322 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:44.582 CC lib/ftl/utils/ftl_conf.o 00:03:44.582 CC lib/ftl/utils/ftl_md.o 00:03:44.582 CC lib/ftl/utils/ftl_mempool.o 00:03:44.582 CC lib/ftl/utils/ftl_bitmap.o 00:03:44.582 CC lib/ftl/utils/ftl_property.o 00:03:44.582 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:44.582 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:44.582 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:44.582 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:44.582 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:44.582 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:44.582 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:44.582 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:44.582 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:44.582 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:44.582 CC lib/ftl/base/ftl_base_dev.o 00:03:44.582 CC lib/ftl/base/ftl_base_bdev.o 00:03:44.582 CC lib/ftl/ftl_trace.o 00:03:44.841 LIB libspdk_nbd.a 00:03:44.841 SO libspdk_nbd.so.6.0 00:03:44.841 SYMLINK libspdk_nbd.so 00:03:44.841 LIB libspdk_scsi.a 00:03:45.100 SO libspdk_scsi.so.8.0 00:03:45.100 LIB libspdk_ublk.a 00:03:45.100 SYMLINK libspdk_scsi.so 00:03:45.100 SO libspdk_ublk.so.2.0 00:03:45.100 SYMLINK libspdk_ublk.so 00:03:45.100 CC lib/vhost/vhost.o 00:03:45.100 CC lib/iscsi/conn.o 00:03:45.100 CC lib/vhost/vhost_rpc.o 00:03:45.100 CC lib/iscsi/init_grp.o 00:03:45.100 CC lib/vhost/vhost_scsi.o 00:03:45.100 CC lib/iscsi/iscsi.o 00:03:45.100 CC lib/vhost/vhost_blk.o 00:03:45.100 CC lib/iscsi/md5.o 00:03:45.100 CC lib/vhost/rte_vhost_user.o 00:03:45.100 CC lib/iscsi/param.o 00:03:45.100 CC lib/iscsi/portal_grp.o 00:03:45.100 CC lib/iscsi/tgt_node.o 00:03:45.100 CC lib/iscsi/iscsi_subsystem.o 00:03:45.100 CC lib/iscsi/iscsi_rpc.o 00:03:45.100 CC lib/iscsi/task.o 00:03:45.359 LIB libspdk_ftl.a 00:03:45.618 SO libspdk_ftl.so.8.0 00:03:45.876 SYMLINK libspdk_ftl.so 00:03:46.443 LIB libspdk_vhost.a 00:03:46.443 SO libspdk_vhost.so.7.1 00:03:46.443 SYMLINK libspdk_vhost.so 00:03:46.702 LIB libspdk_nvmf.a 00:03:46.702 LIB libspdk_iscsi.a 00:03:46.702 SO libspdk_nvmf.so.17.0 00:03:46.702 SO libspdk_iscsi.so.7.0 00:03:46.960 SYMLINK libspdk_iscsi.so 00:03:46.960 SYMLINK libspdk_nvmf.so 00:03:46.960 CC module/env_dpdk/env_dpdk_rpc.o 00:03:46.960 CC module/vfu_device/vfu_virtio.o 00:03:46.960 CC module/vfu_device/vfu_virtio_blk.o 00:03:46.960 CC module/vfu_device/vfu_virtio_scsi.o 00:03:46.960 CC module/vfu_device/vfu_virtio_rpc.o 00:03:47.218 CC module/accel/dsa/accel_dsa.o 00:03:47.218 CC module/accel/ioat/accel_ioat.o 00:03:47.218 CC module/accel/iaa/accel_iaa.o 00:03:47.218 CC module/blob/bdev/blob_bdev.o 00:03:47.218 CC module/sock/posix/posix.o 00:03:47.218 CC module/accel/ioat/accel_ioat_rpc.o 00:03:47.218 CC module/accel/error/accel_error.o 00:03:47.218 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:47.218 CC module/accel/dsa/accel_dsa_rpc.o 00:03:47.218 CC module/accel/iaa/accel_iaa_rpc.o 00:03:47.218 CC module/accel/error/accel_error_rpc.o 00:03:47.218 CC module/scheduler/gscheduler/gscheduler.o 00:03:47.218 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:47.218 LIB libspdk_env_dpdk_rpc.a 00:03:47.218 SO libspdk_env_dpdk_rpc.so.5.0 00:03:47.218 SYMLINK libspdk_env_dpdk_rpc.so 00:03:47.218 LIB libspdk_scheduler_gscheduler.a 00:03:47.218 LIB libspdk_scheduler_dpdk_governor.a 00:03:47.218 SO libspdk_scheduler_gscheduler.so.3.0 00:03:47.218 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:47.218 LIB libspdk_accel_ioat.a 00:03:47.218 LIB libspdk_accel_error.a 00:03:47.218 LIB libspdk_scheduler_dynamic.a 00:03:47.218 LIB libspdk_accel_iaa.a 00:03:47.218 SO libspdk_accel_ioat.so.5.0 00:03:47.218 SO libspdk_accel_error.so.1.0 00:03:47.218 SO libspdk_scheduler_dynamic.so.3.0 00:03:47.218 SYMLINK libspdk_scheduler_gscheduler.so 00:03:47.218 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:47.477 SO libspdk_accel_iaa.so.2.0 00:03:47.477 LIB libspdk_accel_dsa.a 00:03:47.477 SYMLINK libspdk_accel_ioat.so 00:03:47.477 SYMLINK libspdk_accel_error.so 00:03:47.477 SYMLINK libspdk_scheduler_dynamic.so 00:03:47.477 SO libspdk_accel_dsa.so.4.0 00:03:47.477 LIB libspdk_blob_bdev.a 00:03:47.477 SYMLINK libspdk_accel_iaa.so 00:03:47.477 SO libspdk_blob_bdev.so.10.1 00:03:47.477 SYMLINK libspdk_accel_dsa.so 00:03:47.477 SYMLINK libspdk_blob_bdev.so 00:03:47.736 CC module/bdev/nvme/bdev_nvme.o 00:03:47.736 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:47.736 CC module/blobfs/bdev/blobfs_bdev.o 00:03:47.736 CC module/bdev/nvme/nvme_rpc.o 00:03:47.736 CC module/bdev/ftl/bdev_ftl.o 00:03:47.736 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:47.736 CC module/bdev/delay/vbdev_delay.o 00:03:47.736 CC module/bdev/nvme/bdev_mdns_client.o 00:03:47.736 CC module/bdev/raid/bdev_raid.o 00:03:47.736 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:47.736 CC module/bdev/split/vbdev_split.o 00:03:47.736 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:47.736 CC module/bdev/raid/bdev_raid_rpc.o 00:03:47.736 CC module/bdev/split/vbdev_split_rpc.o 00:03:47.736 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:47.736 CC module/bdev/nvme/vbdev_opal.o 00:03:47.736 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:47.736 CC module/bdev/gpt/gpt.o 00:03:47.736 CC module/bdev/iscsi/bdev_iscsi.o 00:03:47.736 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:47.736 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:47.736 CC module/bdev/error/vbdev_error.o 00:03:47.736 CC module/bdev/lvol/vbdev_lvol.o 00:03:47.736 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:47.736 CC module/bdev/raid/raid0.o 00:03:47.736 CC module/bdev/raid/bdev_raid_sb.o 00:03:47.736 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:47.736 CC module/bdev/gpt/vbdev_gpt.o 00:03:47.736 CC module/bdev/raid/raid1.o 00:03:47.736 CC module/bdev/error/vbdev_error_rpc.o 00:03:47.736 CC module/bdev/malloc/bdev_malloc.o 00:03:47.736 CC module/bdev/aio/bdev_aio.o 00:03:47.736 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:47.736 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:47.736 CC module/bdev/null/bdev_null.o 00:03:47.736 CC module/bdev/aio/bdev_aio_rpc.o 00:03:47.736 CC module/bdev/passthru/vbdev_passthru.o 00:03:47.736 CC module/bdev/raid/concat.o 00:03:47.736 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:47.736 CC module/bdev/null/bdev_null_rpc.o 00:03:47.736 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:47.736 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:47.736 LIB libspdk_vfu_device.a 00:03:47.736 SO libspdk_vfu_device.so.2.0 00:03:47.995 SYMLINK libspdk_vfu_device.so 00:03:47.995 LIB libspdk_blobfs_bdev.a 00:03:47.995 LIB libspdk_bdev_split.a 00:03:47.995 SO libspdk_blobfs_bdev.so.5.0 00:03:47.995 LIB libspdk_sock_posix.a 00:03:47.995 SO libspdk_sock_posix.so.5.0 00:03:47.995 SO libspdk_bdev_split.so.5.0 00:03:47.995 LIB libspdk_bdev_error.a 00:03:47.995 SYMLINK libspdk_blobfs_bdev.so 00:03:47.995 LIB libspdk_bdev_null.a 00:03:47.995 LIB libspdk_bdev_gpt.a 00:03:47.995 SO libspdk_bdev_error.so.5.0 00:03:48.253 SYMLINK libspdk_bdev_split.so 00:03:48.253 SO libspdk_bdev_null.so.5.0 00:03:48.253 SO libspdk_bdev_gpt.so.5.0 00:03:48.253 SYMLINK libspdk_sock_posix.so 00:03:48.253 LIB libspdk_bdev_ftl.a 00:03:48.253 LIB libspdk_bdev_passthru.a 00:03:48.253 LIB libspdk_bdev_aio.a 00:03:48.253 LIB libspdk_bdev_zone_block.a 00:03:48.253 SO libspdk_bdev_passthru.so.5.0 00:03:48.253 SYMLINK libspdk_bdev_error.so 00:03:48.253 SO libspdk_bdev_ftl.so.5.0 00:03:48.253 SO libspdk_bdev_aio.so.5.0 00:03:48.253 SO libspdk_bdev_zone_block.so.5.0 00:03:48.253 SYMLINK libspdk_bdev_gpt.so 00:03:48.253 SYMLINK libspdk_bdev_null.so 00:03:48.253 LIB libspdk_bdev_malloc.a 00:03:48.253 SYMLINK libspdk_bdev_passthru.so 00:03:48.253 SYMLINK libspdk_bdev_ftl.so 00:03:48.253 SO libspdk_bdev_malloc.so.5.0 00:03:48.253 SYMLINK libspdk_bdev_aio.so 00:03:48.253 SYMLINK libspdk_bdev_zone_block.so 00:03:48.253 LIB libspdk_bdev_iscsi.a 00:03:48.253 LIB libspdk_bdev_delay.a 00:03:48.253 SYMLINK libspdk_bdev_malloc.so 00:03:48.253 SO libspdk_bdev_iscsi.so.5.0 00:03:48.253 SO libspdk_bdev_delay.so.5.0 00:03:48.253 LIB libspdk_bdev_virtio.a 00:03:48.253 SYMLINK libspdk_bdev_delay.so 00:03:48.253 SYMLINK libspdk_bdev_iscsi.so 00:03:48.253 LIB libspdk_bdev_lvol.a 00:03:48.253 SO libspdk_bdev_virtio.so.5.0 00:03:48.511 SO libspdk_bdev_lvol.so.5.0 00:03:48.511 SYMLINK libspdk_bdev_virtio.so 00:03:48.511 SYMLINK libspdk_bdev_lvol.so 00:03:48.769 LIB libspdk_bdev_raid.a 00:03:48.769 SO libspdk_bdev_raid.so.5.0 00:03:48.769 SYMLINK libspdk_bdev_raid.so 00:03:50.142 LIB libspdk_bdev_nvme.a 00:03:50.142 SO libspdk_bdev_nvme.so.6.0 00:03:50.142 SYMLINK libspdk_bdev_nvme.so 00:03:50.142 CC module/event/subsystems/vmd/vmd.o 00:03:50.142 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:50.142 CC module/event/subsystems/sock/sock.o 00:03:50.142 CC module/event/subsystems/scheduler/scheduler.o 00:03:50.142 CC module/event/subsystems/iobuf/iobuf.o 00:03:50.142 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:50.142 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:50.142 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:50.400 LIB libspdk_event_sock.a 00:03:50.400 LIB libspdk_event_vhost_blk.a 00:03:50.400 LIB libspdk_event_scheduler.a 00:03:50.400 LIB libspdk_event_vfu_tgt.a 00:03:50.400 LIB libspdk_event_vmd.a 00:03:50.400 SO libspdk_event_sock.so.4.0 00:03:50.400 LIB libspdk_event_iobuf.a 00:03:50.400 SO libspdk_event_vhost_blk.so.2.0 00:03:50.400 SO libspdk_event_scheduler.so.3.0 00:03:50.400 SO libspdk_event_vfu_tgt.so.2.0 00:03:50.400 SO libspdk_event_vmd.so.5.0 00:03:50.400 SO libspdk_event_iobuf.so.2.0 00:03:50.400 SYMLINK libspdk_event_sock.so 00:03:50.400 SYMLINK libspdk_event_vhost_blk.so 00:03:50.400 SYMLINK libspdk_event_vfu_tgt.so 00:03:50.400 SYMLINK libspdk_event_scheduler.so 00:03:50.400 SYMLINK libspdk_event_vmd.so 00:03:50.400 SYMLINK libspdk_event_iobuf.so 00:03:50.658 CC module/event/subsystems/accel/accel.o 00:03:50.658 LIB libspdk_event_accel.a 00:03:50.658 SO libspdk_event_accel.so.5.0 00:03:50.916 SYMLINK libspdk_event_accel.so 00:03:50.916 CC module/event/subsystems/bdev/bdev.o 00:03:51.174 LIB libspdk_event_bdev.a 00:03:51.174 SO libspdk_event_bdev.so.5.0 00:03:51.174 SYMLINK libspdk_event_bdev.so 00:03:51.174 CC module/event/subsystems/ublk/ublk.o 00:03:51.174 CC module/event/subsystems/scsi/scsi.o 00:03:51.174 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:51.174 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:51.174 CC module/event/subsystems/nbd/nbd.o 00:03:51.431 LIB libspdk_event_nbd.a 00:03:51.431 LIB libspdk_event_ublk.a 00:03:51.431 SO libspdk_event_ublk.so.2.0 00:03:51.431 SO libspdk_event_nbd.so.5.0 00:03:51.431 LIB libspdk_event_scsi.a 00:03:51.431 SO libspdk_event_scsi.so.5.0 00:03:51.431 SYMLINK libspdk_event_nbd.so 00:03:51.431 SYMLINK libspdk_event_ublk.so 00:03:51.431 LIB libspdk_event_nvmf.a 00:03:51.431 SYMLINK libspdk_event_scsi.so 00:03:51.431 SO libspdk_event_nvmf.so.5.0 00:03:51.689 SYMLINK libspdk_event_nvmf.so 00:03:51.689 CC module/event/subsystems/iscsi/iscsi.o 00:03:51.689 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:51.689 LIB libspdk_event_vhost_scsi.a 00:03:51.689 LIB libspdk_event_iscsi.a 00:03:51.689 SO libspdk_event_vhost_scsi.so.2.0 00:03:51.689 SO libspdk_event_iscsi.so.5.0 00:03:51.948 SYMLINK libspdk_event_vhost_scsi.so 00:03:51.948 SYMLINK libspdk_event_iscsi.so 00:03:51.948 SO libspdk.so.5.0 00:03:51.948 SYMLINK libspdk.so 00:03:52.231 CXX app/trace/trace.o 00:03:52.231 CC app/spdk_top/spdk_top.o 00:03:52.231 CC app/spdk_lspci/spdk_lspci.o 00:03:52.231 CC app/spdk_nvme_perf/perf.o 00:03:52.231 CC app/trace_record/trace_record.o 00:03:52.231 CC app/spdk_nvme_identify/identify.o 00:03:52.231 TEST_HEADER include/spdk/accel.h 00:03:52.231 CC app/spdk_nvme_discover/discovery_aer.o 00:03:52.231 TEST_HEADER include/spdk/accel_module.h 00:03:52.231 TEST_HEADER include/spdk/assert.h 00:03:52.231 CC test/rpc_client/rpc_client_test.o 00:03:52.231 TEST_HEADER include/spdk/barrier.h 00:03:52.231 TEST_HEADER include/spdk/base64.h 00:03:52.231 TEST_HEADER include/spdk/bdev.h 00:03:52.231 TEST_HEADER include/spdk/bdev_module.h 00:03:52.231 TEST_HEADER include/spdk/bdev_zone.h 00:03:52.231 TEST_HEADER include/spdk/bit_array.h 00:03:52.231 TEST_HEADER include/spdk/bit_pool.h 00:03:52.231 TEST_HEADER include/spdk/blob_bdev.h 00:03:52.231 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:52.231 TEST_HEADER include/spdk/blobfs.h 00:03:52.231 TEST_HEADER include/spdk/blob.h 00:03:52.231 TEST_HEADER include/spdk/conf.h 00:03:52.231 TEST_HEADER include/spdk/config.h 00:03:52.231 CC app/spdk_dd/spdk_dd.o 00:03:52.231 TEST_HEADER include/spdk/cpuset.h 00:03:52.231 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:52.231 TEST_HEADER include/spdk/crc16.h 00:03:52.231 TEST_HEADER include/spdk/crc32.h 00:03:52.231 TEST_HEADER include/spdk/crc64.h 00:03:52.231 TEST_HEADER include/spdk/dif.h 00:03:52.231 TEST_HEADER include/spdk/dma.h 00:03:52.231 CC app/nvmf_tgt/nvmf_main.o 00:03:52.231 CC app/iscsi_tgt/iscsi_tgt.o 00:03:52.231 TEST_HEADER include/spdk/endian.h 00:03:52.231 CC app/vhost/vhost.o 00:03:52.231 TEST_HEADER include/spdk/env_dpdk.h 00:03:52.231 TEST_HEADER include/spdk/env.h 00:03:52.231 CC examples/sock/hello_world/hello_sock.o 00:03:52.231 TEST_HEADER include/spdk/event.h 00:03:52.231 CC examples/ioat/perf/perf.o 00:03:52.231 CC examples/vmd/lsvmd/lsvmd.o 00:03:52.231 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:52.231 CC examples/accel/perf/accel_perf.o 00:03:52.231 CC examples/ioat/verify/verify.o 00:03:52.231 TEST_HEADER include/spdk/fd_group.h 00:03:52.231 CC examples/vmd/led/led.o 00:03:52.231 TEST_HEADER include/spdk/fd.h 00:03:52.231 CC test/app/histogram_perf/histogram_perf.o 00:03:52.231 CC test/env/memory/memory_ut.o 00:03:52.231 CC examples/idxd/perf/perf.o 00:03:52.231 TEST_HEADER include/spdk/file.h 00:03:52.231 CC test/env/pci/pci_ut.o 00:03:52.231 CC test/app/jsoncat/jsoncat.o 00:03:52.231 CC examples/util/zipf/zipf.o 00:03:52.231 TEST_HEADER include/spdk/ftl.h 00:03:52.231 CC test/env/vtophys/vtophys.o 00:03:52.231 TEST_HEADER include/spdk/gpt_spec.h 00:03:52.231 CC examples/nvme/hello_world/hello_world.o 00:03:52.231 TEST_HEADER include/spdk/hexlify.h 00:03:52.231 CC test/event/event_perf/event_perf.o 00:03:52.231 CC test/nvme/aer/aer.o 00:03:52.231 CC app/spdk_tgt/spdk_tgt.o 00:03:52.231 TEST_HEADER include/spdk/histogram_data.h 00:03:52.231 CC test/thread/poller_perf/poller_perf.o 00:03:52.231 TEST_HEADER include/spdk/idxd.h 00:03:52.231 CC app/fio/nvme/fio_plugin.o 00:03:52.231 TEST_HEADER include/spdk/idxd_spec.h 00:03:52.231 TEST_HEADER include/spdk/init.h 00:03:52.231 TEST_HEADER include/spdk/ioat.h 00:03:52.231 TEST_HEADER include/spdk/ioat_spec.h 00:03:52.231 TEST_HEADER include/spdk/iscsi_spec.h 00:03:52.231 TEST_HEADER include/spdk/json.h 00:03:52.231 TEST_HEADER include/spdk/jsonrpc.h 00:03:52.231 CC examples/blob/cli/blobcli.o 00:03:52.231 TEST_HEADER include/spdk/likely.h 00:03:52.231 CC examples/bdev/hello_world/hello_bdev.o 00:03:52.231 TEST_HEADER include/spdk/log.h 00:03:52.231 CC test/bdev/bdevio/bdevio.o 00:03:52.231 TEST_HEADER include/spdk/lvol.h 00:03:52.231 CC test/blobfs/mkfs/mkfs.o 00:03:52.231 TEST_HEADER include/spdk/memory.h 00:03:52.231 CC test/dma/test_dma/test_dma.o 00:03:52.231 CC examples/nvmf/nvmf/nvmf.o 00:03:52.231 CC examples/blob/hello_world/hello_blob.o 00:03:52.231 CC examples/thread/thread/thread_ex.o 00:03:52.231 CC test/accel/dif/dif.o 00:03:52.231 TEST_HEADER include/spdk/mmio.h 00:03:52.231 CC test/app/bdev_svc/bdev_svc.o 00:03:52.231 TEST_HEADER include/spdk/nbd.h 00:03:52.231 TEST_HEADER include/spdk/notify.h 00:03:52.231 CC examples/bdev/bdevperf/bdevperf.o 00:03:52.231 TEST_HEADER include/spdk/nvme.h 00:03:52.231 TEST_HEADER include/spdk/nvme_intel.h 00:03:52.231 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:52.231 CC test/env/mem_callbacks/mem_callbacks.o 00:03:52.231 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:52.231 TEST_HEADER include/spdk/nvme_spec.h 00:03:52.231 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:52.231 TEST_HEADER include/spdk/nvme_zns.h 00:03:52.231 CC test/lvol/esnap/esnap.o 00:03:52.231 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:52.231 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:52.231 TEST_HEADER include/spdk/nvmf.h 00:03:52.231 TEST_HEADER include/spdk/nvmf_spec.h 00:03:52.231 TEST_HEADER include/spdk/nvmf_transport.h 00:03:52.231 TEST_HEADER include/spdk/opal.h 00:03:52.520 TEST_HEADER include/spdk/opal_spec.h 00:03:52.520 TEST_HEADER include/spdk/pci_ids.h 00:03:52.520 TEST_HEADER include/spdk/pipe.h 00:03:52.520 TEST_HEADER include/spdk/queue.h 00:03:52.520 TEST_HEADER include/spdk/reduce.h 00:03:52.520 TEST_HEADER include/spdk/rpc.h 00:03:52.520 TEST_HEADER include/spdk/scheduler.h 00:03:52.520 TEST_HEADER include/spdk/scsi.h 00:03:52.520 LINK spdk_lspci 00:03:52.520 TEST_HEADER include/spdk/scsi_spec.h 00:03:52.520 TEST_HEADER include/spdk/sock.h 00:03:52.520 TEST_HEADER include/spdk/stdinc.h 00:03:52.521 TEST_HEADER include/spdk/string.h 00:03:52.521 TEST_HEADER include/spdk/thread.h 00:03:52.521 TEST_HEADER include/spdk/trace.h 00:03:52.521 TEST_HEADER include/spdk/trace_parser.h 00:03:52.521 TEST_HEADER include/spdk/tree.h 00:03:52.521 TEST_HEADER include/spdk/ublk.h 00:03:52.521 TEST_HEADER include/spdk/util.h 00:03:52.521 TEST_HEADER include/spdk/uuid.h 00:03:52.521 TEST_HEADER include/spdk/version.h 00:03:52.521 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:52.521 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:52.521 TEST_HEADER include/spdk/vhost.h 00:03:52.521 TEST_HEADER include/spdk/vmd.h 00:03:52.521 TEST_HEADER include/spdk/xor.h 00:03:52.521 TEST_HEADER include/spdk/zipf.h 00:03:52.521 CXX test/cpp_headers/accel.o 00:03:52.521 LINK lsvmd 00:03:52.521 LINK rpc_client_test 00:03:52.521 LINK jsoncat 00:03:52.521 LINK led 00:03:52.521 LINK histogram_perf 00:03:52.521 LINK event_perf 00:03:52.521 LINK spdk_nvme_discover 00:03:52.521 LINK zipf 00:03:52.521 LINK env_dpdk_post_init 00:03:52.521 LINK interrupt_tgt 00:03:52.521 LINK poller_perf 00:03:52.521 LINK vtophys 00:03:52.521 LINK nvmf_tgt 00:03:52.521 LINK vhost 00:03:52.521 LINK spdk_trace_record 00:03:52.521 LINK iscsi_tgt 00:03:52.521 LINK ioat_perf 00:03:52.805 LINK verify 00:03:52.805 LINK bdev_svc 00:03:52.805 LINK spdk_tgt 00:03:52.805 LINK mkfs 00:03:52.805 LINK hello_sock 00:03:52.805 LINK hello_world 00:03:52.805 LINK hello_bdev 00:03:52.805 LINK hello_blob 00:03:52.805 LINK thread 00:03:52.805 LINK aer 00:03:52.805 CXX test/cpp_headers/accel_module.o 00:03:52.805 CC examples/nvme/reconnect/reconnect.o 00:03:52.805 CXX test/cpp_headers/assert.o 00:03:52.805 LINK spdk_dd 00:03:52.805 LINK nvmf 00:03:52.805 LINK idxd_perf 00:03:52.805 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:52.805 CC test/nvme/reset/reset.o 00:03:52.805 CC test/event/reactor/reactor.o 00:03:52.805 CXX test/cpp_headers/barrier.o 00:03:53.079 CC examples/nvme/arbitration/arbitration.o 00:03:53.079 LINK pci_ut 00:03:53.079 CC test/nvme/sgl/sgl.o 00:03:53.079 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:53.079 LINK spdk_trace 00:03:53.079 CC examples/nvme/hotplug/hotplug.o 00:03:53.079 CC app/fio/bdev/fio_plugin.o 00:03:53.079 CC test/event/reactor_perf/reactor_perf.o 00:03:53.079 LINK bdevio 00:03:53.079 CC test/nvme/e2edp/nvme_dp.o 00:03:53.079 CC test/app/stub/stub.o 00:03:53.079 LINK dif 00:03:53.079 LINK test_dma 00:03:53.079 CXX test/cpp_headers/base64.o 00:03:53.079 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:53.079 CC test/event/app_repeat/app_repeat.o 00:03:53.079 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:53.079 LINK accel_perf 00:03:53.079 CXX test/cpp_headers/bdev.o 00:03:53.079 CC test/nvme/overhead/overhead.o 00:03:53.079 LINK nvme_fuzz 00:03:53.079 CC test/nvme/err_injection/err_injection.o 00:03:53.079 CC test/event/scheduler/scheduler.o 00:03:53.079 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:53.079 CXX test/cpp_headers/bdev_module.o 00:03:53.079 CC test/nvme/startup/startup.o 00:03:53.342 LINK reactor 00:03:53.342 CC test/nvme/reserve/reserve.o 00:03:53.342 CC test/nvme/simple_copy/simple_copy.o 00:03:53.342 CXX test/cpp_headers/bdev_zone.o 00:03:53.342 LINK blobcli 00:03:53.342 CXX test/cpp_headers/bit_array.o 00:03:53.342 LINK reactor_perf 00:03:53.342 CC examples/nvme/abort/abort.o 00:03:53.342 CC test/nvme/connect_stress/connect_stress.o 00:03:53.342 CXX test/cpp_headers/bit_pool.o 00:03:53.342 LINK spdk_nvme 00:03:53.343 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:53.343 CC test/nvme/boot_partition/boot_partition.o 00:03:53.343 CXX test/cpp_headers/blob_bdev.o 00:03:53.343 CC test/nvme/compliance/nvme_compliance.o 00:03:53.343 LINK stub 00:03:53.343 LINK app_repeat 00:03:53.343 CXX test/cpp_headers/blobfs.o 00:03:53.343 CXX test/cpp_headers/blobfs_bdev.o 00:03:53.343 LINK reset 00:03:53.343 CXX test/cpp_headers/blob.o 00:03:53.343 LINK cmb_copy 00:03:53.343 LINK hotplug 00:03:53.343 LINK sgl 00:03:53.605 CXX test/cpp_headers/conf.o 00:03:53.605 CC test/nvme/fused_ordering/fused_ordering.o 00:03:53.605 CXX test/cpp_headers/config.o 00:03:53.605 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:53.605 LINK mem_callbacks 00:03:53.605 LINK err_injection 00:03:53.605 CXX test/cpp_headers/cpuset.o 00:03:53.605 LINK reconnect 00:03:53.605 CC test/nvme/fdp/fdp.o 00:03:53.605 CXX test/cpp_headers/crc16.o 00:03:53.605 CC test/nvme/cuse/cuse.o 00:03:53.605 LINK nvme_dp 00:03:53.605 LINK startup 00:03:53.605 CXX test/cpp_headers/crc32.o 00:03:53.605 LINK arbitration 00:03:53.605 LINK scheduler 00:03:53.605 CXX test/cpp_headers/crc64.o 00:03:53.605 CXX test/cpp_headers/dif.o 00:03:53.605 LINK reserve 00:03:53.605 LINK boot_partition 00:03:53.605 LINK overhead 00:03:53.605 CXX test/cpp_headers/dma.o 00:03:53.605 CXX test/cpp_headers/endian.o 00:03:53.605 LINK spdk_nvme_perf 00:03:53.605 LINK connect_stress 00:03:53.605 LINK pmr_persistence 00:03:53.605 CXX test/cpp_headers/env_dpdk.o 00:03:53.605 LINK spdk_nvme_identify 00:03:53.605 CXX test/cpp_headers/env.o 00:03:53.605 CXX test/cpp_headers/event.o 00:03:53.605 LINK simple_copy 00:03:53.605 LINK spdk_top 00:03:53.864 CXX test/cpp_headers/fd_group.o 00:03:53.864 LINK bdevperf 00:03:53.864 CXX test/cpp_headers/fd.o 00:03:53.864 CXX test/cpp_headers/file.o 00:03:53.864 CXX test/cpp_headers/ftl.o 00:03:53.864 CXX test/cpp_headers/gpt_spec.o 00:03:53.864 CXX test/cpp_headers/hexlify.o 00:03:53.864 CXX test/cpp_headers/histogram_data.o 00:03:53.864 CXX test/cpp_headers/idxd.o 00:03:53.864 CXX test/cpp_headers/idxd_spec.o 00:03:53.864 CXX test/cpp_headers/init.o 00:03:53.864 CXX test/cpp_headers/ioat.o 00:03:53.864 CXX test/cpp_headers/ioat_spec.o 00:03:53.864 LINK nvme_manage 00:03:53.864 CXX test/cpp_headers/iscsi_spec.o 00:03:53.864 CXX test/cpp_headers/json.o 00:03:53.864 LINK spdk_bdev 00:03:53.864 CXX test/cpp_headers/jsonrpc.o 00:03:53.864 CXX test/cpp_headers/likely.o 00:03:53.864 LINK fused_ordering 00:03:53.864 LINK doorbell_aers 00:03:53.864 CXX test/cpp_headers/log.o 00:03:53.864 CXX test/cpp_headers/lvol.o 00:03:53.864 LINK memory_ut 00:03:53.864 CXX test/cpp_headers/memory.o 00:03:53.864 CXX test/cpp_headers/mmio.o 00:03:53.864 CXX test/cpp_headers/nbd.o 00:03:53.864 CXX test/cpp_headers/notify.o 00:03:53.864 CXX test/cpp_headers/nvme.o 00:03:53.864 LINK vhost_fuzz 00:03:53.864 CXX test/cpp_headers/nvme_intel.o 00:03:54.133 CXX test/cpp_headers/nvme_ocssd.o 00:03:54.133 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:54.133 CXX test/cpp_headers/nvme_spec.o 00:03:54.133 CXX test/cpp_headers/nvme_zns.o 00:03:54.133 LINK abort 00:03:54.133 LINK nvme_compliance 00:03:54.133 CXX test/cpp_headers/nvmf_cmd.o 00:03:54.133 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:54.133 CXX test/cpp_headers/nvmf.o 00:03:54.133 CXX test/cpp_headers/nvmf_spec.o 00:03:54.133 CXX test/cpp_headers/nvmf_transport.o 00:03:54.133 CXX test/cpp_headers/opal.o 00:03:54.133 CXX test/cpp_headers/opal_spec.o 00:03:54.133 CXX test/cpp_headers/pci_ids.o 00:03:54.133 CXX test/cpp_headers/pipe.o 00:03:54.133 CXX test/cpp_headers/queue.o 00:03:54.133 CXX test/cpp_headers/reduce.o 00:03:54.133 LINK fdp 00:03:54.133 CXX test/cpp_headers/rpc.o 00:03:54.133 CXX test/cpp_headers/scheduler.o 00:03:54.133 CXX test/cpp_headers/scsi.o 00:03:54.133 CXX test/cpp_headers/scsi_spec.o 00:03:54.133 CXX test/cpp_headers/sock.o 00:03:54.133 CXX test/cpp_headers/stdinc.o 00:03:54.133 CXX test/cpp_headers/string.o 00:03:54.133 CXX test/cpp_headers/thread.o 00:03:54.133 CXX test/cpp_headers/trace.o 00:03:54.133 CXX test/cpp_headers/trace_parser.o 00:03:54.133 CXX test/cpp_headers/tree.o 00:03:54.133 CXX test/cpp_headers/ublk.o 00:03:54.133 CXX test/cpp_headers/util.o 00:03:54.391 CXX test/cpp_headers/uuid.o 00:03:54.391 CXX test/cpp_headers/version.o 00:03:54.391 CXX test/cpp_headers/vfio_user_pci.o 00:03:54.391 CXX test/cpp_headers/vfio_user_spec.o 00:03:54.391 CXX test/cpp_headers/vhost.o 00:03:54.391 CXX test/cpp_headers/vmd.o 00:03:54.391 CXX test/cpp_headers/xor.o 00:03:54.391 CXX test/cpp_headers/zipf.o 00:03:54.958 LINK cuse 00:03:55.216 LINK iscsi_fuzz 00:03:57.744 LINK esnap 00:03:58.002 00:03:58.002 real 0m37.928s 00:03:58.002 user 7m16.186s 00:03:58.002 sys 1m38.851s 00:03:58.002 15:50:21 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:58.002 15:50:21 -- common/autotest_common.sh@10 -- $ set +x 00:03:58.002 ************************************ 00:03:58.002 END TEST make 00:03:58.002 ************************************ 00:03:58.002 15:50:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:58.002 15:50:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:58.002 15:50:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:58.261 15:50:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:58.261 15:50:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:58.261 15:50:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:58.261 15:50:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:58.261 15:50:21 -- scripts/common.sh@335 -- # IFS=.-: 00:03:58.261 15:50:21 -- scripts/common.sh@335 -- # read -ra ver1 00:03:58.261 15:50:21 -- scripts/common.sh@336 -- # IFS=.-: 00:03:58.261 15:50:21 -- scripts/common.sh@336 -- # read -ra ver2 00:03:58.261 15:50:21 -- scripts/common.sh@337 -- # local 'op=<' 00:03:58.261 15:50:21 -- scripts/common.sh@339 -- # ver1_l=2 00:03:58.261 15:50:21 -- scripts/common.sh@340 -- # ver2_l=1 00:03:58.261 15:50:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:58.261 15:50:21 -- scripts/common.sh@343 -- # case "$op" in 00:03:58.261 15:50:21 -- scripts/common.sh@344 -- # : 1 00:03:58.261 15:50:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:58.261 15:50:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:58.261 15:50:21 -- scripts/common.sh@364 -- # decimal 1 00:03:58.261 15:50:21 -- scripts/common.sh@352 -- # local d=1 00:03:58.261 15:50:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:58.261 15:50:21 -- scripts/common.sh@354 -- # echo 1 00:03:58.261 15:50:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:58.261 15:50:21 -- scripts/common.sh@365 -- # decimal 2 00:03:58.261 15:50:21 -- scripts/common.sh@352 -- # local d=2 00:03:58.261 15:50:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:58.261 15:50:21 -- scripts/common.sh@354 -- # echo 2 00:03:58.261 15:50:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:58.261 15:50:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:58.261 15:50:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:58.261 15:50:21 -- scripts/common.sh@367 -- # return 0 00:03:58.261 15:50:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:58.261 15:50:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:58.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.261 --rc genhtml_branch_coverage=1 00:03:58.261 --rc genhtml_function_coverage=1 00:03:58.261 --rc genhtml_legend=1 00:03:58.261 --rc geninfo_all_blocks=1 00:03:58.261 --rc geninfo_unexecuted_blocks=1 00:03:58.261 00:03:58.261 ' 00:03:58.261 15:50:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:58.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.261 --rc genhtml_branch_coverage=1 00:03:58.261 --rc genhtml_function_coverage=1 00:03:58.261 --rc genhtml_legend=1 00:03:58.261 --rc geninfo_all_blocks=1 00:03:58.261 --rc geninfo_unexecuted_blocks=1 00:03:58.261 00:03:58.261 ' 00:03:58.261 15:50:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:58.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.261 --rc genhtml_branch_coverage=1 00:03:58.261 --rc genhtml_function_coverage=1 00:03:58.261 --rc genhtml_legend=1 00:03:58.261 --rc geninfo_all_blocks=1 00:03:58.261 --rc geninfo_unexecuted_blocks=1 00:03:58.261 00:03:58.261 ' 00:03:58.261 15:50:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:58.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:58.261 --rc genhtml_branch_coverage=1 00:03:58.261 --rc genhtml_function_coverage=1 00:03:58.261 --rc genhtml_legend=1 00:03:58.261 --rc geninfo_all_blocks=1 00:03:58.261 --rc geninfo_unexecuted_blocks=1 00:03:58.261 00:03:58.261 ' 00:03:58.261 15:50:21 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:58.261 15:50:21 -- nvmf/common.sh@7 -- # uname -s 00:03:58.261 15:50:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:58.261 15:50:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:58.261 15:50:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:58.261 15:50:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:58.261 15:50:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:58.261 15:50:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:58.261 15:50:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:58.261 15:50:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:58.261 15:50:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:58.261 15:50:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:58.261 15:50:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:58.261 15:50:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:58.262 15:50:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:58.262 15:50:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:58.262 15:50:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:58.262 15:50:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:58.262 15:50:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:58.262 15:50:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:58.262 15:50:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:58.262 15:50:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:58.262 15:50:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:58.262 15:50:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:58.262 15:50:21 -- paths/export.sh@5 -- # export PATH 00:03:58.262 15:50:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:58.262 15:50:21 -- nvmf/common.sh@46 -- # : 0 00:03:58.262 15:50:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:58.262 15:50:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:58.262 15:50:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:58.262 15:50:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:58.262 15:50:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:58.262 15:50:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:58.262 15:50:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:58.262 15:50:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:58.262 15:50:21 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:58.262 15:50:21 -- spdk/autotest.sh@32 -- # uname -s 00:03:58.262 15:50:21 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:58.262 15:50:21 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:58.262 15:50:21 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:58.262 15:50:21 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:58.262 15:50:21 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:58.262 15:50:21 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:58.262 15:50:21 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:58.262 15:50:21 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:58.262 15:50:21 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:58.262 15:50:21 -- spdk/autotest.sh@48 -- # udevadm_pid=1428204 00:03:58.262 15:50:21 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:58.262 15:50:21 -- spdk/autotest.sh@54 -- # echo 1428206 00:03:58.262 15:50:21 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:58.262 15:50:21 -- spdk/autotest.sh@56 -- # echo 1428207 00:03:58.262 15:50:21 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:58.262 15:50:21 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:58.262 15:50:21 -- spdk/autotest.sh@60 -- # echo 1428208 00:03:58.262 15:50:21 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:58.262 15:50:21 -- spdk/autotest.sh@62 -- # echo 1428209 00:03:58.262 15:50:21 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:58.262 15:50:21 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:58.262 15:50:21 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:58.262 15:50:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:58.262 15:50:21 -- common/autotest_common.sh@10 -- # set +x 00:03:58.262 15:50:21 -- spdk/autotest.sh@70 -- # create_test_list 00:03:58.262 15:50:21 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:58.262 15:50:21 -- common/autotest_common.sh@10 -- # set +x 00:03:58.262 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:58.262 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:58.262 15:50:21 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:58.262 15:50:21 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:58.262 15:50:21 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:58.262 15:50:21 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:58.262 15:50:21 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:58.262 15:50:21 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:58.262 15:50:21 -- common/autotest_common.sh@1450 -- # uname 00:03:58.262 15:50:21 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:58.262 15:50:21 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:58.262 15:50:21 -- common/autotest_common.sh@1470 -- # uname 00:03:58.262 15:50:21 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:58.262 15:50:21 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:58.262 15:50:21 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:58.262 lcov: LCOV version 1.15 00:03:58.262 15:50:21 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:04:02.446 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:04:02.446 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:04:02.446 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:04:02.446 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:04:02.446 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:04:02.446 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:34.513 15:50:54 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:34.513 15:50:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:34.513 15:50:54 -- common/autotest_common.sh@10 -- # set +x 00:04:34.513 15:50:54 -- spdk/autotest.sh@89 -- # rm -f 00:04:34.513 15:50:54 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:34.513 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:34.513 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:34.513 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:34.513 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:34.513 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:34.513 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:34.513 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:34.513 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:34.513 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:34.513 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:34.513 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:34.513 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:34.513 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:34.513 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:34.513 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:34.513 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:34.513 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:34.513 15:50:56 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:34.513 15:50:56 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:34.513 15:50:56 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:34.513 15:50:56 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:34.513 15:50:56 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:34.513 15:50:56 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:34.513 15:50:56 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:34.513 15:50:56 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:34.513 15:50:56 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:34.513 15:50:56 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:34.513 15:50:56 -- spdk/autotest.sh@108 -- # grep -v p 00:04:34.513 15:50:56 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:34.513 15:50:56 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:34.513 15:50:56 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:34.513 15:50:56 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:34.513 15:50:56 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:34.513 15:50:56 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:34.513 No valid GPT data, bailing 00:04:34.513 15:50:56 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:34.513 15:50:56 -- scripts/common.sh@393 -- # pt= 00:04:34.513 15:50:56 -- scripts/common.sh@394 -- # return 1 00:04:34.513 15:50:56 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:34.513 1+0 records in 00:04:34.513 1+0 records out 00:04:34.513 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00221214 s, 474 MB/s 00:04:34.513 15:50:56 -- spdk/autotest.sh@116 -- # sync 00:04:34.513 15:50:56 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:34.513 15:50:56 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:34.513 15:50:56 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:34.513 15:50:58 -- spdk/autotest.sh@122 -- # uname -s 00:04:34.513 15:50:58 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:34.513 15:50:58 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:34.513 15:50:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.513 15:50:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.514 15:50:58 -- common/autotest_common.sh@10 -- # set +x 00:04:34.514 ************************************ 00:04:34.514 START TEST setup.sh 00:04:34.514 ************************************ 00:04:34.514 15:50:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:34.772 * Looking for test storage... 00:04:34.772 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:34.772 15:50:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:34.772 15:50:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:34.772 15:50:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:34.772 15:50:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:34.772 15:50:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:34.772 15:50:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:34.772 15:50:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:34.772 15:50:58 -- scripts/common.sh@335 -- # IFS=.-: 00:04:34.772 15:50:58 -- scripts/common.sh@335 -- # read -ra ver1 00:04:34.772 15:50:58 -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.772 15:50:58 -- scripts/common.sh@336 -- # read -ra ver2 00:04:34.772 15:50:58 -- scripts/common.sh@337 -- # local 'op=<' 00:04:34.772 15:50:58 -- scripts/common.sh@339 -- # ver1_l=2 00:04:34.772 15:50:58 -- scripts/common.sh@340 -- # ver2_l=1 00:04:34.772 15:50:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:34.772 15:50:58 -- scripts/common.sh@343 -- # case "$op" in 00:04:34.772 15:50:58 -- scripts/common.sh@344 -- # : 1 00:04:34.772 15:50:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:34.772 15:50:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.772 15:50:58 -- scripts/common.sh@364 -- # decimal 1 00:04:34.772 15:50:58 -- scripts/common.sh@352 -- # local d=1 00:04:34.772 15:50:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.772 15:50:58 -- scripts/common.sh@354 -- # echo 1 00:04:34.772 15:50:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:34.772 15:50:58 -- scripts/common.sh@365 -- # decimal 2 00:04:34.772 15:50:58 -- scripts/common.sh@352 -- # local d=2 00:04:34.772 15:50:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.772 15:50:58 -- scripts/common.sh@354 -- # echo 2 00:04:34.772 15:50:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:34.772 15:50:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:34.772 15:50:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:34.772 15:50:58 -- scripts/common.sh@367 -- # return 0 00:04:34.772 15:50:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.772 15:50:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:34.772 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.772 --rc genhtml_branch_coverage=1 00:04:34.772 --rc genhtml_function_coverage=1 00:04:34.772 --rc genhtml_legend=1 00:04:34.772 --rc geninfo_all_blocks=1 00:04:34.772 --rc geninfo_unexecuted_blocks=1 00:04:34.772 00:04:34.772 ' 00:04:34.772 15:50:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:34.772 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.772 --rc genhtml_branch_coverage=1 00:04:34.772 --rc genhtml_function_coverage=1 00:04:34.772 --rc genhtml_legend=1 00:04:34.772 --rc geninfo_all_blocks=1 00:04:34.772 --rc geninfo_unexecuted_blocks=1 00:04:34.772 00:04:34.772 ' 00:04:34.772 15:50:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:34.772 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.772 --rc genhtml_branch_coverage=1 00:04:34.772 --rc genhtml_function_coverage=1 00:04:34.772 --rc genhtml_legend=1 00:04:34.772 --rc geninfo_all_blocks=1 00:04:34.772 --rc geninfo_unexecuted_blocks=1 00:04:34.772 00:04:34.772 ' 00:04:34.772 15:50:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:34.772 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.772 --rc genhtml_branch_coverage=1 00:04:34.772 --rc genhtml_function_coverage=1 00:04:34.772 --rc genhtml_legend=1 00:04:34.772 --rc geninfo_all_blocks=1 00:04:34.772 --rc geninfo_unexecuted_blocks=1 00:04:34.772 00:04:34.772 ' 00:04:34.772 15:50:58 -- setup/test-setup.sh@10 -- # uname -s 00:04:34.772 15:50:58 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:34.772 15:50:58 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:34.772 15:50:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.772 15:50:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.772 15:50:58 -- common/autotest_common.sh@10 -- # set +x 00:04:34.772 ************************************ 00:04:34.772 START TEST acl 00:04:34.772 ************************************ 00:04:34.772 15:50:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:34.772 * Looking for test storage... 00:04:34.772 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:34.772 15:50:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:34.772 15:50:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:34.772 15:50:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:35.031 15:50:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:35.031 15:50:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:35.031 15:50:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:35.031 15:50:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:35.031 15:50:58 -- scripts/common.sh@335 -- # IFS=.-: 00:04:35.031 15:50:58 -- scripts/common.sh@335 -- # read -ra ver1 00:04:35.031 15:50:58 -- scripts/common.sh@336 -- # IFS=.-: 00:04:35.031 15:50:58 -- scripts/common.sh@336 -- # read -ra ver2 00:04:35.031 15:50:58 -- scripts/common.sh@337 -- # local 'op=<' 00:04:35.031 15:50:58 -- scripts/common.sh@339 -- # ver1_l=2 00:04:35.031 15:50:58 -- scripts/common.sh@340 -- # ver2_l=1 00:04:35.031 15:50:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:35.031 15:50:58 -- scripts/common.sh@343 -- # case "$op" in 00:04:35.031 15:50:58 -- scripts/common.sh@344 -- # : 1 00:04:35.031 15:50:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:35.031 15:50:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:35.031 15:50:58 -- scripts/common.sh@364 -- # decimal 1 00:04:35.031 15:50:58 -- scripts/common.sh@352 -- # local d=1 00:04:35.031 15:50:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:35.031 15:50:58 -- scripts/common.sh@354 -- # echo 1 00:04:35.031 15:50:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:35.031 15:50:58 -- scripts/common.sh@365 -- # decimal 2 00:04:35.031 15:50:58 -- scripts/common.sh@352 -- # local d=2 00:04:35.031 15:50:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:35.031 15:50:58 -- scripts/common.sh@354 -- # echo 2 00:04:35.031 15:50:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:35.031 15:50:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:35.031 15:50:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:35.031 15:50:58 -- scripts/common.sh@367 -- # return 0 00:04:35.031 15:50:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:35.031 15:50:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:35.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.031 --rc genhtml_branch_coverage=1 00:04:35.031 --rc genhtml_function_coverage=1 00:04:35.031 --rc genhtml_legend=1 00:04:35.031 --rc geninfo_all_blocks=1 00:04:35.031 --rc geninfo_unexecuted_blocks=1 00:04:35.031 00:04:35.031 ' 00:04:35.031 15:50:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:35.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.031 --rc genhtml_branch_coverage=1 00:04:35.031 --rc genhtml_function_coverage=1 00:04:35.031 --rc genhtml_legend=1 00:04:35.031 --rc geninfo_all_blocks=1 00:04:35.031 --rc geninfo_unexecuted_blocks=1 00:04:35.031 00:04:35.031 ' 00:04:35.031 15:50:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:35.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.031 --rc genhtml_branch_coverage=1 00:04:35.031 --rc genhtml_function_coverage=1 00:04:35.031 --rc genhtml_legend=1 00:04:35.031 --rc geninfo_all_blocks=1 00:04:35.031 --rc geninfo_unexecuted_blocks=1 00:04:35.031 00:04:35.031 ' 00:04:35.031 15:50:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:35.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.031 --rc genhtml_branch_coverage=1 00:04:35.031 --rc genhtml_function_coverage=1 00:04:35.031 --rc genhtml_legend=1 00:04:35.031 --rc geninfo_all_blocks=1 00:04:35.031 --rc geninfo_unexecuted_blocks=1 00:04:35.031 00:04:35.031 ' 00:04:35.031 15:50:58 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:35.031 15:50:58 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:35.031 15:50:58 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:35.031 15:50:58 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:35.031 15:50:58 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:35.031 15:50:58 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:35.031 15:50:58 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:35.031 15:50:58 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:35.031 15:50:58 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:35.031 15:50:58 -- setup/acl.sh@12 -- # devs=() 00:04:35.031 15:50:58 -- setup/acl.sh@12 -- # declare -a devs 00:04:35.031 15:50:58 -- setup/acl.sh@13 -- # drivers=() 00:04:35.031 15:50:58 -- setup/acl.sh@13 -- # declare -A drivers 00:04:35.031 15:50:58 -- setup/acl.sh@51 -- # setup reset 00:04:35.031 15:50:58 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:35.031 15:50:58 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:36.406 15:50:59 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:36.406 15:50:59 -- setup/acl.sh@16 -- # local dev driver 00:04:36.406 15:50:59 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:36.406 15:50:59 -- setup/acl.sh@15 -- # setup output status 00:04:36.406 15:50:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:36.406 15:50:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:37.339 Hugepages 00:04:37.339 node hugesize free / total 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 00:04:37.598 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:00 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:37.598 15:51:00 -- setup/acl.sh@20 -- # continue 00:04:37.598 15:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:01 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:37.598 15:51:01 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:37.598 15:51:01 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:37.598 15:51:01 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:37.598 15:51:01 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:37.598 15:51:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:37.598 15:51:01 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:37.598 15:51:01 -- setup/acl.sh@54 -- # run_test denied denied 00:04:37.598 15:51:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.598 15:51:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.598 15:51:01 -- common/autotest_common.sh@10 -- # set +x 00:04:37.598 ************************************ 00:04:37.598 START TEST denied 00:04:37.598 ************************************ 00:04:37.598 15:51:01 -- common/autotest_common.sh@1114 -- # denied 00:04:37.598 15:51:01 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:37.598 15:51:01 -- setup/acl.sh@38 -- # setup output config 00:04:37.598 15:51:01 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:37.598 15:51:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:37.598 15:51:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:38.975 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:38.975 15:51:02 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:38.975 15:51:02 -- setup/acl.sh@28 -- # local dev driver 00:04:38.975 15:51:02 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:38.975 15:51:02 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:38.975 15:51:02 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:38.975 15:51:02 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:38.975 15:51:02 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:38.975 15:51:02 -- setup/acl.sh@41 -- # setup reset 00:04:38.975 15:51:02 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:38.975 15:51:02 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:41.506 00:04:41.506 real 0m3.963s 00:04:41.506 user 0m1.148s 00:04:41.506 sys 0m1.919s 00:04:41.506 15:51:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:41.506 15:51:05 -- common/autotest_common.sh@10 -- # set +x 00:04:41.506 ************************************ 00:04:41.506 END TEST denied 00:04:41.506 ************************************ 00:04:41.506 15:51:05 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:41.506 15:51:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.506 15:51:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.506 15:51:05 -- common/autotest_common.sh@10 -- # set +x 00:04:41.506 ************************************ 00:04:41.506 START TEST allowed 00:04:41.506 ************************************ 00:04:41.506 15:51:05 -- common/autotest_common.sh@1114 -- # allowed 00:04:41.506 15:51:05 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:41.506 15:51:05 -- setup/acl.sh@45 -- # setup output config 00:04:41.506 15:51:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:41.506 15:51:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:41.506 15:51:05 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:44.035 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:44.035 15:51:07 -- setup/acl.sh@47 -- # verify 00:04:44.035 15:51:07 -- setup/acl.sh@28 -- # local dev driver 00:04:44.035 15:51:07 -- setup/acl.sh@48 -- # setup reset 00:04:44.035 15:51:07 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:44.035 15:51:07 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:45.411 00:04:45.411 real 0m3.829s 00:04:45.411 user 0m0.972s 00:04:45.411 sys 0m1.734s 00:04:45.411 15:51:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.411 15:51:08 -- common/autotest_common.sh@10 -- # set +x 00:04:45.411 ************************************ 00:04:45.411 END TEST allowed 00:04:45.411 ************************************ 00:04:45.411 00:04:45.411 real 0m10.647s 00:04:45.411 user 0m3.248s 00:04:45.411 sys 0m5.462s 00:04:45.411 15:51:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.411 15:51:08 -- common/autotest_common.sh@10 -- # set +x 00:04:45.411 ************************************ 00:04:45.411 END TEST acl 00:04:45.411 ************************************ 00:04:45.411 15:51:08 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:45.411 15:51:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.411 15:51:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.411 15:51:08 -- common/autotest_common.sh@10 -- # set +x 00:04:45.411 ************************************ 00:04:45.411 START TEST hugepages 00:04:45.411 ************************************ 00:04:45.411 15:51:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:45.411 * Looking for test storage... 00:04:45.411 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:45.411 15:51:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:45.411 15:51:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:45.411 15:51:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:45.670 15:51:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:45.670 15:51:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:45.670 15:51:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:45.670 15:51:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:45.670 15:51:09 -- scripts/common.sh@335 -- # IFS=.-: 00:04:45.670 15:51:09 -- scripts/common.sh@335 -- # read -ra ver1 00:04:45.670 15:51:09 -- scripts/common.sh@336 -- # IFS=.-: 00:04:45.670 15:51:09 -- scripts/common.sh@336 -- # read -ra ver2 00:04:45.670 15:51:09 -- scripts/common.sh@337 -- # local 'op=<' 00:04:45.670 15:51:09 -- scripts/common.sh@339 -- # ver1_l=2 00:04:45.670 15:51:09 -- scripts/common.sh@340 -- # ver2_l=1 00:04:45.670 15:51:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:45.670 15:51:09 -- scripts/common.sh@343 -- # case "$op" in 00:04:45.670 15:51:09 -- scripts/common.sh@344 -- # : 1 00:04:45.670 15:51:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:45.670 15:51:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:45.670 15:51:09 -- scripts/common.sh@364 -- # decimal 1 00:04:45.670 15:51:09 -- scripts/common.sh@352 -- # local d=1 00:04:45.670 15:51:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:45.670 15:51:09 -- scripts/common.sh@354 -- # echo 1 00:04:45.670 15:51:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:45.670 15:51:09 -- scripts/common.sh@365 -- # decimal 2 00:04:45.670 15:51:09 -- scripts/common.sh@352 -- # local d=2 00:04:45.670 15:51:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:45.670 15:51:09 -- scripts/common.sh@354 -- # echo 2 00:04:45.670 15:51:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:45.670 15:51:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:45.670 15:51:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:45.670 15:51:09 -- scripts/common.sh@367 -- # return 0 00:04:45.670 15:51:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:45.670 15:51:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:45.670 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.670 --rc genhtml_branch_coverage=1 00:04:45.670 --rc genhtml_function_coverage=1 00:04:45.670 --rc genhtml_legend=1 00:04:45.670 --rc geninfo_all_blocks=1 00:04:45.670 --rc geninfo_unexecuted_blocks=1 00:04:45.670 00:04:45.670 ' 00:04:45.670 15:51:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:45.670 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.670 --rc genhtml_branch_coverage=1 00:04:45.670 --rc genhtml_function_coverage=1 00:04:45.670 --rc genhtml_legend=1 00:04:45.670 --rc geninfo_all_blocks=1 00:04:45.670 --rc geninfo_unexecuted_blocks=1 00:04:45.670 00:04:45.670 ' 00:04:45.670 15:51:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:45.670 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.670 --rc genhtml_branch_coverage=1 00:04:45.670 --rc genhtml_function_coverage=1 00:04:45.670 --rc genhtml_legend=1 00:04:45.670 --rc geninfo_all_blocks=1 00:04:45.670 --rc geninfo_unexecuted_blocks=1 00:04:45.670 00:04:45.670 ' 00:04:45.670 15:51:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:45.670 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.670 --rc genhtml_branch_coverage=1 00:04:45.670 --rc genhtml_function_coverage=1 00:04:45.670 --rc genhtml_legend=1 00:04:45.670 --rc geninfo_all_blocks=1 00:04:45.670 --rc geninfo_unexecuted_blocks=1 00:04:45.670 00:04:45.670 ' 00:04:45.670 15:51:09 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:45.670 15:51:09 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:45.670 15:51:09 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:45.670 15:51:09 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:45.670 15:51:09 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:45.670 15:51:09 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:45.670 15:51:09 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:45.670 15:51:09 -- setup/common.sh@18 -- # local node= 00:04:45.670 15:51:09 -- setup/common.sh@19 -- # local var val 00:04:45.670 15:51:09 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.670 15:51:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.670 15:51:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.670 15:51:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.670 15:51:09 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.670 15:51:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.670 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.670 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.670 15:51:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 41182600 kB' 'MemAvailable: 44931764 kB' 'Buffers: 2708 kB' 'Cached: 12667748 kB' 'SwapCached: 0 kB' 'Active: 9367556 kB' 'Inactive: 3753000 kB' 'Active(anon): 8976200 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453536 kB' 'Mapped: 157944 kB' 'Shmem: 8526100 kB' 'KReclaimable: 197260 kB' 'Slab: 688908 kB' 'SReclaimable: 197260 kB' 'SUnreclaim: 491648 kB' 'KernelStack: 12864 kB' 'PageTables: 8036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559284 kB' 'Committed_AS: 10044172 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:45.670 15:51:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.670 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.670 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.670 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.670 15:51:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.670 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.670 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.670 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.670 15:51:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.670 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.670 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.670 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.670 15:51:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.670 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.670 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.671 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.671 15:51:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # continue 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.672 15:51:09 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.672 15:51:09 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:45.672 15:51:09 -- setup/common.sh@33 -- # echo 2048 00:04:45.672 15:51:09 -- setup/common.sh@33 -- # return 0 00:04:45.672 15:51:09 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:45.672 15:51:09 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:45.672 15:51:09 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:45.672 15:51:09 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:45.672 15:51:09 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:45.672 15:51:09 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:45.672 15:51:09 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:45.672 15:51:09 -- setup/hugepages.sh@207 -- # get_nodes 00:04:45.672 15:51:09 -- setup/hugepages.sh@27 -- # local node 00:04:45.672 15:51:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.672 15:51:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:45.672 15:51:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.672 15:51:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:45.672 15:51:09 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:45.672 15:51:09 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:45.672 15:51:09 -- setup/hugepages.sh@208 -- # clear_hp 00:04:45.672 15:51:09 -- setup/hugepages.sh@37 -- # local node hp 00:04:45.672 15:51:09 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:45.672 15:51:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:45.672 15:51:09 -- setup/hugepages.sh@41 -- # echo 0 00:04:45.672 15:51:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:45.672 15:51:09 -- setup/hugepages.sh@41 -- # echo 0 00:04:45.672 15:51:09 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:45.672 15:51:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:45.672 15:51:09 -- setup/hugepages.sh@41 -- # echo 0 00:04:45.672 15:51:09 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:45.672 15:51:09 -- setup/hugepages.sh@41 -- # echo 0 00:04:45.672 15:51:09 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:45.672 15:51:09 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:45.672 15:51:09 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:45.672 15:51:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.672 15:51:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.672 15:51:09 -- common/autotest_common.sh@10 -- # set +x 00:04:45.672 ************************************ 00:04:45.672 START TEST default_setup 00:04:45.672 ************************************ 00:04:45.672 15:51:09 -- common/autotest_common.sh@1114 -- # default_setup 00:04:45.672 15:51:09 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:45.672 15:51:09 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:45.672 15:51:09 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:45.672 15:51:09 -- setup/hugepages.sh@51 -- # shift 00:04:45.672 15:51:09 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:45.672 15:51:09 -- setup/hugepages.sh@52 -- # local node_ids 00:04:45.672 15:51:09 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:45.672 15:51:09 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:45.672 15:51:09 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:45.672 15:51:09 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:45.672 15:51:09 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:45.672 15:51:09 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:45.672 15:51:09 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:45.672 15:51:09 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:45.672 15:51:09 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:45.672 15:51:09 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:45.672 15:51:09 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:45.672 15:51:09 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:45.672 15:51:09 -- setup/hugepages.sh@73 -- # return 0 00:04:45.672 15:51:09 -- setup/hugepages.sh@137 -- # setup output 00:04:45.672 15:51:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.672 15:51:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:47.048 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:47.048 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:47.048 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:47.048 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:47.048 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:47.048 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:47.048 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:47.048 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:47.048 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:47.048 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:47.048 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:47.048 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:47.048 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:47.048 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:47.048 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:47.048 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:47.986 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:47.987 15:51:11 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:47.987 15:51:11 -- setup/hugepages.sh@89 -- # local node 00:04:47.987 15:51:11 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:47.987 15:51:11 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:47.987 15:51:11 -- setup/hugepages.sh@92 -- # local surp 00:04:47.987 15:51:11 -- setup/hugepages.sh@93 -- # local resv 00:04:47.987 15:51:11 -- setup/hugepages.sh@94 -- # local anon 00:04:47.987 15:51:11 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:47.987 15:51:11 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:47.987 15:51:11 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:47.987 15:51:11 -- setup/common.sh@18 -- # local node= 00:04:47.987 15:51:11 -- setup/common.sh@19 -- # local var val 00:04:47.987 15:51:11 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.987 15:51:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.987 15:51:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.987 15:51:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.987 15:51:11 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.987 15:51:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43316208 kB' 'MemAvailable: 47065416 kB' 'Buffers: 2708 kB' 'Cached: 12667836 kB' 'SwapCached: 0 kB' 'Active: 9369432 kB' 'Inactive: 3753000 kB' 'Active(anon): 8978076 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455192 kB' 'Mapped: 157132 kB' 'Shmem: 8526188 kB' 'KReclaimable: 197348 kB' 'Slab: 688804 kB' 'SReclaimable: 197348 kB' 'SUnreclaim: 491456 kB' 'KernelStack: 12944 kB' 'PageTables: 8548 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047160 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.987 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.987 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.988 15:51:11 -- setup/common.sh@33 -- # echo 0 00:04:47.988 15:51:11 -- setup/common.sh@33 -- # return 0 00:04:47.988 15:51:11 -- setup/hugepages.sh@97 -- # anon=0 00:04:47.988 15:51:11 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:47.988 15:51:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.988 15:51:11 -- setup/common.sh@18 -- # local node= 00:04:47.988 15:51:11 -- setup/common.sh@19 -- # local var val 00:04:47.988 15:51:11 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.988 15:51:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.988 15:51:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.988 15:51:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.988 15:51:11 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.988 15:51:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43335128 kB' 'MemAvailable: 47084336 kB' 'Buffers: 2708 kB' 'Cached: 12667844 kB' 'SwapCached: 0 kB' 'Active: 9369140 kB' 'Inactive: 3753000 kB' 'Active(anon): 8977784 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455016 kB' 'Mapped: 157080 kB' 'Shmem: 8526196 kB' 'KReclaimable: 197348 kB' 'Slab: 688864 kB' 'SReclaimable: 197348 kB' 'SUnreclaim: 491516 kB' 'KernelStack: 12816 kB' 'PageTables: 7872 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047172 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198232 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.988 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.988 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.989 15:51:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.989 15:51:11 -- setup/common.sh@33 -- # echo 0 00:04:47.989 15:51:11 -- setup/common.sh@33 -- # return 0 00:04:47.989 15:51:11 -- setup/hugepages.sh@99 -- # surp=0 00:04:47.989 15:51:11 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:47.989 15:51:11 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:47.989 15:51:11 -- setup/common.sh@18 -- # local node= 00:04:47.989 15:51:11 -- setup/common.sh@19 -- # local var val 00:04:47.989 15:51:11 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.989 15:51:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.989 15:51:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.989 15:51:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.989 15:51:11 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.989 15:51:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.989 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43335820 kB' 'MemAvailable: 47085028 kB' 'Buffers: 2708 kB' 'Cached: 12667856 kB' 'SwapCached: 0 kB' 'Active: 9368072 kB' 'Inactive: 3753000 kB' 'Active(anon): 8976716 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453844 kB' 'Mapped: 157076 kB' 'Shmem: 8526208 kB' 'KReclaimable: 197348 kB' 'Slab: 688932 kB' 'SReclaimable: 197348 kB' 'SUnreclaim: 491584 kB' 'KernelStack: 12736 kB' 'PageTables: 7628 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047184 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.990 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.990 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.991 15:51:11 -- setup/common.sh@33 -- # echo 0 00:04:47.991 15:51:11 -- setup/common.sh@33 -- # return 0 00:04:47.991 15:51:11 -- setup/hugepages.sh@100 -- # resv=0 00:04:47.991 15:51:11 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:47.991 nr_hugepages=1024 00:04:47.991 15:51:11 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:47.991 resv_hugepages=0 00:04:47.991 15:51:11 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:47.991 surplus_hugepages=0 00:04:47.991 15:51:11 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:47.991 anon_hugepages=0 00:04:47.991 15:51:11 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:47.991 15:51:11 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:47.991 15:51:11 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:47.991 15:51:11 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:47.991 15:51:11 -- setup/common.sh@18 -- # local node= 00:04:47.991 15:51:11 -- setup/common.sh@19 -- # local var val 00:04:47.991 15:51:11 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.991 15:51:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.991 15:51:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.991 15:51:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.991 15:51:11 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.991 15:51:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43336184 kB' 'MemAvailable: 47085384 kB' 'Buffers: 2708 kB' 'Cached: 12667872 kB' 'SwapCached: 0 kB' 'Active: 9368132 kB' 'Inactive: 3753000 kB' 'Active(anon): 8976776 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453932 kB' 'Mapped: 157076 kB' 'Shmem: 8526224 kB' 'KReclaimable: 197332 kB' 'Slab: 688908 kB' 'SReclaimable: 197332 kB' 'SUnreclaim: 491576 kB' 'KernelStack: 12768 kB' 'PageTables: 7732 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047200 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.991 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.991 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.992 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.992 15:51:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.992 15:51:11 -- setup/common.sh@33 -- # echo 1024 00:04:47.992 15:51:11 -- setup/common.sh@33 -- # return 0 00:04:47.992 15:51:11 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:47.992 15:51:11 -- setup/hugepages.sh@112 -- # get_nodes 00:04:47.992 15:51:11 -- setup/hugepages.sh@27 -- # local node 00:04:47.993 15:51:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.993 15:51:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:47.993 15:51:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.993 15:51:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:47.993 15:51:11 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:47.993 15:51:11 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:47.993 15:51:11 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:47.993 15:51:11 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:47.993 15:51:11 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:47.993 15:51:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.993 15:51:11 -- setup/common.sh@18 -- # local node=0 00:04:47.993 15:51:11 -- setup/common.sh@19 -- # local var val 00:04:47.993 15:51:11 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.993 15:51:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.993 15:51:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:47.993 15:51:11 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:47.993 15:51:11 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.993 15:51:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19128944 kB' 'MemUsed: 13745980 kB' 'SwapCached: 0 kB' 'Active: 6774096 kB' 'Inactive: 3590924 kB' 'Active(anon): 6583932 kB' 'Inactive(anon): 0 kB' 'Active(file): 190164 kB' 'Inactive(file): 3590924 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10041952 kB' 'Mapped: 65860 kB' 'AnonPages: 326304 kB' 'Shmem: 6260864 kB' 'KernelStack: 8184 kB' 'PageTables: 4944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113292 kB' 'Slab: 410996 kB' 'SReclaimable: 113292 kB' 'SUnreclaim: 297704 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.993 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.993 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.994 15:51:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.994 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.994 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.994 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.994 15:51:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.994 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.994 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.994 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.994 15:51:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.994 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.994 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.994 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.994 15:51:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.994 15:51:11 -- setup/common.sh@32 -- # continue 00:04:47.994 15:51:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.994 15:51:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.994 15:51:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.994 15:51:11 -- setup/common.sh@33 -- # echo 0 00:04:47.994 15:51:11 -- setup/common.sh@33 -- # return 0 00:04:47.994 15:51:11 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:47.994 15:51:11 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:47.994 15:51:11 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:47.994 15:51:11 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:47.994 15:51:11 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:47.994 node0=1024 expecting 1024 00:04:47.994 15:51:11 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:47.994 00:04:47.994 real 0m2.383s 00:04:47.994 user 0m0.621s 00:04:47.994 sys 0m0.881s 00:04:47.994 15:51:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.994 15:51:11 -- common/autotest_common.sh@10 -- # set +x 00:04:47.994 ************************************ 00:04:47.994 END TEST default_setup 00:04:47.994 ************************************ 00:04:47.994 15:51:11 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:47.994 15:51:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.994 15:51:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.994 15:51:11 -- common/autotest_common.sh@10 -- # set +x 00:04:47.994 ************************************ 00:04:47.994 START TEST per_node_1G_alloc 00:04:47.994 ************************************ 00:04:47.994 15:51:11 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:47.994 15:51:11 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:47.994 15:51:11 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:47.994 15:51:11 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:47.994 15:51:11 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:47.994 15:51:11 -- setup/hugepages.sh@51 -- # shift 00:04:47.994 15:51:11 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:47.994 15:51:11 -- setup/hugepages.sh@52 -- # local node_ids 00:04:47.994 15:51:11 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:47.994 15:51:11 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:47.994 15:51:11 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:47.994 15:51:11 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:47.994 15:51:11 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:47.994 15:51:11 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:47.994 15:51:11 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:47.994 15:51:11 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:47.994 15:51:11 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:47.994 15:51:11 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:47.994 15:51:11 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:47.994 15:51:11 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:47.994 15:51:11 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:47.994 15:51:11 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:47.994 15:51:11 -- setup/hugepages.sh@73 -- # return 0 00:04:47.994 15:51:11 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:47.994 15:51:11 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:47.994 15:51:11 -- setup/hugepages.sh@146 -- # setup output 00:04:47.994 15:51:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:47.994 15:51:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:49.371 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:49.372 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:49.372 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:49.372 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:49.372 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:49.372 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:49.372 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:49.372 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:49.372 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:49.372 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:49.372 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:49.372 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:49.372 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:49.372 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:49.372 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:49.372 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:49.372 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:49.372 15:51:12 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:49.372 15:51:12 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:49.372 15:51:12 -- setup/hugepages.sh@89 -- # local node 00:04:49.372 15:51:12 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:49.372 15:51:12 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:49.372 15:51:12 -- setup/hugepages.sh@92 -- # local surp 00:04:49.372 15:51:12 -- setup/hugepages.sh@93 -- # local resv 00:04:49.372 15:51:12 -- setup/hugepages.sh@94 -- # local anon 00:04:49.372 15:51:12 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:49.372 15:51:12 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:49.372 15:51:12 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:49.372 15:51:12 -- setup/common.sh@18 -- # local node= 00:04:49.372 15:51:12 -- setup/common.sh@19 -- # local var val 00:04:49.372 15:51:12 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.372 15:51:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.372 15:51:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.372 15:51:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.372 15:51:12 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.372 15:51:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43332572 kB' 'MemAvailable: 47081772 kB' 'Buffers: 2708 kB' 'Cached: 12667924 kB' 'SwapCached: 0 kB' 'Active: 9369036 kB' 'Inactive: 3753000 kB' 'Active(anon): 8977680 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454672 kB' 'Mapped: 157184 kB' 'Shmem: 8526276 kB' 'KReclaimable: 197332 kB' 'Slab: 688908 kB' 'SReclaimable: 197332 kB' 'SUnreclaim: 491576 kB' 'KernelStack: 12848 kB' 'PageTables: 7916 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047372 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.372 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.372 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.373 15:51:12 -- setup/common.sh@33 -- # echo 0 00:04:49.373 15:51:12 -- setup/common.sh@33 -- # return 0 00:04:49.373 15:51:12 -- setup/hugepages.sh@97 -- # anon=0 00:04:49.373 15:51:12 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:49.373 15:51:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.373 15:51:12 -- setup/common.sh@18 -- # local node= 00:04:49.373 15:51:12 -- setup/common.sh@19 -- # local var val 00:04:49.373 15:51:12 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.373 15:51:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.373 15:51:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.373 15:51:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.373 15:51:12 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.373 15:51:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43333064 kB' 'MemAvailable: 47082264 kB' 'Buffers: 2708 kB' 'Cached: 12667928 kB' 'SwapCached: 0 kB' 'Active: 9369600 kB' 'Inactive: 3753000 kB' 'Active(anon): 8978244 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455288 kB' 'Mapped: 157184 kB' 'Shmem: 8526280 kB' 'KReclaimable: 197332 kB' 'Slab: 688880 kB' 'SReclaimable: 197332 kB' 'SUnreclaim: 491548 kB' 'KernelStack: 12880 kB' 'PageTables: 7996 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047384 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.373 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.373 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.374 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.374 15:51:12 -- setup/common.sh@33 -- # echo 0 00:04:49.374 15:51:12 -- setup/common.sh@33 -- # return 0 00:04:49.374 15:51:12 -- setup/hugepages.sh@99 -- # surp=0 00:04:49.374 15:51:12 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:49.374 15:51:12 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:49.374 15:51:12 -- setup/common.sh@18 -- # local node= 00:04:49.374 15:51:12 -- setup/common.sh@19 -- # local var val 00:04:49.374 15:51:12 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.374 15:51:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.374 15:51:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.374 15:51:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.374 15:51:12 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.374 15:51:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.374 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43335748 kB' 'MemAvailable: 47084948 kB' 'Buffers: 2708 kB' 'Cached: 12667940 kB' 'SwapCached: 0 kB' 'Active: 9368440 kB' 'Inactive: 3753000 kB' 'Active(anon): 8977084 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454028 kB' 'Mapped: 157100 kB' 'Shmem: 8526292 kB' 'KReclaimable: 197332 kB' 'Slab: 688864 kB' 'SReclaimable: 197332 kB' 'SUnreclaim: 491532 kB' 'KernelStack: 12800 kB' 'PageTables: 7724 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047400 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.375 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.375 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.376 15:51:12 -- setup/common.sh@33 -- # echo 0 00:04:49.376 15:51:12 -- setup/common.sh@33 -- # return 0 00:04:49.376 15:51:12 -- setup/hugepages.sh@100 -- # resv=0 00:04:49.376 15:51:12 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:49.376 nr_hugepages=1024 00:04:49.376 15:51:12 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:49.376 resv_hugepages=0 00:04:49.376 15:51:12 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:49.376 surplus_hugepages=0 00:04:49.376 15:51:12 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:49.376 anon_hugepages=0 00:04:49.376 15:51:12 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:49.376 15:51:12 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:49.376 15:51:12 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:49.376 15:51:12 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:49.376 15:51:12 -- setup/common.sh@18 -- # local node= 00:04:49.376 15:51:12 -- setup/common.sh@19 -- # local var val 00:04:49.376 15:51:12 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.376 15:51:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.376 15:51:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.376 15:51:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.376 15:51:12 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.376 15:51:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43335748 kB' 'MemAvailable: 47084948 kB' 'Buffers: 2708 kB' 'Cached: 12667952 kB' 'SwapCached: 0 kB' 'Active: 9368160 kB' 'Inactive: 3753000 kB' 'Active(anon): 8976804 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453708 kB' 'Mapped: 157100 kB' 'Shmem: 8526304 kB' 'KReclaimable: 197332 kB' 'Slab: 688864 kB' 'SReclaimable: 197332 kB' 'SUnreclaim: 491532 kB' 'KernelStack: 12768 kB' 'PageTables: 7616 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047412 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.376 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.376 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.377 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.377 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.377 15:51:12 -- setup/common.sh@33 -- # echo 1024 00:04:49.377 15:51:12 -- setup/common.sh@33 -- # return 0 00:04:49.377 15:51:12 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:49.377 15:51:12 -- setup/hugepages.sh@112 -- # get_nodes 00:04:49.377 15:51:12 -- setup/hugepages.sh@27 -- # local node 00:04:49.377 15:51:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.377 15:51:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:49.377 15:51:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.377 15:51:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:49.377 15:51:12 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:49.377 15:51:12 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:49.377 15:51:12 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:49.377 15:51:12 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:49.377 15:51:12 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:49.377 15:51:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.377 15:51:12 -- setup/common.sh@18 -- # local node=0 00:04:49.377 15:51:12 -- setup/common.sh@19 -- # local var val 00:04:49.377 15:51:12 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.377 15:51:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.378 15:51:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:49.378 15:51:12 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:49.378 15:51:12 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.378 15:51:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20175032 kB' 'MemUsed: 12699892 kB' 'SwapCached: 0 kB' 'Active: 6774920 kB' 'Inactive: 3590924 kB' 'Active(anon): 6584756 kB' 'Inactive(anon): 0 kB' 'Active(file): 190164 kB' 'Inactive(file): 3590924 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10041952 kB' 'Mapped: 65864 kB' 'AnonPages: 327060 kB' 'Shmem: 6260864 kB' 'KernelStack: 8200 kB' 'PageTables: 4948 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113292 kB' 'Slab: 411056 kB' 'SReclaimable: 113292 kB' 'SUnreclaim: 297764 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.378 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.378 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@33 -- # echo 0 00:04:49.379 15:51:12 -- setup/common.sh@33 -- # return 0 00:04:49.379 15:51:12 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:49.379 15:51:12 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:49.379 15:51:12 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:49.379 15:51:12 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:49.379 15:51:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.379 15:51:12 -- setup/common.sh@18 -- # local node=1 00:04:49.379 15:51:12 -- setup/common.sh@19 -- # local var val 00:04:49.379 15:51:12 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.379 15:51:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.379 15:51:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:49.379 15:51:12 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:49.379 15:51:12 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.379 15:51:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660740 kB' 'MemFree: 23160716 kB' 'MemUsed: 4500024 kB' 'SwapCached: 0 kB' 'Active: 2593984 kB' 'Inactive: 162076 kB' 'Active(anon): 2392792 kB' 'Inactive(anon): 0 kB' 'Active(file): 201192 kB' 'Inactive(file): 162076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2628708 kB' 'Mapped: 91236 kB' 'AnonPages: 127388 kB' 'Shmem: 2265440 kB' 'KernelStack: 4584 kB' 'PageTables: 2724 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84040 kB' 'Slab: 277808 kB' 'SReclaimable: 84040 kB' 'SUnreclaim: 193768 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.379 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.379 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.380 15:51:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.380 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.380 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.380 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.380 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.380 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.380 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.380 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.380 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.380 15:51:12 -- setup/common.sh@32 -- # continue 00:04:49.380 15:51:12 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.380 15:51:12 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.380 15:51:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.380 15:51:12 -- setup/common.sh@33 -- # echo 0 00:04:49.380 15:51:12 -- setup/common.sh@33 -- # return 0 00:04:49.380 15:51:12 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:49.380 15:51:12 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:49.380 15:51:12 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:49.380 15:51:12 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:49.380 15:51:12 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:49.380 node0=512 expecting 512 00:04:49.380 15:51:12 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:49.380 15:51:12 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:49.380 15:51:12 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:49.380 15:51:12 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:49.380 node1=512 expecting 512 00:04:49.380 15:51:12 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:49.380 00:04:49.380 real 0m1.358s 00:04:49.380 user 0m0.543s 00:04:49.380 sys 0m0.778s 00:04:49.380 15:51:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.380 15:51:12 -- common/autotest_common.sh@10 -- # set +x 00:04:49.380 ************************************ 00:04:49.380 END TEST per_node_1G_alloc 00:04:49.380 ************************************ 00:04:49.380 15:51:12 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:49.380 15:51:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:49.380 15:51:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.380 15:51:12 -- common/autotest_common.sh@10 -- # set +x 00:04:49.380 ************************************ 00:04:49.380 START TEST even_2G_alloc 00:04:49.380 ************************************ 00:04:49.380 15:51:12 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:49.380 15:51:12 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:49.380 15:51:12 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:49.380 15:51:12 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:49.380 15:51:12 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:49.380 15:51:12 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:49.380 15:51:12 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:49.380 15:51:12 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:49.380 15:51:12 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:49.380 15:51:12 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:49.380 15:51:12 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:49.380 15:51:12 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:49.380 15:51:12 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:49.380 15:51:12 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:49.380 15:51:12 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:49.380 15:51:12 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:49.380 15:51:12 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:49.380 15:51:12 -- setup/hugepages.sh@83 -- # : 512 00:04:49.380 15:51:12 -- setup/hugepages.sh@84 -- # : 1 00:04:49.380 15:51:12 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:49.380 15:51:12 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:49.380 15:51:12 -- setup/hugepages.sh@83 -- # : 0 00:04:49.380 15:51:12 -- setup/hugepages.sh@84 -- # : 0 00:04:49.380 15:51:12 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:49.380 15:51:12 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:49.380 15:51:12 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:49.380 15:51:12 -- setup/hugepages.sh@153 -- # setup output 00:04:49.380 15:51:12 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:49.380 15:51:12 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:50.758 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.758 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:50.758 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.758 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.758 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.758 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.758 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.758 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.758 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.758 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.758 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.758 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.758 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.758 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.758 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.758 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.758 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.758 15:51:14 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:50.758 15:51:14 -- setup/hugepages.sh@89 -- # local node 00:04:50.758 15:51:14 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:50.758 15:51:14 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:50.758 15:51:14 -- setup/hugepages.sh@92 -- # local surp 00:04:50.758 15:51:14 -- setup/hugepages.sh@93 -- # local resv 00:04:50.758 15:51:14 -- setup/hugepages.sh@94 -- # local anon 00:04:50.758 15:51:14 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:50.758 15:51:14 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:50.758 15:51:14 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:50.758 15:51:14 -- setup/common.sh@18 -- # local node= 00:04:50.758 15:51:14 -- setup/common.sh@19 -- # local var val 00:04:50.758 15:51:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.758 15:51:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.758 15:51:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.758 15:51:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.758 15:51:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.758 15:51:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.758 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.758 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.758 15:51:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43347272 kB' 'MemAvailable: 47096472 kB' 'Buffers: 2708 kB' 'Cached: 12668012 kB' 'SwapCached: 0 kB' 'Active: 9369080 kB' 'Inactive: 3753000 kB' 'Active(anon): 8977724 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454608 kB' 'Mapped: 157112 kB' 'Shmem: 8526364 kB' 'KReclaimable: 197332 kB' 'Slab: 688952 kB' 'SReclaimable: 197332 kB' 'SUnreclaim: 491620 kB' 'KernelStack: 12800 kB' 'PageTables: 7732 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047768 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:50.758 15:51:14 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.758 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.758 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.758 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.758 15:51:14 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.758 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.758 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.758 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.758 15:51:14 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.758 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.758 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.758 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.758 15:51:14 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.759 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.759 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.760 15:51:14 -- setup/common.sh@33 -- # echo 0 00:04:50.760 15:51:14 -- setup/common.sh@33 -- # return 0 00:04:50.760 15:51:14 -- setup/hugepages.sh@97 -- # anon=0 00:04:50.760 15:51:14 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:50.760 15:51:14 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.760 15:51:14 -- setup/common.sh@18 -- # local node= 00:04:50.760 15:51:14 -- setup/common.sh@19 -- # local var val 00:04:50.760 15:51:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.760 15:51:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.760 15:51:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.760 15:51:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.760 15:51:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.760 15:51:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43351232 kB' 'MemAvailable: 47100432 kB' 'Buffers: 2708 kB' 'Cached: 12668016 kB' 'SwapCached: 0 kB' 'Active: 9369180 kB' 'Inactive: 3753000 kB' 'Active(anon): 8977824 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454676 kB' 'Mapped: 157112 kB' 'Shmem: 8526368 kB' 'KReclaimable: 197332 kB' 'Slab: 688900 kB' 'SReclaimable: 197332 kB' 'SUnreclaim: 491568 kB' 'KernelStack: 12752 kB' 'PageTables: 7572 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047780 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.760 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.760 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.761 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.761 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.762 15:51:14 -- setup/common.sh@33 -- # echo 0 00:04:50.762 15:51:14 -- setup/common.sh@33 -- # return 0 00:04:50.762 15:51:14 -- setup/hugepages.sh@99 -- # surp=0 00:04:50.762 15:51:14 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:50.762 15:51:14 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:50.762 15:51:14 -- setup/common.sh@18 -- # local node= 00:04:50.762 15:51:14 -- setup/common.sh@19 -- # local var val 00:04:50.762 15:51:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.762 15:51:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.762 15:51:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.762 15:51:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.762 15:51:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.762 15:51:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43350980 kB' 'MemAvailable: 47100180 kB' 'Buffers: 2708 kB' 'Cached: 12668028 kB' 'SwapCached: 0 kB' 'Active: 9368696 kB' 'Inactive: 3753000 kB' 'Active(anon): 8977340 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454160 kB' 'Mapped: 157088 kB' 'Shmem: 8526380 kB' 'KReclaimable: 197332 kB' 'Slab: 689024 kB' 'SReclaimable: 197332 kB' 'SUnreclaim: 491692 kB' 'KernelStack: 12800 kB' 'PageTables: 7724 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047796 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.762 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.762 15:51:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.763 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.763 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.764 15:51:14 -- setup/common.sh@33 -- # echo 0 00:04:50.764 15:51:14 -- setup/common.sh@33 -- # return 0 00:04:50.764 15:51:14 -- setup/hugepages.sh@100 -- # resv=0 00:04:50.764 15:51:14 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:50.764 nr_hugepages=1024 00:04:50.764 15:51:14 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:50.764 resv_hugepages=0 00:04:50.764 15:51:14 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:50.764 surplus_hugepages=0 00:04:50.764 15:51:14 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:50.764 anon_hugepages=0 00:04:50.764 15:51:14 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:50.764 15:51:14 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:50.764 15:51:14 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:50.764 15:51:14 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:50.764 15:51:14 -- setup/common.sh@18 -- # local node= 00:04:50.764 15:51:14 -- setup/common.sh@19 -- # local var val 00:04:50.764 15:51:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.764 15:51:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.764 15:51:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.764 15:51:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.764 15:51:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.764 15:51:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.764 15:51:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43351516 kB' 'MemAvailable: 47100716 kB' 'Buffers: 2708 kB' 'Cached: 12668028 kB' 'SwapCached: 0 kB' 'Active: 9368360 kB' 'Inactive: 3753000 kB' 'Active(anon): 8977004 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453824 kB' 'Mapped: 157088 kB' 'Shmem: 8526380 kB' 'KReclaimable: 197332 kB' 'Slab: 689024 kB' 'SReclaimable: 197332 kB' 'SUnreclaim: 491692 kB' 'KernelStack: 12784 kB' 'PageTables: 7672 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10047812 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.764 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.764 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.765 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.765 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.766 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.766 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.766 15:51:14 -- setup/common.sh@33 -- # echo 1024 00:04:50.766 15:51:14 -- setup/common.sh@33 -- # return 0 00:04:50.767 15:51:14 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:50.767 15:51:14 -- setup/hugepages.sh@112 -- # get_nodes 00:04:50.767 15:51:14 -- setup/hugepages.sh@27 -- # local node 00:04:50.767 15:51:14 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.767 15:51:14 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:50.767 15:51:14 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.767 15:51:14 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:50.767 15:51:14 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:50.767 15:51:14 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:50.767 15:51:14 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:50.767 15:51:14 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:50.767 15:51:14 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:50.767 15:51:14 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.767 15:51:14 -- setup/common.sh@18 -- # local node=0 00:04:50.767 15:51:14 -- setup/common.sh@19 -- # local var val 00:04:50.767 15:51:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.767 15:51:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.767 15:51:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:50.767 15:51:14 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:50.767 15:51:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.767 15:51:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20177532 kB' 'MemUsed: 12697392 kB' 'SwapCached: 0 kB' 'Active: 6774404 kB' 'Inactive: 3590924 kB' 'Active(anon): 6584240 kB' 'Inactive(anon): 0 kB' 'Active(file): 190164 kB' 'Inactive(file): 3590924 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10042056 kB' 'Mapped: 65872 kB' 'AnonPages: 326504 kB' 'Shmem: 6260968 kB' 'KernelStack: 8184 kB' 'PageTables: 4900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113292 kB' 'Slab: 411116 kB' 'SReclaimable: 113292 kB' 'SUnreclaim: 297824 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.767 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.767 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@33 -- # echo 0 00:04:50.768 15:51:14 -- setup/common.sh@33 -- # return 0 00:04:50.768 15:51:14 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:50.768 15:51:14 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:50.768 15:51:14 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:50.768 15:51:14 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:50.768 15:51:14 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.768 15:51:14 -- setup/common.sh@18 -- # local node=1 00:04:50.768 15:51:14 -- setup/common.sh@19 -- # local var val 00:04:50.768 15:51:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.768 15:51:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.768 15:51:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:50.768 15:51:14 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:50.768 15:51:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.768 15:51:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660740 kB' 'MemFree: 23172976 kB' 'MemUsed: 4487764 kB' 'SwapCached: 0 kB' 'Active: 2594160 kB' 'Inactive: 162076 kB' 'Active(anon): 2392968 kB' 'Inactive(anon): 0 kB' 'Active(file): 201192 kB' 'Inactive(file): 162076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2628712 kB' 'Mapped: 91216 kB' 'AnonPages: 127540 kB' 'Shmem: 2265444 kB' 'KernelStack: 4552 kB' 'PageTables: 2616 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84040 kB' 'Slab: 277908 kB' 'SReclaimable: 84040 kB' 'SUnreclaim: 193868 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.768 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.768 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.769 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.769 15:51:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.770 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.770 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.770 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.770 15:51:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.770 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.770 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.770 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.770 15:51:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.770 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.770 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.770 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.770 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.770 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.770 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.770 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.770 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.770 15:51:14 -- setup/common.sh@32 -- # continue 00:04:50.770 15:51:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.770 15:51:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.770 15:51:14 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.770 15:51:14 -- setup/common.sh@33 -- # echo 0 00:04:50.770 15:51:14 -- setup/common.sh@33 -- # return 0 00:04:50.770 15:51:14 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:50.770 15:51:14 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:50.770 15:51:14 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:50.770 15:51:14 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:50.770 15:51:14 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:50.770 node0=512 expecting 512 00:04:50.770 15:51:14 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:50.770 15:51:14 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:50.770 15:51:14 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:50.770 15:51:14 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:50.770 node1=512 expecting 512 00:04:50.770 15:51:14 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:50.770 00:04:50.770 real 0m1.364s 00:04:50.770 user 0m0.588s 00:04:50.770 sys 0m0.741s 00:04:50.770 15:51:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.770 15:51:14 -- common/autotest_common.sh@10 -- # set +x 00:04:50.770 ************************************ 00:04:50.770 END TEST even_2G_alloc 00:04:50.770 ************************************ 00:04:50.770 15:51:14 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:50.770 15:51:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.770 15:51:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.770 15:51:14 -- common/autotest_common.sh@10 -- # set +x 00:04:50.770 ************************************ 00:04:50.770 START TEST odd_alloc 00:04:50.770 ************************************ 00:04:50.770 15:51:14 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:50.770 15:51:14 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:50.770 15:51:14 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:50.770 15:51:14 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:50.770 15:51:14 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:50.770 15:51:14 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:50.770 15:51:14 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:50.770 15:51:14 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:50.770 15:51:14 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:50.770 15:51:14 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:50.770 15:51:14 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:50.770 15:51:14 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:50.770 15:51:14 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:50.770 15:51:14 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:50.770 15:51:14 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:50.770 15:51:14 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:50.770 15:51:14 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:50.770 15:51:14 -- setup/hugepages.sh@83 -- # : 513 00:04:50.770 15:51:14 -- setup/hugepages.sh@84 -- # : 1 00:04:50.770 15:51:14 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:50.770 15:51:14 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:50.770 15:51:14 -- setup/hugepages.sh@83 -- # : 0 00:04:50.770 15:51:14 -- setup/hugepages.sh@84 -- # : 0 00:04:50.770 15:51:14 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:50.770 15:51:14 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:50.770 15:51:14 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:50.770 15:51:14 -- setup/hugepages.sh@160 -- # setup output 00:04:50.770 15:51:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:50.770 15:51:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:52.148 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:52.148 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:52.148 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:52.148 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:52.148 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:52.148 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:52.148 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:52.148 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:52.148 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:52.148 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:52.148 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:52.148 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:52.148 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:52.148 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:52.148 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:52.148 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:52.148 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:52.148 15:51:15 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:52.148 15:51:15 -- setup/hugepages.sh@89 -- # local node 00:04:52.148 15:51:15 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:52.148 15:51:15 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:52.148 15:51:15 -- setup/hugepages.sh@92 -- # local surp 00:04:52.148 15:51:15 -- setup/hugepages.sh@93 -- # local resv 00:04:52.148 15:51:15 -- setup/hugepages.sh@94 -- # local anon 00:04:52.148 15:51:15 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:52.148 15:51:15 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:52.148 15:51:15 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:52.148 15:51:15 -- setup/common.sh@18 -- # local node= 00:04:52.148 15:51:15 -- setup/common.sh@19 -- # local var val 00:04:52.148 15:51:15 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.148 15:51:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.148 15:51:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.148 15:51:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.148 15:51:15 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.148 15:51:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.148 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.148 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43349568 kB' 'MemAvailable: 47098764 kB' 'Buffers: 2708 kB' 'Cached: 12668108 kB' 'SwapCached: 0 kB' 'Active: 9367160 kB' 'Inactive: 3753000 kB' 'Active(anon): 8975804 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452604 kB' 'Mapped: 156028 kB' 'Shmem: 8526460 kB' 'KReclaimable: 197324 kB' 'Slab: 689096 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491772 kB' 'KernelStack: 12736 kB' 'PageTables: 7388 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10035456 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.149 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.149 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.150 15:51:15 -- setup/common.sh@33 -- # echo 0 00:04:52.150 15:51:15 -- setup/common.sh@33 -- # return 0 00:04:52.150 15:51:15 -- setup/hugepages.sh@97 -- # anon=0 00:04:52.150 15:51:15 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:52.150 15:51:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:52.150 15:51:15 -- setup/common.sh@18 -- # local node= 00:04:52.150 15:51:15 -- setup/common.sh@19 -- # local var val 00:04:52.150 15:51:15 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.150 15:51:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.150 15:51:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.150 15:51:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.150 15:51:15 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.150 15:51:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43361288 kB' 'MemAvailable: 47110484 kB' 'Buffers: 2708 kB' 'Cached: 12668112 kB' 'SwapCached: 0 kB' 'Active: 9367100 kB' 'Inactive: 3753000 kB' 'Active(anon): 8975744 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452512 kB' 'Mapped: 156032 kB' 'Shmem: 8526464 kB' 'KReclaimable: 197324 kB' 'Slab: 689092 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491768 kB' 'KernelStack: 12672 kB' 'PageTables: 7168 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10035464 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.150 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.150 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.151 15:51:15 -- setup/common.sh@33 -- # echo 0 00:04:52.151 15:51:15 -- setup/common.sh@33 -- # return 0 00:04:52.151 15:51:15 -- setup/hugepages.sh@99 -- # surp=0 00:04:52.151 15:51:15 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:52.151 15:51:15 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:52.151 15:51:15 -- setup/common.sh@18 -- # local node= 00:04:52.151 15:51:15 -- setup/common.sh@19 -- # local var val 00:04:52.151 15:51:15 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.151 15:51:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.151 15:51:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.151 15:51:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.151 15:51:15 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.151 15:51:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43361336 kB' 'MemAvailable: 47110532 kB' 'Buffers: 2708 kB' 'Cached: 12668116 kB' 'SwapCached: 0 kB' 'Active: 9367288 kB' 'Inactive: 3753000 kB' 'Active(anon): 8975932 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452752 kB' 'Mapped: 156032 kB' 'Shmem: 8526468 kB' 'KReclaimable: 197324 kB' 'Slab: 689108 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491784 kB' 'KernelStack: 12688 kB' 'PageTables: 7244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10035480 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.151 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.151 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.152 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.152 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.153 15:51:15 -- setup/common.sh@33 -- # echo 0 00:04:52.153 15:51:15 -- setup/common.sh@33 -- # return 0 00:04:52.153 15:51:15 -- setup/hugepages.sh@100 -- # resv=0 00:04:52.153 15:51:15 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:52.153 nr_hugepages=1025 00:04:52.153 15:51:15 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:52.153 resv_hugepages=0 00:04:52.153 15:51:15 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:52.153 surplus_hugepages=0 00:04:52.153 15:51:15 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:52.153 anon_hugepages=0 00:04:52.153 15:51:15 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:52.153 15:51:15 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:52.153 15:51:15 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:52.153 15:51:15 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:52.153 15:51:15 -- setup/common.sh@18 -- # local node= 00:04:52.153 15:51:15 -- setup/common.sh@19 -- # local var val 00:04:52.153 15:51:15 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.153 15:51:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.153 15:51:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.153 15:51:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.153 15:51:15 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.153 15:51:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43361308 kB' 'MemAvailable: 47110504 kB' 'Buffers: 2708 kB' 'Cached: 12668128 kB' 'SwapCached: 0 kB' 'Active: 9366340 kB' 'Inactive: 3753000 kB' 'Active(anon): 8974984 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451752 kB' 'Mapped: 156008 kB' 'Shmem: 8526480 kB' 'KReclaimable: 197324 kB' 'Slab: 689180 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491856 kB' 'KernelStack: 12736 kB' 'PageTables: 7392 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 10035496 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.153 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.153 15:51:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.154 15:51:15 -- setup/common.sh@33 -- # echo 1025 00:04:52.154 15:51:15 -- setup/common.sh@33 -- # return 0 00:04:52.154 15:51:15 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:52.154 15:51:15 -- setup/hugepages.sh@112 -- # get_nodes 00:04:52.154 15:51:15 -- setup/hugepages.sh@27 -- # local node 00:04:52.154 15:51:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:52.154 15:51:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:52.154 15:51:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:52.154 15:51:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:52.154 15:51:15 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:52.154 15:51:15 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:52.154 15:51:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:52.154 15:51:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:52.154 15:51:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:52.154 15:51:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:52.154 15:51:15 -- setup/common.sh@18 -- # local node=0 00:04:52.154 15:51:15 -- setup/common.sh@19 -- # local var val 00:04:52.154 15:51:15 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.154 15:51:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.154 15:51:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:52.154 15:51:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:52.154 15:51:15 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.154 15:51:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20186904 kB' 'MemUsed: 12688020 kB' 'SwapCached: 0 kB' 'Active: 6773272 kB' 'Inactive: 3590924 kB' 'Active(anon): 6583108 kB' 'Inactive(anon): 0 kB' 'Active(file): 190164 kB' 'Inactive(file): 3590924 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10042144 kB' 'Mapped: 65572 kB' 'AnonPages: 325220 kB' 'Shmem: 6261056 kB' 'KernelStack: 8168 kB' 'PageTables: 4756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113284 kB' 'Slab: 411080 kB' 'SReclaimable: 113284 kB' 'SUnreclaim: 297796 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.154 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.154 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@33 -- # echo 0 00:04:52.155 15:51:15 -- setup/common.sh@33 -- # return 0 00:04:52.155 15:51:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:52.155 15:51:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:52.155 15:51:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:52.155 15:51:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:52.155 15:51:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:52.155 15:51:15 -- setup/common.sh@18 -- # local node=1 00:04:52.155 15:51:15 -- setup/common.sh@19 -- # local var val 00:04:52.155 15:51:15 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.155 15:51:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.155 15:51:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:52.155 15:51:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:52.155 15:51:15 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.155 15:51:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660740 kB' 'MemFree: 23172640 kB' 'MemUsed: 4488100 kB' 'SwapCached: 0 kB' 'Active: 2593444 kB' 'Inactive: 162076 kB' 'Active(anon): 2392252 kB' 'Inactive(anon): 0 kB' 'Active(file): 201192 kB' 'Inactive(file): 162076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2628716 kB' 'Mapped: 90436 kB' 'AnonPages: 126852 kB' 'Shmem: 2265448 kB' 'KernelStack: 4568 kB' 'PageTables: 2636 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84040 kB' 'Slab: 278076 kB' 'SReclaimable: 84040 kB' 'SUnreclaim: 194036 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.155 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.155 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # continue 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.156 15:51:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.156 15:51:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.156 15:51:15 -- setup/common.sh@33 -- # echo 0 00:04:52.156 15:51:15 -- setup/common.sh@33 -- # return 0 00:04:52.156 15:51:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:52.156 15:51:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:52.156 15:51:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:52.156 15:51:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:52.156 15:51:15 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:52.156 node0=512 expecting 513 00:04:52.156 15:51:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:52.156 15:51:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:52.156 15:51:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:52.156 15:51:15 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:52.156 node1=513 expecting 512 00:04:52.156 15:51:15 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:52.156 00:04:52.156 real 0m1.395s 00:04:52.156 user 0m0.593s 00:04:52.156 sys 0m0.766s 00:04:52.156 15:51:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:52.156 15:51:15 -- common/autotest_common.sh@10 -- # set +x 00:04:52.156 ************************************ 00:04:52.156 END TEST odd_alloc 00:04:52.156 ************************************ 00:04:52.156 15:51:15 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:52.156 15:51:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:52.156 15:51:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:52.157 15:51:15 -- common/autotest_common.sh@10 -- # set +x 00:04:52.157 ************************************ 00:04:52.157 START TEST custom_alloc 00:04:52.157 ************************************ 00:04:52.157 15:51:15 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:52.157 15:51:15 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:52.157 15:51:15 -- setup/hugepages.sh@169 -- # local node 00:04:52.157 15:51:15 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:52.157 15:51:15 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:52.157 15:51:15 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:52.157 15:51:15 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:52.157 15:51:15 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:52.157 15:51:15 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:52.157 15:51:15 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:52.157 15:51:15 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:52.157 15:51:15 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:52.157 15:51:15 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:52.157 15:51:15 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:52.157 15:51:15 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:52.157 15:51:15 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:52.157 15:51:15 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:52.157 15:51:15 -- setup/hugepages.sh@83 -- # : 256 00:04:52.157 15:51:15 -- setup/hugepages.sh@84 -- # : 1 00:04:52.157 15:51:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:52.157 15:51:15 -- setup/hugepages.sh@83 -- # : 0 00:04:52.157 15:51:15 -- setup/hugepages.sh@84 -- # : 0 00:04:52.157 15:51:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:52.157 15:51:15 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:52.157 15:51:15 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:52.157 15:51:15 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:52.157 15:51:15 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:52.157 15:51:15 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:52.157 15:51:15 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:52.157 15:51:15 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:52.157 15:51:15 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:52.157 15:51:15 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:52.157 15:51:15 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:52.157 15:51:15 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:52.157 15:51:15 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:52.157 15:51:15 -- setup/hugepages.sh@78 -- # return 0 00:04:52.157 15:51:15 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:52.157 15:51:15 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:52.157 15:51:15 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:52.157 15:51:15 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:52.157 15:51:15 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:52.157 15:51:15 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:52.157 15:51:15 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:52.157 15:51:15 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:52.157 15:51:15 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:52.157 15:51:15 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:52.157 15:51:15 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:52.157 15:51:15 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:52.157 15:51:15 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:52.157 15:51:15 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:52.157 15:51:15 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:52.157 15:51:15 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:52.157 15:51:15 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:52.157 15:51:15 -- setup/hugepages.sh@78 -- # return 0 00:04:52.157 15:51:15 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:52.157 15:51:15 -- setup/hugepages.sh@187 -- # setup output 00:04:52.157 15:51:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:52.157 15:51:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:53.532 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:53.532 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:53.532 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:53.532 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:53.532 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:53.532 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:53.532 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:53.532 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:53.532 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:53.532 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:53.532 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:53.532 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:53.532 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:53.532 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:53.532 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:53.532 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:53.532 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:53.532 15:51:17 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:53.532 15:51:17 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:53.532 15:51:17 -- setup/hugepages.sh@89 -- # local node 00:04:53.532 15:51:17 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:53.532 15:51:17 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:53.532 15:51:17 -- setup/hugepages.sh@92 -- # local surp 00:04:53.532 15:51:17 -- setup/hugepages.sh@93 -- # local resv 00:04:53.532 15:51:17 -- setup/hugepages.sh@94 -- # local anon 00:04:53.532 15:51:17 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:53.532 15:51:17 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:53.532 15:51:17 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:53.532 15:51:17 -- setup/common.sh@18 -- # local node= 00:04:53.532 15:51:17 -- setup/common.sh@19 -- # local var val 00:04:53.532 15:51:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.532 15:51:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.532 15:51:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.532 15:51:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.532 15:51:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.532 15:51:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42291420 kB' 'MemAvailable: 46040616 kB' 'Buffers: 2708 kB' 'Cached: 12668204 kB' 'SwapCached: 0 kB' 'Active: 9366724 kB' 'Inactive: 3753000 kB' 'Active(anon): 8975368 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452092 kB' 'Mapped: 156056 kB' 'Shmem: 8526556 kB' 'KReclaimable: 197324 kB' 'Slab: 689004 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491680 kB' 'KernelStack: 12736 kB' 'PageTables: 7372 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10035676 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.532 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.532 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.533 15:51:17 -- setup/common.sh@33 -- # echo 0 00:04:53.533 15:51:17 -- setup/common.sh@33 -- # return 0 00:04:53.533 15:51:17 -- setup/hugepages.sh@97 -- # anon=0 00:04:53.533 15:51:17 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:53.533 15:51:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:53.533 15:51:17 -- setup/common.sh@18 -- # local node= 00:04:53.533 15:51:17 -- setup/common.sh@19 -- # local var val 00:04:53.533 15:51:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.533 15:51:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.533 15:51:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.533 15:51:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.533 15:51:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.533 15:51:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42291472 kB' 'MemAvailable: 46040668 kB' 'Buffers: 2708 kB' 'Cached: 12668208 kB' 'SwapCached: 0 kB' 'Active: 9366788 kB' 'Inactive: 3753000 kB' 'Active(anon): 8975432 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452132 kB' 'Mapped: 156056 kB' 'Shmem: 8526560 kB' 'KReclaimable: 197324 kB' 'Slab: 689004 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491680 kB' 'KernelStack: 12704 kB' 'PageTables: 7240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10035688 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.533 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.533 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.534 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.534 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.535 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.535 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.535 15:51:17 -- setup/common.sh@33 -- # echo 0 00:04:53.535 15:51:17 -- setup/common.sh@33 -- # return 0 00:04:53.535 15:51:17 -- setup/hugepages.sh@99 -- # surp=0 00:04:53.535 15:51:17 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:53.535 15:51:17 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:53.535 15:51:17 -- setup/common.sh@18 -- # local node= 00:04:53.535 15:51:17 -- setup/common.sh@19 -- # local var val 00:04:53.535 15:51:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.535 15:51:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.535 15:51:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.535 15:51:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.535 15:51:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.535 15:51:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.796 15:51:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42295052 kB' 'MemAvailable: 46044248 kB' 'Buffers: 2708 kB' 'Cached: 12668220 kB' 'SwapCached: 0 kB' 'Active: 9366780 kB' 'Inactive: 3753000 kB' 'Active(anon): 8975424 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452108 kB' 'Mapped: 156016 kB' 'Shmem: 8526572 kB' 'KReclaimable: 197324 kB' 'Slab: 689044 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491720 kB' 'KernelStack: 12736 kB' 'PageTables: 7348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10035704 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.796 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.796 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.797 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.797 15:51:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.798 15:51:17 -- setup/common.sh@33 -- # echo 0 00:04:53.798 15:51:17 -- setup/common.sh@33 -- # return 0 00:04:53.798 15:51:17 -- setup/hugepages.sh@100 -- # resv=0 00:04:53.798 15:51:17 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:53.798 nr_hugepages=1536 00:04:53.798 15:51:17 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:53.798 resv_hugepages=0 00:04:53.798 15:51:17 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:53.798 surplus_hugepages=0 00:04:53.798 15:51:17 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:53.798 anon_hugepages=0 00:04:53.798 15:51:17 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:53.798 15:51:17 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:53.798 15:51:17 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:53.798 15:51:17 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:53.798 15:51:17 -- setup/common.sh@18 -- # local node= 00:04:53.798 15:51:17 -- setup/common.sh@19 -- # local var val 00:04:53.798 15:51:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.798 15:51:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.798 15:51:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.798 15:51:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.798 15:51:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.798 15:51:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42295052 kB' 'MemAvailable: 46044248 kB' 'Buffers: 2708 kB' 'Cached: 12668232 kB' 'SwapCached: 0 kB' 'Active: 9366800 kB' 'Inactive: 3753000 kB' 'Active(anon): 8975444 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452156 kB' 'Mapped: 156016 kB' 'Shmem: 8526584 kB' 'KReclaimable: 197324 kB' 'Slab: 689044 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491720 kB' 'KernelStack: 12752 kB' 'PageTables: 7400 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 10035720 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.798 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.798 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.799 15:51:17 -- setup/common.sh@33 -- # echo 1536 00:04:53.799 15:51:17 -- setup/common.sh@33 -- # return 0 00:04:53.799 15:51:17 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:53.799 15:51:17 -- setup/hugepages.sh@112 -- # get_nodes 00:04:53.799 15:51:17 -- setup/hugepages.sh@27 -- # local node 00:04:53.799 15:51:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:53.799 15:51:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:53.799 15:51:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:53.799 15:51:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:53.799 15:51:17 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:53.799 15:51:17 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:53.799 15:51:17 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:53.799 15:51:17 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:53.799 15:51:17 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:53.799 15:51:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:53.799 15:51:17 -- setup/common.sh@18 -- # local node=0 00:04:53.799 15:51:17 -- setup/common.sh@19 -- # local var val 00:04:53.799 15:51:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.799 15:51:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.799 15:51:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:53.799 15:51:17 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:53.799 15:51:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.799 15:51:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20170792 kB' 'MemUsed: 12704132 kB' 'SwapCached: 0 kB' 'Active: 6772988 kB' 'Inactive: 3590924 kB' 'Active(anon): 6582824 kB' 'Inactive(anon): 0 kB' 'Active(file): 190164 kB' 'Inactive(file): 3590924 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10042188 kB' 'Mapped: 65580 kB' 'AnonPages: 324912 kB' 'Shmem: 6261100 kB' 'KernelStack: 8184 kB' 'PageTables: 4708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113284 kB' 'Slab: 410892 kB' 'SReclaimable: 113284 kB' 'SUnreclaim: 297608 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.799 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.799 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@33 -- # echo 0 00:04:53.800 15:51:17 -- setup/common.sh@33 -- # return 0 00:04:53.800 15:51:17 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:53.800 15:51:17 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:53.800 15:51:17 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:53.800 15:51:17 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:53.800 15:51:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:53.800 15:51:17 -- setup/common.sh@18 -- # local node=1 00:04:53.800 15:51:17 -- setup/common.sh@19 -- # local var val 00:04:53.800 15:51:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.800 15:51:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.800 15:51:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:53.800 15:51:17 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:53.800 15:51:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.800 15:51:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660740 kB' 'MemFree: 22124444 kB' 'MemUsed: 5536296 kB' 'SwapCached: 0 kB' 'Active: 2594148 kB' 'Inactive: 162076 kB' 'Active(anon): 2392956 kB' 'Inactive(anon): 0 kB' 'Active(file): 201192 kB' 'Inactive(file): 162076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2628780 kB' 'Mapped: 90436 kB' 'AnonPages: 127512 kB' 'Shmem: 2265512 kB' 'KernelStack: 4568 kB' 'PageTables: 2692 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84040 kB' 'Slab: 278152 kB' 'SReclaimable: 84040 kB' 'SUnreclaim: 194112 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.800 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.800 15:51:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.801 15:51:17 -- setup/common.sh@32 -- # continue 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.801 15:51:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.802 15:51:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.802 15:51:17 -- setup/common.sh@33 -- # echo 0 00:04:53.802 15:51:17 -- setup/common.sh@33 -- # return 0 00:04:53.802 15:51:17 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:53.802 15:51:17 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:53.802 15:51:17 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:53.802 15:51:17 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:53.802 15:51:17 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:53.802 node0=512 expecting 512 00:04:53.802 15:51:17 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:53.802 15:51:17 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:53.802 15:51:17 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:53.802 15:51:17 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:53.802 node1=1024 expecting 1024 00:04:53.802 15:51:17 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:53.802 00:04:53.802 real 0m1.523s 00:04:53.802 user 0m0.602s 00:04:53.802 sys 0m0.886s 00:04:53.802 15:51:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:53.802 15:51:17 -- common/autotest_common.sh@10 -- # set +x 00:04:53.802 ************************************ 00:04:53.802 END TEST custom_alloc 00:04:53.802 ************************************ 00:04:53.802 15:51:17 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:53.802 15:51:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:53.802 15:51:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.802 15:51:17 -- common/autotest_common.sh@10 -- # set +x 00:04:53.802 ************************************ 00:04:53.802 START TEST no_shrink_alloc 00:04:53.802 ************************************ 00:04:53.802 15:51:17 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:53.802 15:51:17 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:53.802 15:51:17 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:53.802 15:51:17 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:53.802 15:51:17 -- setup/hugepages.sh@51 -- # shift 00:04:53.802 15:51:17 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:53.802 15:51:17 -- setup/hugepages.sh@52 -- # local node_ids 00:04:53.802 15:51:17 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:53.802 15:51:17 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:53.802 15:51:17 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:53.802 15:51:17 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:53.802 15:51:17 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:53.802 15:51:17 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:53.802 15:51:17 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:53.802 15:51:17 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:53.802 15:51:17 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:53.802 15:51:17 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:53.802 15:51:17 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:53.802 15:51:17 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:53.802 15:51:17 -- setup/hugepages.sh@73 -- # return 0 00:04:53.802 15:51:17 -- setup/hugepages.sh@198 -- # setup output 00:04:53.802 15:51:17 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:53.802 15:51:17 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:55.238 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:55.238 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:55.238 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:55.239 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:55.239 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:55.239 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:55.239 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:55.239 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:55.239 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:55.239 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:55.239 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:55.239 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:55.239 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:55.239 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:55.239 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:55.239 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:55.239 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:55.239 15:51:18 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:55.239 15:51:18 -- setup/hugepages.sh@89 -- # local node 00:04:55.239 15:51:18 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:55.239 15:51:18 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:55.239 15:51:18 -- setup/hugepages.sh@92 -- # local surp 00:04:55.239 15:51:18 -- setup/hugepages.sh@93 -- # local resv 00:04:55.239 15:51:18 -- setup/hugepages.sh@94 -- # local anon 00:04:55.239 15:51:18 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:55.239 15:51:18 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:55.239 15:51:18 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:55.239 15:51:18 -- setup/common.sh@18 -- # local node= 00:04:55.239 15:51:18 -- setup/common.sh@19 -- # local var val 00:04:55.239 15:51:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.239 15:51:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.239 15:51:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.239 15:51:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.239 15:51:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.239 15:51:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43293752 kB' 'MemAvailable: 47042948 kB' 'Buffers: 2708 kB' 'Cached: 12668300 kB' 'SwapCached: 0 kB' 'Active: 9366552 kB' 'Inactive: 3753000 kB' 'Active(anon): 8975196 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451720 kB' 'Mapped: 156060 kB' 'Shmem: 8526652 kB' 'KReclaimable: 197324 kB' 'Slab: 688824 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491500 kB' 'KernelStack: 12752 kB' 'PageTables: 7352 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10035540 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.239 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.239 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.240 15:51:18 -- setup/common.sh@33 -- # echo 0 00:04:55.240 15:51:18 -- setup/common.sh@33 -- # return 0 00:04:55.240 15:51:18 -- setup/hugepages.sh@97 -- # anon=0 00:04:55.240 15:51:18 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:55.240 15:51:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:55.240 15:51:18 -- setup/common.sh@18 -- # local node= 00:04:55.240 15:51:18 -- setup/common.sh@19 -- # local var val 00:04:55.240 15:51:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.240 15:51:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.240 15:51:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.240 15:51:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.240 15:51:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.240 15:51:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43302136 kB' 'MemAvailable: 47051332 kB' 'Buffers: 2708 kB' 'Cached: 12668304 kB' 'SwapCached: 0 kB' 'Active: 9367428 kB' 'Inactive: 3753000 kB' 'Active(anon): 8976072 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452656 kB' 'Mapped: 156136 kB' 'Shmem: 8526656 kB' 'KReclaimable: 197324 kB' 'Slab: 688832 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491508 kB' 'KernelStack: 12784 kB' 'PageTables: 7468 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10035916 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.240 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.240 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.241 15:51:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.241 15:51:18 -- setup/common.sh@33 -- # echo 0 00:04:55.241 15:51:18 -- setup/common.sh@33 -- # return 0 00:04:55.241 15:51:18 -- setup/hugepages.sh@99 -- # surp=0 00:04:55.241 15:51:18 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:55.241 15:51:18 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:55.241 15:51:18 -- setup/common.sh@18 -- # local node= 00:04:55.241 15:51:18 -- setup/common.sh@19 -- # local var val 00:04:55.241 15:51:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.241 15:51:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.241 15:51:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.241 15:51:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.241 15:51:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.241 15:51:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.241 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43309820 kB' 'MemAvailable: 47059016 kB' 'Buffers: 2708 kB' 'Cached: 12668316 kB' 'SwapCached: 0 kB' 'Active: 9367224 kB' 'Inactive: 3753000 kB' 'Active(anon): 8975868 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452444 kB' 'Mapped: 156028 kB' 'Shmem: 8526668 kB' 'KReclaimable: 197324 kB' 'Slab: 688848 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491524 kB' 'KernelStack: 12832 kB' 'PageTables: 7568 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10035932 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.242 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.242 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.243 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.243 15:51:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.243 15:51:18 -- setup/common.sh@33 -- # echo 0 00:04:55.243 15:51:18 -- setup/common.sh@33 -- # return 0 00:04:55.243 15:51:18 -- setup/hugepages.sh@100 -- # resv=0 00:04:55.243 15:51:18 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:55.243 nr_hugepages=1024 00:04:55.243 15:51:18 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:55.243 resv_hugepages=0 00:04:55.243 15:51:18 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:55.243 surplus_hugepages=0 00:04:55.243 15:51:18 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:55.243 anon_hugepages=0 00:04:55.243 15:51:18 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:55.243 15:51:18 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:55.243 15:51:18 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:55.244 15:51:18 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:55.244 15:51:18 -- setup/common.sh@18 -- # local node= 00:04:55.244 15:51:18 -- setup/common.sh@19 -- # local var val 00:04:55.244 15:51:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.244 15:51:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.244 15:51:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.244 15:51:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.244 15:51:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.244 15:51:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43310004 kB' 'MemAvailable: 47059200 kB' 'Buffers: 2708 kB' 'Cached: 12668332 kB' 'SwapCached: 0 kB' 'Active: 9367228 kB' 'Inactive: 3753000 kB' 'Active(anon): 8975872 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452444 kB' 'Mapped: 156028 kB' 'Shmem: 8526684 kB' 'KReclaimable: 197324 kB' 'Slab: 688848 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491524 kB' 'KernelStack: 12832 kB' 'PageTables: 7568 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10035948 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.244 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.244 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.245 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.245 15:51:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.246 15:51:18 -- setup/common.sh@33 -- # echo 1024 00:04:55.246 15:51:18 -- setup/common.sh@33 -- # return 0 00:04:55.246 15:51:18 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:55.246 15:51:18 -- setup/hugepages.sh@112 -- # get_nodes 00:04:55.246 15:51:18 -- setup/hugepages.sh@27 -- # local node 00:04:55.246 15:51:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:55.246 15:51:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:55.246 15:51:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:55.246 15:51:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:55.246 15:51:18 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:55.246 15:51:18 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:55.246 15:51:18 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:55.246 15:51:18 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:55.246 15:51:18 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:55.246 15:51:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:55.246 15:51:18 -- setup/common.sh@18 -- # local node=0 00:04:55.246 15:51:18 -- setup/common.sh@19 -- # local var val 00:04:55.246 15:51:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.246 15:51:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.246 15:51:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:55.246 15:51:18 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:55.246 15:51:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.246 15:51:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19136484 kB' 'MemUsed: 13738440 kB' 'SwapCached: 0 kB' 'Active: 6773564 kB' 'Inactive: 3590924 kB' 'Active(anon): 6583400 kB' 'Inactive(anon): 0 kB' 'Active(file): 190164 kB' 'Inactive(file): 3590924 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10042204 kB' 'Mapped: 65584 kB' 'AnonPages: 325464 kB' 'Shmem: 6261116 kB' 'KernelStack: 8296 kB' 'PageTables: 4924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113284 kB' 'Slab: 410780 kB' 'SReclaimable: 113284 kB' 'SUnreclaim: 297496 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.246 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.246 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # continue 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.247 15:51:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.247 15:51:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.247 15:51:18 -- setup/common.sh@33 -- # echo 0 00:04:55.247 15:51:18 -- setup/common.sh@33 -- # return 0 00:04:55.247 15:51:18 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:55.247 15:51:18 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:55.247 15:51:18 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:55.247 15:51:18 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:55.247 15:51:18 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:55.247 node0=1024 expecting 1024 00:04:55.247 15:51:18 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:55.247 15:51:18 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:55.247 15:51:18 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:55.247 15:51:18 -- setup/hugepages.sh@202 -- # setup output 00:04:55.247 15:51:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:55.247 15:51:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:56.626 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:56.626 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:56.626 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:56.626 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:56.626 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:56.626 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:56.626 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:56.626 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:56.626 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:56.626 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:56.626 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:56.626 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:56.626 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:56.626 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:56.626 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:56.626 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:56.626 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:56.626 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:56.626 15:51:20 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:56.626 15:51:20 -- setup/hugepages.sh@89 -- # local node 00:04:56.626 15:51:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:56.626 15:51:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:56.626 15:51:20 -- setup/hugepages.sh@92 -- # local surp 00:04:56.626 15:51:20 -- setup/hugepages.sh@93 -- # local resv 00:04:56.626 15:51:20 -- setup/hugepages.sh@94 -- # local anon 00:04:56.626 15:51:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:56.626 15:51:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:56.626 15:51:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:56.626 15:51:20 -- setup/common.sh@18 -- # local node= 00:04:56.626 15:51:20 -- setup/common.sh@19 -- # local var val 00:04:56.626 15:51:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:56.626 15:51:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:56.626 15:51:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:56.626 15:51:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:56.626 15:51:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:56.626 15:51:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43317380 kB' 'MemAvailable: 47066576 kB' 'Buffers: 2708 kB' 'Cached: 12668376 kB' 'SwapCached: 0 kB' 'Active: 9368332 kB' 'Inactive: 3753000 kB' 'Active(anon): 8976976 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453532 kB' 'Mapped: 156088 kB' 'Shmem: 8526728 kB' 'KReclaimable: 197324 kB' 'Slab: 688892 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491568 kB' 'KernelStack: 12800 kB' 'PageTables: 7448 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10036424 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.626 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.626 15:51:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:56.627 15:51:20 -- setup/common.sh@33 -- # echo 0 00:04:56.627 15:51:20 -- setup/common.sh@33 -- # return 0 00:04:56.627 15:51:20 -- setup/hugepages.sh@97 -- # anon=0 00:04:56.627 15:51:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:56.627 15:51:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:56.627 15:51:20 -- setup/common.sh@18 -- # local node= 00:04:56.627 15:51:20 -- setup/common.sh@19 -- # local var val 00:04:56.627 15:51:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:56.627 15:51:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:56.627 15:51:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:56.627 15:51:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:56.627 15:51:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:56.627 15:51:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43318060 kB' 'MemAvailable: 47067256 kB' 'Buffers: 2708 kB' 'Cached: 12668380 kB' 'SwapCached: 0 kB' 'Active: 9369384 kB' 'Inactive: 3753000 kB' 'Active(anon): 8978028 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454720 kB' 'Mapped: 156088 kB' 'Shmem: 8526732 kB' 'KReclaimable: 197324 kB' 'Slab: 688880 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491556 kB' 'KernelStack: 12800 kB' 'PageTables: 7420 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10036436 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.627 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.627 15:51:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.628 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.628 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.629 15:51:20 -- setup/common.sh@33 -- # echo 0 00:04:56.629 15:51:20 -- setup/common.sh@33 -- # return 0 00:04:56.629 15:51:20 -- setup/hugepages.sh@99 -- # surp=0 00:04:56.629 15:51:20 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:56.629 15:51:20 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:56.629 15:51:20 -- setup/common.sh@18 -- # local node= 00:04:56.629 15:51:20 -- setup/common.sh@19 -- # local var val 00:04:56.629 15:51:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:56.629 15:51:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:56.629 15:51:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:56.629 15:51:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:56.629 15:51:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:56.629 15:51:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43316836 kB' 'MemAvailable: 47066032 kB' 'Buffers: 2708 kB' 'Cached: 12668392 kB' 'SwapCached: 0 kB' 'Active: 9369624 kB' 'Inactive: 3753000 kB' 'Active(anon): 8978268 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455144 kB' 'Mapped: 156036 kB' 'Shmem: 8526744 kB' 'KReclaimable: 197324 kB' 'Slab: 688960 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491636 kB' 'KernelStack: 12800 kB' 'PageTables: 7392 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10036448 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.629 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.629 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:56.630 15:51:20 -- setup/common.sh@33 -- # echo 0 00:04:56.630 15:51:20 -- setup/common.sh@33 -- # return 0 00:04:56.630 15:51:20 -- setup/hugepages.sh@100 -- # resv=0 00:04:56.630 15:51:20 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:56.630 nr_hugepages=1024 00:04:56.630 15:51:20 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:56.630 resv_hugepages=0 00:04:56.630 15:51:20 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:56.630 surplus_hugepages=0 00:04:56.630 15:51:20 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:56.630 anon_hugepages=0 00:04:56.630 15:51:20 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:56.630 15:51:20 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:56.630 15:51:20 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:56.630 15:51:20 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:56.630 15:51:20 -- setup/common.sh@18 -- # local node= 00:04:56.630 15:51:20 -- setup/common.sh@19 -- # local var val 00:04:56.630 15:51:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:56.630 15:51:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:56.630 15:51:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:56.630 15:51:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:56.630 15:51:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:56.630 15:51:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43316584 kB' 'MemAvailable: 47065780 kB' 'Buffers: 2708 kB' 'Cached: 12668408 kB' 'SwapCached: 0 kB' 'Active: 9369644 kB' 'Inactive: 3753000 kB' 'Active(anon): 8978288 kB' 'Inactive(anon): 0 kB' 'Active(file): 391356 kB' 'Inactive(file): 3753000 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455092 kB' 'Mapped: 156036 kB' 'Shmem: 8526760 kB' 'KReclaimable: 197324 kB' 'Slab: 688960 kB' 'SReclaimable: 197324 kB' 'SUnreclaim: 491636 kB' 'KernelStack: 12800 kB' 'PageTables: 7392 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 10036464 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33408 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1719900 kB' 'DirectMap2M: 11831296 kB' 'DirectMap1G: 56623104 kB' 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.630 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.630 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.631 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.631 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:56.632 15:51:20 -- setup/common.sh@33 -- # echo 1024 00:04:56.632 15:51:20 -- setup/common.sh@33 -- # return 0 00:04:56.632 15:51:20 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:56.632 15:51:20 -- setup/hugepages.sh@112 -- # get_nodes 00:04:56.632 15:51:20 -- setup/hugepages.sh@27 -- # local node 00:04:56.632 15:51:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:56.632 15:51:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:56.632 15:51:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:56.632 15:51:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:56.632 15:51:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:56.632 15:51:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:56.632 15:51:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:56.632 15:51:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:56.632 15:51:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:56.632 15:51:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:56.632 15:51:20 -- setup/common.sh@18 -- # local node=0 00:04:56.632 15:51:20 -- setup/common.sh@19 -- # local var val 00:04:56.632 15:51:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:56.632 15:51:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:56.632 15:51:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:56.632 15:51:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:56.632 15:51:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:56.632 15:51:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19132932 kB' 'MemUsed: 13741992 kB' 'SwapCached: 0 kB' 'Active: 6773992 kB' 'Inactive: 3590924 kB' 'Active(anon): 6583828 kB' 'Inactive(anon): 0 kB' 'Active(file): 190164 kB' 'Inactive(file): 3590924 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10042224 kB' 'Mapped: 65592 kB' 'AnonPages: 326016 kB' 'Shmem: 6261136 kB' 'KernelStack: 8232 kB' 'PageTables: 4700 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 113284 kB' 'Slab: 410820 kB' 'SReclaimable: 113284 kB' 'SUnreclaim: 297536 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.632 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.632 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # continue 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:56.633 15:51:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:56.633 15:51:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:56.633 15:51:20 -- setup/common.sh@33 -- # echo 0 00:04:56.633 15:51:20 -- setup/common.sh@33 -- # return 0 00:04:56.633 15:51:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:56.633 15:51:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:56.633 15:51:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:56.633 15:51:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:56.633 15:51:20 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:56.633 node0=1024 expecting 1024 00:04:56.633 15:51:20 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:56.633 00:04:56.633 real 0m2.896s 00:04:56.633 user 0m1.169s 00:04:56.633 sys 0m1.656s 00:04:56.633 15:51:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.633 15:51:20 -- common/autotest_common.sh@10 -- # set +x 00:04:56.633 ************************************ 00:04:56.633 END TEST no_shrink_alloc 00:04:56.633 ************************************ 00:04:56.633 15:51:20 -- setup/hugepages.sh@217 -- # clear_hp 00:04:56.633 15:51:20 -- setup/hugepages.sh@37 -- # local node hp 00:04:56.633 15:51:20 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:56.633 15:51:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:56.633 15:51:20 -- setup/hugepages.sh@41 -- # echo 0 00:04:56.633 15:51:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:56.633 15:51:20 -- setup/hugepages.sh@41 -- # echo 0 00:04:56.633 15:51:20 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:56.633 15:51:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:56.633 15:51:20 -- setup/hugepages.sh@41 -- # echo 0 00:04:56.633 15:51:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:56.633 15:51:20 -- setup/hugepages.sh@41 -- # echo 0 00:04:56.633 15:51:20 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:56.633 15:51:20 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:56.633 00:04:56.633 real 0m11.264s 00:04:56.633 user 0m4.296s 00:04:56.633 sys 0m5.906s 00:04:56.633 15:51:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.633 15:51:20 -- common/autotest_common.sh@10 -- # set +x 00:04:56.633 ************************************ 00:04:56.633 END TEST hugepages 00:04:56.633 ************************************ 00:04:56.633 15:51:20 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:56.633 15:51:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:56.633 15:51:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.633 15:51:20 -- common/autotest_common.sh@10 -- # set +x 00:04:56.633 ************************************ 00:04:56.633 START TEST driver 00:04:56.633 ************************************ 00:04:56.633 15:51:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:56.892 * Looking for test storage... 00:04:56.892 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:56.892 15:51:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:56.892 15:51:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:56.892 15:51:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:56.892 15:51:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:56.892 15:51:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:56.892 15:51:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:56.892 15:51:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:56.892 15:51:20 -- scripts/common.sh@335 -- # IFS=.-: 00:04:56.892 15:51:20 -- scripts/common.sh@335 -- # read -ra ver1 00:04:56.892 15:51:20 -- scripts/common.sh@336 -- # IFS=.-: 00:04:56.892 15:51:20 -- scripts/common.sh@336 -- # read -ra ver2 00:04:56.892 15:51:20 -- scripts/common.sh@337 -- # local 'op=<' 00:04:56.892 15:51:20 -- scripts/common.sh@339 -- # ver1_l=2 00:04:56.892 15:51:20 -- scripts/common.sh@340 -- # ver2_l=1 00:04:56.892 15:51:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:56.892 15:51:20 -- scripts/common.sh@343 -- # case "$op" in 00:04:56.892 15:51:20 -- scripts/common.sh@344 -- # : 1 00:04:56.892 15:51:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:56.892 15:51:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:56.892 15:51:20 -- scripts/common.sh@364 -- # decimal 1 00:04:56.892 15:51:20 -- scripts/common.sh@352 -- # local d=1 00:04:56.892 15:51:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:56.892 15:51:20 -- scripts/common.sh@354 -- # echo 1 00:04:56.892 15:51:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:56.892 15:51:20 -- scripts/common.sh@365 -- # decimal 2 00:04:56.892 15:51:20 -- scripts/common.sh@352 -- # local d=2 00:04:56.892 15:51:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:56.892 15:51:20 -- scripts/common.sh@354 -- # echo 2 00:04:56.892 15:51:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:56.892 15:51:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:56.892 15:51:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:56.892 15:51:20 -- scripts/common.sh@367 -- # return 0 00:04:56.892 15:51:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:56.892 15:51:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:56.892 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.892 --rc genhtml_branch_coverage=1 00:04:56.892 --rc genhtml_function_coverage=1 00:04:56.892 --rc genhtml_legend=1 00:04:56.892 --rc geninfo_all_blocks=1 00:04:56.892 --rc geninfo_unexecuted_blocks=1 00:04:56.892 00:04:56.892 ' 00:04:56.892 15:51:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:56.892 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.892 --rc genhtml_branch_coverage=1 00:04:56.892 --rc genhtml_function_coverage=1 00:04:56.892 --rc genhtml_legend=1 00:04:56.892 --rc geninfo_all_blocks=1 00:04:56.892 --rc geninfo_unexecuted_blocks=1 00:04:56.892 00:04:56.892 ' 00:04:56.892 15:51:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:56.892 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.892 --rc genhtml_branch_coverage=1 00:04:56.892 --rc genhtml_function_coverage=1 00:04:56.892 --rc genhtml_legend=1 00:04:56.892 --rc geninfo_all_blocks=1 00:04:56.892 --rc geninfo_unexecuted_blocks=1 00:04:56.892 00:04:56.892 ' 00:04:56.892 15:51:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:56.892 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.892 --rc genhtml_branch_coverage=1 00:04:56.892 --rc genhtml_function_coverage=1 00:04:56.892 --rc genhtml_legend=1 00:04:56.892 --rc geninfo_all_blocks=1 00:04:56.892 --rc geninfo_unexecuted_blocks=1 00:04:56.892 00:04:56.892 ' 00:04:56.892 15:51:20 -- setup/driver.sh@68 -- # setup reset 00:04:56.892 15:51:20 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:56.892 15:51:20 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:59.423 15:51:22 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:59.423 15:51:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:59.423 15:51:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:59.423 15:51:22 -- common/autotest_common.sh@10 -- # set +x 00:04:59.423 ************************************ 00:04:59.423 START TEST guess_driver 00:04:59.423 ************************************ 00:04:59.423 15:51:22 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:59.423 15:51:22 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:59.423 15:51:22 -- setup/driver.sh@47 -- # local fail=0 00:04:59.423 15:51:22 -- setup/driver.sh@49 -- # pick_driver 00:04:59.423 15:51:22 -- setup/driver.sh@36 -- # vfio 00:04:59.423 15:51:22 -- setup/driver.sh@21 -- # local iommu_grups 00:04:59.423 15:51:22 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:59.423 15:51:22 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:59.423 15:51:22 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:59.423 15:51:22 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:59.423 15:51:22 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:59.423 15:51:22 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:59.423 15:51:22 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:59.423 15:51:22 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:59.424 15:51:22 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:59.424 15:51:22 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:59.424 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:59.424 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:59.424 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:59.424 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:59.424 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:59.424 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:59.424 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:59.424 15:51:22 -- setup/driver.sh@30 -- # return 0 00:04:59.424 15:51:22 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:59.424 15:51:22 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:59.424 15:51:22 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:59.424 15:51:22 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:59.424 Looking for driver=vfio-pci 00:04:59.424 15:51:22 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:59.424 15:51:22 -- setup/driver.sh@45 -- # setup output config 00:04:59.424 15:51:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:59.424 15:51:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:00.358 15:51:23 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.358 15:51:23 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.358 15:51:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.358 15:51:23 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.358 15:51:23 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.358 15:51:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.358 15:51:23 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.358 15:51:23 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.358 15:51:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.358 15:51:23 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.358 15:51:23 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.358 15:51:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.358 15:51:23 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.358 15:51:23 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.358 15:51:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.358 15:51:23 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.358 15:51:23 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.358 15:51:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.617 15:51:23 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.617 15:51:23 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.617 15:51:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.617 15:51:23 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.617 15:51:23 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.617 15:51:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.617 15:51:23 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.617 15:51:23 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.617 15:51:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.617 15:51:23 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.617 15:51:23 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.617 15:51:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.617 15:51:23 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.617 15:51:23 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.617 15:51:23 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.617 15:51:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.617 15:51:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.617 15:51:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.617 15:51:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.617 15:51:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.617 15:51:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.617 15:51:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.617 15:51:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.617 15:51:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.617 15:51:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.617 15:51:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.617 15:51:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:00.617 15:51:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:00.617 15:51:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:00.617 15:51:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:01.551 15:51:24 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:01.551 15:51:24 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:01.551 15:51:24 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:01.551 15:51:25 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:05:01.551 15:51:25 -- setup/driver.sh@65 -- # setup reset 00:05:01.551 15:51:25 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:01.551 15:51:25 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:04.086 00:05:04.086 real 0m4.753s 00:05:04.086 user 0m1.047s 00:05:04.086 sys 0m1.913s 00:05:04.086 15:51:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:04.086 15:51:27 -- common/autotest_common.sh@10 -- # set +x 00:05:04.086 ************************************ 00:05:04.086 END TEST guess_driver 00:05:04.086 ************************************ 00:05:04.086 00:05:04.086 real 0m7.307s 00:05:04.086 user 0m1.634s 00:05:04.086 sys 0m2.955s 00:05:04.086 15:51:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:04.086 15:51:27 -- common/autotest_common.sh@10 -- # set +x 00:05:04.086 ************************************ 00:05:04.086 END TEST driver 00:05:04.086 ************************************ 00:05:04.086 15:51:27 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:04.086 15:51:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.086 15:51:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.086 15:51:27 -- common/autotest_common.sh@10 -- # set +x 00:05:04.086 ************************************ 00:05:04.086 START TEST devices 00:05:04.086 ************************************ 00:05:04.086 15:51:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:04.086 * Looking for test storage... 00:05:04.086 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:04.086 15:51:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:04.086 15:51:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:04.086 15:51:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:04.086 15:51:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:04.086 15:51:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:04.086 15:51:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:04.086 15:51:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:04.086 15:51:27 -- scripts/common.sh@335 -- # IFS=.-: 00:05:04.086 15:51:27 -- scripts/common.sh@335 -- # read -ra ver1 00:05:04.086 15:51:27 -- scripts/common.sh@336 -- # IFS=.-: 00:05:04.086 15:51:27 -- scripts/common.sh@336 -- # read -ra ver2 00:05:04.086 15:51:27 -- scripts/common.sh@337 -- # local 'op=<' 00:05:04.086 15:51:27 -- scripts/common.sh@339 -- # ver1_l=2 00:05:04.086 15:51:27 -- scripts/common.sh@340 -- # ver2_l=1 00:05:04.086 15:51:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:04.086 15:51:27 -- scripts/common.sh@343 -- # case "$op" in 00:05:04.086 15:51:27 -- scripts/common.sh@344 -- # : 1 00:05:04.086 15:51:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:04.086 15:51:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:04.086 15:51:27 -- scripts/common.sh@364 -- # decimal 1 00:05:04.086 15:51:27 -- scripts/common.sh@352 -- # local d=1 00:05:04.086 15:51:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:04.086 15:51:27 -- scripts/common.sh@354 -- # echo 1 00:05:04.086 15:51:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:04.086 15:51:27 -- scripts/common.sh@365 -- # decimal 2 00:05:04.086 15:51:27 -- scripts/common.sh@352 -- # local d=2 00:05:04.086 15:51:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:04.086 15:51:27 -- scripts/common.sh@354 -- # echo 2 00:05:04.086 15:51:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:04.086 15:51:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:04.086 15:51:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:04.086 15:51:27 -- scripts/common.sh@367 -- # return 0 00:05:04.086 15:51:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:04.086 15:51:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:04.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:04.086 --rc genhtml_branch_coverage=1 00:05:04.086 --rc genhtml_function_coverage=1 00:05:04.086 --rc genhtml_legend=1 00:05:04.086 --rc geninfo_all_blocks=1 00:05:04.086 --rc geninfo_unexecuted_blocks=1 00:05:04.086 00:05:04.086 ' 00:05:04.086 15:51:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:04.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:04.086 --rc genhtml_branch_coverage=1 00:05:04.086 --rc genhtml_function_coverage=1 00:05:04.086 --rc genhtml_legend=1 00:05:04.086 --rc geninfo_all_blocks=1 00:05:04.086 --rc geninfo_unexecuted_blocks=1 00:05:04.086 00:05:04.086 ' 00:05:04.086 15:51:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:04.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:04.087 --rc genhtml_branch_coverage=1 00:05:04.087 --rc genhtml_function_coverage=1 00:05:04.087 --rc genhtml_legend=1 00:05:04.087 --rc geninfo_all_blocks=1 00:05:04.087 --rc geninfo_unexecuted_blocks=1 00:05:04.087 00:05:04.087 ' 00:05:04.087 15:51:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:04.087 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:04.087 --rc genhtml_branch_coverage=1 00:05:04.087 --rc genhtml_function_coverage=1 00:05:04.087 --rc genhtml_legend=1 00:05:04.087 --rc geninfo_all_blocks=1 00:05:04.087 --rc geninfo_unexecuted_blocks=1 00:05:04.087 00:05:04.087 ' 00:05:04.087 15:51:27 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:05:04.087 15:51:27 -- setup/devices.sh@192 -- # setup reset 00:05:04.087 15:51:27 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:04.087 15:51:27 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:05.988 15:51:29 -- setup/devices.sh@194 -- # get_zoned_devs 00:05:05.988 15:51:29 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:05:05.988 15:51:29 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:05:05.988 15:51:29 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:05:05.988 15:51:29 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:05:05.988 15:51:29 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:05:05.988 15:51:29 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:05:05.988 15:51:29 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:05.988 15:51:29 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:05:05.988 15:51:29 -- setup/devices.sh@196 -- # blocks=() 00:05:05.988 15:51:29 -- setup/devices.sh@196 -- # declare -a blocks 00:05:05.988 15:51:29 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:05:05.988 15:51:29 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:05:05.988 15:51:29 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:05:05.988 15:51:29 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:05:05.988 15:51:29 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:05:05.988 15:51:29 -- setup/devices.sh@201 -- # ctrl=nvme0 00:05:05.988 15:51:29 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:05:05.988 15:51:29 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:05:05.988 15:51:29 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:05:05.988 15:51:29 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:05:05.988 15:51:29 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:05:05.988 No valid GPT data, bailing 00:05:05.988 15:51:29 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:05.988 15:51:29 -- scripts/common.sh@393 -- # pt= 00:05:05.988 15:51:29 -- scripts/common.sh@394 -- # return 1 00:05:05.988 15:51:29 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:05:05.988 15:51:29 -- setup/common.sh@76 -- # local dev=nvme0n1 00:05:05.988 15:51:29 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:05:05.988 15:51:29 -- setup/common.sh@80 -- # echo 1000204886016 00:05:05.989 15:51:29 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:05:05.989 15:51:29 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:05:05.989 15:51:29 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:05:05.989 15:51:29 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:05:05.989 15:51:29 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:05:05.989 15:51:29 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:05:05.989 15:51:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.989 15:51:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.989 15:51:29 -- common/autotest_common.sh@10 -- # set +x 00:05:05.989 ************************************ 00:05:05.989 START TEST nvme_mount 00:05:05.989 ************************************ 00:05:05.989 15:51:29 -- common/autotest_common.sh@1114 -- # nvme_mount 00:05:05.989 15:51:29 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:05:05.989 15:51:29 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:05:05.989 15:51:29 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:05.989 15:51:29 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:05.989 15:51:29 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:05:05.989 15:51:29 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:05.989 15:51:29 -- setup/common.sh@40 -- # local part_no=1 00:05:05.989 15:51:29 -- setup/common.sh@41 -- # local size=1073741824 00:05:05.989 15:51:29 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:05.989 15:51:29 -- setup/common.sh@44 -- # parts=() 00:05:05.989 15:51:29 -- setup/common.sh@44 -- # local parts 00:05:05.989 15:51:29 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:05.989 15:51:29 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.989 15:51:29 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:05.989 15:51:29 -- setup/common.sh@46 -- # (( part++ )) 00:05:05.989 15:51:29 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.989 15:51:29 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:05.989 15:51:29 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:05.989 15:51:29 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:06.923 Creating new GPT entries in memory. 00:05:06.923 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:06.923 other utilities. 00:05:06.923 15:51:30 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:06.923 15:51:30 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:06.923 15:51:30 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:06.923 15:51:30 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:06.923 15:51:30 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:07.857 Creating new GPT entries in memory. 00:05:07.857 The operation has completed successfully. 00:05:07.857 15:51:31 -- setup/common.sh@57 -- # (( part++ )) 00:05:07.857 15:51:31 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:07.857 15:51:31 -- setup/common.sh@62 -- # wait 1448862 00:05:07.857 15:51:31 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.857 15:51:31 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:07.857 15:51:31 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.857 15:51:31 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:07.857 15:51:31 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:07.857 15:51:31 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.857 15:51:31 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:07.857 15:51:31 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:07.857 15:51:31 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:07.857 15:51:31 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.857 15:51:31 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:07.857 15:51:31 -- setup/devices.sh@53 -- # local found=0 00:05:07.857 15:51:31 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:07.857 15:51:31 -- setup/devices.sh@56 -- # : 00:05:07.857 15:51:31 -- setup/devices.sh@59 -- # local pci status 00:05:07.857 15:51:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.857 15:51:31 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:07.857 15:51:31 -- setup/devices.sh@47 -- # setup output config 00:05:07.857 15:51:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:07.857 15:51:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:09.232 15:51:32 -- setup/devices.sh@63 -- # found=1 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.232 15:51:32 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:09.232 15:51:32 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:09.232 15:51:32 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:09.232 15:51:32 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:09.232 15:51:32 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:09.232 15:51:32 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:09.232 15:51:32 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:09.232 15:51:32 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:09.232 15:51:32 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:09.232 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:09.232 15:51:32 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:09.232 15:51:32 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:09.490 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:09.490 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:09.490 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:09.490 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:09.490 15:51:33 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:09.490 15:51:33 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:09.490 15:51:33 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:09.490 15:51:33 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:09.490 15:51:33 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:09.490 15:51:33 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:09.748 15:51:33 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:09.748 15:51:33 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:09.748 15:51:33 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:09.748 15:51:33 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:09.748 15:51:33 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:09.748 15:51:33 -- setup/devices.sh@53 -- # local found=0 00:05:09.748 15:51:33 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:09.748 15:51:33 -- setup/devices.sh@56 -- # : 00:05:09.748 15:51:33 -- setup/devices.sh@59 -- # local pci status 00:05:09.748 15:51:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.748 15:51:33 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:09.748 15:51:33 -- setup/devices.sh@47 -- # setup output config 00:05:09.748 15:51:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:09.748 15:51:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:10.683 15:51:34 -- setup/devices.sh@63 -- # found=1 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.683 15:51:34 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.683 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.941 15:51:34 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:10.941 15:51:34 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:10.941 15:51:34 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:10.941 15:51:34 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:10.941 15:51:34 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:10.941 15:51:34 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:10.941 15:51:34 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:10.941 15:51:34 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:10.941 15:51:34 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:10.941 15:51:34 -- setup/devices.sh@50 -- # local mount_point= 00:05:10.941 15:51:34 -- setup/devices.sh@51 -- # local test_file= 00:05:10.941 15:51:34 -- setup/devices.sh@53 -- # local found=0 00:05:10.941 15:51:34 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:10.941 15:51:34 -- setup/devices.sh@59 -- # local pci status 00:05:10.941 15:51:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.941 15:51:34 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:10.941 15:51:34 -- setup/devices.sh@47 -- # setup output config 00:05:10.941 15:51:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:10.941 15:51:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:11.876 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.876 15:51:35 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:11.876 15:51:35 -- setup/devices.sh@63 -- # found=1 00:05:11.876 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.876 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.876 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.876 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.876 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.876 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.876 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.135 15:51:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.135 15:51:35 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:12.135 15:51:35 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:12.135 15:51:35 -- setup/devices.sh@68 -- # return 0 00:05:12.135 15:51:35 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:12.136 15:51:35 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:12.136 15:51:35 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:12.136 15:51:35 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:12.136 15:51:35 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:12.136 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:12.136 00:05:12.136 real 0m6.452s 00:05:12.136 user 0m1.549s 00:05:12.136 sys 0m2.494s 00:05:12.136 15:51:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.136 15:51:35 -- common/autotest_common.sh@10 -- # set +x 00:05:12.136 ************************************ 00:05:12.136 END TEST nvme_mount 00:05:12.136 ************************************ 00:05:12.136 15:51:35 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:12.136 15:51:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.136 15:51:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.136 15:51:35 -- common/autotest_common.sh@10 -- # set +x 00:05:12.136 ************************************ 00:05:12.136 START TEST dm_mount 00:05:12.136 ************************************ 00:05:12.136 15:51:35 -- common/autotest_common.sh@1114 -- # dm_mount 00:05:12.136 15:51:35 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:12.136 15:51:35 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:12.136 15:51:35 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:12.136 15:51:35 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:12.136 15:51:35 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:12.136 15:51:35 -- setup/common.sh@40 -- # local part_no=2 00:05:12.136 15:51:35 -- setup/common.sh@41 -- # local size=1073741824 00:05:12.136 15:51:35 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:12.136 15:51:35 -- setup/common.sh@44 -- # parts=() 00:05:12.136 15:51:35 -- setup/common.sh@44 -- # local parts 00:05:12.136 15:51:35 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:12.136 15:51:35 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:12.136 15:51:35 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:12.136 15:51:35 -- setup/common.sh@46 -- # (( part++ )) 00:05:12.136 15:51:35 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:12.136 15:51:35 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:12.136 15:51:35 -- setup/common.sh@46 -- # (( part++ )) 00:05:12.136 15:51:35 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:12.136 15:51:35 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:12.136 15:51:35 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:12.136 15:51:35 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:13.511 Creating new GPT entries in memory. 00:05:13.511 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:13.511 other utilities. 00:05:13.511 15:51:36 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:13.511 15:51:36 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:13.511 15:51:36 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:13.511 15:51:36 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:13.511 15:51:36 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:14.446 Creating new GPT entries in memory. 00:05:14.446 The operation has completed successfully. 00:05:14.446 15:51:37 -- setup/common.sh@57 -- # (( part++ )) 00:05:14.446 15:51:37 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:14.446 15:51:37 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:14.446 15:51:37 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:14.446 15:51:37 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:15.381 The operation has completed successfully. 00:05:15.381 15:51:38 -- setup/common.sh@57 -- # (( part++ )) 00:05:15.381 15:51:38 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:15.381 15:51:38 -- setup/common.sh@62 -- # wait 1451332 00:05:15.381 15:51:38 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:15.381 15:51:38 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.381 15:51:38 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:15.381 15:51:38 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:15.381 15:51:38 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:15.381 15:51:38 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:15.381 15:51:38 -- setup/devices.sh@161 -- # break 00:05:15.381 15:51:38 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:15.381 15:51:38 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:15.381 15:51:38 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:15.381 15:51:38 -- setup/devices.sh@166 -- # dm=dm-0 00:05:15.381 15:51:38 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:15.381 15:51:38 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:15.381 15:51:38 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.381 15:51:38 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:15.381 15:51:38 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.381 15:51:38 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:15.381 15:51:38 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:15.381 15:51:38 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.381 15:51:38 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:15.381 15:51:38 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:15.381 15:51:38 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:15.381 15:51:38 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.381 15:51:38 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:15.381 15:51:38 -- setup/devices.sh@53 -- # local found=0 00:05:15.381 15:51:38 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:15.381 15:51:38 -- setup/devices.sh@56 -- # : 00:05:15.381 15:51:38 -- setup/devices.sh@59 -- # local pci status 00:05:15.381 15:51:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.381 15:51:38 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:15.381 15:51:38 -- setup/devices.sh@47 -- # setup output config 00:05:15.381 15:51:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:15.381 15:51:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:16.755 15:51:39 -- setup/devices.sh@63 -- # found=1 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.755 15:51:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:40 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:16.755 15:51:40 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:16.755 15:51:40 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:16.755 15:51:40 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:16.755 15:51:40 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:16.755 15:51:40 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:16.755 15:51:40 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:16.755 15:51:40 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:16.755 15:51:40 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:16.755 15:51:40 -- setup/devices.sh@50 -- # local mount_point= 00:05:16.755 15:51:40 -- setup/devices.sh@51 -- # local test_file= 00:05:16.755 15:51:40 -- setup/devices.sh@53 -- # local found=0 00:05:16.755 15:51:40 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:16.755 15:51:40 -- setup/devices.sh@59 -- # local pci status 00:05:16.755 15:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.755 15:51:40 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:16.755 15:51:40 -- setup/devices.sh@47 -- # setup output config 00:05:16.755 15:51:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:16.755 15:51:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:17.689 15:51:41 -- setup/devices.sh@63 -- # found=1 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.689 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.689 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.690 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.690 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.690 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.690 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.690 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.690 15:51:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:17.690 15:51:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:17.948 15:51:41 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:17.948 15:51:41 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:17.948 15:51:41 -- setup/devices.sh@68 -- # return 0 00:05:17.948 15:51:41 -- setup/devices.sh@187 -- # cleanup_dm 00:05:17.948 15:51:41 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:17.948 15:51:41 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:17.948 15:51:41 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:17.948 15:51:41 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:17.948 15:51:41 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:17.948 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:17.948 15:51:41 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:17.948 15:51:41 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:17.948 00:05:17.948 real 0m5.780s 00:05:17.948 user 0m0.949s 00:05:17.948 sys 0m1.701s 00:05:17.948 15:51:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:17.948 15:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:17.948 ************************************ 00:05:17.948 END TEST dm_mount 00:05:17.948 ************************************ 00:05:17.948 15:51:41 -- setup/devices.sh@1 -- # cleanup 00:05:17.948 15:51:41 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:17.948 15:51:41 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:17.948 15:51:41 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:17.948 15:51:41 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:17.948 15:51:41 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:17.948 15:51:41 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:18.206 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:18.206 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:18.206 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:18.206 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:18.206 15:51:41 -- setup/devices.sh@12 -- # cleanup_dm 00:05:18.206 15:51:41 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:18.206 15:51:41 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:18.206 15:51:41 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:18.206 15:51:41 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:18.206 15:51:41 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:18.206 15:51:41 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:18.206 00:05:18.206 real 0m14.258s 00:05:18.206 user 0m3.203s 00:05:18.206 sys 0m5.291s 00:05:18.206 15:51:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.206 15:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:18.206 ************************************ 00:05:18.206 END TEST devices 00:05:18.206 ************************************ 00:05:18.465 00:05:18.465 real 0m43.716s 00:05:18.465 user 0m12.512s 00:05:18.465 sys 0m19.746s 00:05:18.465 15:51:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.465 15:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:18.465 ************************************ 00:05:18.465 END TEST setup.sh 00:05:18.465 ************************************ 00:05:18.465 15:51:41 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:19.399 Hugepages 00:05:19.399 node hugesize free / total 00:05:19.399 node0 1048576kB 0 / 0 00:05:19.399 node0 2048kB 2048 / 2048 00:05:19.399 node1 1048576kB 0 / 0 00:05:19.399 node1 2048kB 0 / 0 00:05:19.399 00:05:19.399 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:19.399 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:19.399 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:19.399 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:19.399 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:19.399 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:19.399 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:19.399 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:19.399 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:19.399 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:19.399 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:19.399 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:19.399 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:19.399 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:19.399 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:19.399 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:19.399 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:19.657 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:19.657 15:51:43 -- spdk/autotest.sh@128 -- # uname -s 00:05:19.657 15:51:43 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:05:19.657 15:51:43 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:05:19.657 15:51:43 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:21.033 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:21.033 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:21.033 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:21.033 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:21.033 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:21.033 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:21.033 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:21.033 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:21.033 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:21.033 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:21.033 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:21.033 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:21.033 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:21.033 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:21.033 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:21.033 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:21.967 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:21.967 15:51:45 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:22.900 15:51:46 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:22.900 15:51:46 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:22.900 15:51:46 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:22.900 15:51:46 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:22.900 15:51:46 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:22.900 15:51:46 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:22.900 15:51:46 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:22.900 15:51:46 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:22.900 15:51:46 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:22.900 15:51:46 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:22.900 15:51:46 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:22.901 15:51:46 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:24.275 Waiting for block devices as requested 00:05:24.275 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:24.275 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:24.534 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:24.534 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:24.534 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:24.534 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:24.792 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:24.792 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:24.792 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:24.792 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:25.050 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:25.050 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:25.050 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:25.308 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:25.308 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:25.308 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:25.308 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:25.566 15:51:48 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:25.566 15:51:48 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:25.566 15:51:48 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:25.566 15:51:48 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:25.566 15:51:48 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:25.566 15:51:48 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:25.566 15:51:48 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:25.566 15:51:48 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:25.566 15:51:48 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:25.566 15:51:48 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:25.566 15:51:48 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:25.566 15:51:48 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:25.566 15:51:48 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:25.566 15:51:48 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:25.566 15:51:48 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:25.566 15:51:48 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:25.566 15:51:48 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:25.566 15:51:48 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:25.566 15:51:48 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:25.566 15:51:48 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:25.566 15:51:48 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:25.566 15:51:48 -- common/autotest_common.sh@1552 -- # continue 00:05:25.566 15:51:48 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:25.566 15:51:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:25.566 15:51:48 -- common/autotest_common.sh@10 -- # set +x 00:05:25.566 15:51:49 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:25.566 15:51:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:25.566 15:51:49 -- common/autotest_common.sh@10 -- # set +x 00:05:25.566 15:51:49 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:26.941 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:26.941 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:26.941 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:26.941 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:26.941 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:26.941 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:26.941 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:26.941 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:26.941 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:26.941 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:26.941 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:26.941 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:26.941 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:26.941 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:26.941 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:26.941 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:27.874 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:27.874 15:51:51 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:27.874 15:51:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:27.874 15:51:51 -- common/autotest_common.sh@10 -- # set +x 00:05:27.874 15:51:51 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:27.874 15:51:51 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:27.874 15:51:51 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:27.874 15:51:51 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:27.874 15:51:51 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:27.874 15:51:51 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:27.874 15:51:51 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:27.874 15:51:51 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:27.874 15:51:51 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:27.874 15:51:51 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:27.874 15:51:51 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:28.133 15:51:51 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:28.133 15:51:51 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:28.133 15:51:51 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:28.133 15:51:51 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:28.133 15:51:51 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:28.133 15:51:51 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:28.133 15:51:51 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:28.133 15:51:51 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:28.133 15:51:51 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:28.133 15:51:51 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=1456755 00:05:28.133 15:51:51 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:28.133 15:51:51 -- common/autotest_common.sh@1593 -- # waitforlisten 1456755 00:05:28.133 15:51:51 -- common/autotest_common.sh@829 -- # '[' -z 1456755 ']' 00:05:28.133 15:51:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:28.133 15:51:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:28.133 15:51:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:28.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:28.133 15:51:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:28.133 15:51:51 -- common/autotest_common.sh@10 -- # set +x 00:05:28.133 [2024-11-18 15:51:51.574101] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.133 [2024-11-18 15:51:51.574212] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1456755 ] 00:05:28.133 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.133 [2024-11-18 15:51:51.632018] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.133 [2024-11-18 15:51:51.720644] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:28.133 [2024-11-18 15:51:51.720852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.068 15:51:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.068 15:51:52 -- common/autotest_common.sh@862 -- # return 0 00:05:29.068 15:51:52 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:29.068 15:51:52 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:29.068 15:51:52 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:32.423 nvme0n1 00:05:32.423 15:51:55 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:32.423 [2024-11-18 15:51:55.871547] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:32.423 [2024-11-18 15:51:55.871597] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:32.423 request: 00:05:32.423 { 00:05:32.423 "nvme_ctrlr_name": "nvme0", 00:05:32.423 "password": "test", 00:05:32.423 "method": "bdev_nvme_opal_revert", 00:05:32.423 "req_id": 1 00:05:32.423 } 00:05:32.423 Got JSON-RPC error response 00:05:32.423 response: 00:05:32.423 { 00:05:32.423 "code": -32603, 00:05:32.423 "message": "Internal error" 00:05:32.423 } 00:05:32.423 15:51:55 -- common/autotest_common.sh@1599 -- # true 00:05:32.423 15:51:55 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:32.423 15:51:55 -- common/autotest_common.sh@1603 -- # killprocess 1456755 00:05:32.423 15:51:55 -- common/autotest_common.sh@936 -- # '[' -z 1456755 ']' 00:05:32.423 15:51:55 -- common/autotest_common.sh@940 -- # kill -0 1456755 00:05:32.423 15:51:55 -- common/autotest_common.sh@941 -- # uname 00:05:32.423 15:51:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:32.423 15:51:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1456755 00:05:32.423 15:51:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:32.423 15:51:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:32.423 15:51:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1456755' 00:05:32.423 killing process with pid 1456755 00:05:32.423 15:51:55 -- common/autotest_common.sh@955 -- # kill 1456755 00:05:32.423 15:51:55 -- common/autotest_common.sh@960 -- # wait 1456755 00:05:34.322 15:51:57 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:34.322 15:51:57 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:34.322 15:51:57 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:34.322 15:51:57 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:34.322 15:51:57 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:34.322 15:51:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:34.322 15:51:57 -- common/autotest_common.sh@10 -- # set +x 00:05:34.322 15:51:57 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:34.322 15:51:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.322 15:51:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.322 15:51:57 -- common/autotest_common.sh@10 -- # set +x 00:05:34.322 ************************************ 00:05:34.322 START TEST env 00:05:34.322 ************************************ 00:05:34.322 15:51:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:34.322 * Looking for test storage... 00:05:34.322 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:34.322 15:51:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:34.322 15:51:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:34.322 15:51:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:34.322 15:51:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:34.322 15:51:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:34.322 15:51:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:34.322 15:51:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:34.322 15:51:57 -- scripts/common.sh@335 -- # IFS=.-: 00:05:34.323 15:51:57 -- scripts/common.sh@335 -- # read -ra ver1 00:05:34.323 15:51:57 -- scripts/common.sh@336 -- # IFS=.-: 00:05:34.323 15:51:57 -- scripts/common.sh@336 -- # read -ra ver2 00:05:34.323 15:51:57 -- scripts/common.sh@337 -- # local 'op=<' 00:05:34.323 15:51:57 -- scripts/common.sh@339 -- # ver1_l=2 00:05:34.323 15:51:57 -- scripts/common.sh@340 -- # ver2_l=1 00:05:34.323 15:51:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:34.323 15:51:57 -- scripts/common.sh@343 -- # case "$op" in 00:05:34.323 15:51:57 -- scripts/common.sh@344 -- # : 1 00:05:34.323 15:51:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:34.323 15:51:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:34.323 15:51:57 -- scripts/common.sh@364 -- # decimal 1 00:05:34.323 15:51:57 -- scripts/common.sh@352 -- # local d=1 00:05:34.323 15:51:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:34.323 15:51:57 -- scripts/common.sh@354 -- # echo 1 00:05:34.323 15:51:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:34.323 15:51:57 -- scripts/common.sh@365 -- # decimal 2 00:05:34.323 15:51:57 -- scripts/common.sh@352 -- # local d=2 00:05:34.323 15:51:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:34.323 15:51:57 -- scripts/common.sh@354 -- # echo 2 00:05:34.323 15:51:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:34.323 15:51:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:34.323 15:51:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:34.323 15:51:57 -- scripts/common.sh@367 -- # return 0 00:05:34.323 15:51:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:34.323 15:51:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:34.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.323 --rc genhtml_branch_coverage=1 00:05:34.323 --rc genhtml_function_coverage=1 00:05:34.323 --rc genhtml_legend=1 00:05:34.323 --rc geninfo_all_blocks=1 00:05:34.323 --rc geninfo_unexecuted_blocks=1 00:05:34.323 00:05:34.323 ' 00:05:34.323 15:51:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:34.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.323 --rc genhtml_branch_coverage=1 00:05:34.323 --rc genhtml_function_coverage=1 00:05:34.323 --rc genhtml_legend=1 00:05:34.323 --rc geninfo_all_blocks=1 00:05:34.323 --rc geninfo_unexecuted_blocks=1 00:05:34.323 00:05:34.323 ' 00:05:34.323 15:51:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:34.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.323 --rc genhtml_branch_coverage=1 00:05:34.323 --rc genhtml_function_coverage=1 00:05:34.323 --rc genhtml_legend=1 00:05:34.323 --rc geninfo_all_blocks=1 00:05:34.323 --rc geninfo_unexecuted_blocks=1 00:05:34.323 00:05:34.323 ' 00:05:34.323 15:51:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:34.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.323 --rc genhtml_branch_coverage=1 00:05:34.323 --rc genhtml_function_coverage=1 00:05:34.323 --rc genhtml_legend=1 00:05:34.323 --rc geninfo_all_blocks=1 00:05:34.323 --rc geninfo_unexecuted_blocks=1 00:05:34.323 00:05:34.323 ' 00:05:34.323 15:51:57 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:34.323 15:51:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.323 15:51:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.323 15:51:57 -- common/autotest_common.sh@10 -- # set +x 00:05:34.323 ************************************ 00:05:34.323 START TEST env_memory 00:05:34.323 ************************************ 00:05:34.323 15:51:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:34.323 00:05:34.323 00:05:34.323 CUnit - A unit testing framework for C - Version 2.1-3 00:05:34.323 http://cunit.sourceforge.net/ 00:05:34.323 00:05:34.323 00:05:34.323 Suite: memory 00:05:34.323 Test: alloc and free memory map ...[2024-11-18 15:51:57.841431] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:34.323 passed 00:05:34.323 Test: mem map translation ...[2024-11-18 15:51:57.861084] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:34.323 [2024-11-18 15:51:57.861107] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:34.323 [2024-11-18 15:51:57.861153] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:34.323 [2024-11-18 15:51:57.861165] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:34.323 passed 00:05:34.323 Test: mem map registration ...[2024-11-18 15:51:57.901757] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:34.323 [2024-11-18 15:51:57.901776] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:34.582 passed 00:05:34.582 Test: mem map adjacent registrations ...passed 00:05:34.582 00:05:34.582 Run Summary: Type Total Ran Passed Failed Inactive 00:05:34.582 suites 1 1 n/a 0 0 00:05:34.582 tests 4 4 4 0 0 00:05:34.582 asserts 152 152 152 0 n/a 00:05:34.582 00:05:34.582 Elapsed time = 0.141 seconds 00:05:34.582 00:05:34.582 real 0m0.150s 00:05:34.582 user 0m0.143s 00:05:34.582 sys 0m0.007s 00:05:34.582 15:51:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.582 15:51:57 -- common/autotest_common.sh@10 -- # set +x 00:05:34.582 ************************************ 00:05:34.582 END TEST env_memory 00:05:34.582 ************************************ 00:05:34.582 15:51:57 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:34.582 15:51:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.582 15:51:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.582 15:51:57 -- common/autotest_common.sh@10 -- # set +x 00:05:34.582 ************************************ 00:05:34.582 START TEST env_vtophys 00:05:34.582 ************************************ 00:05:34.582 15:51:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:34.582 EAL: lib.eal log level changed from notice to debug 00:05:34.582 EAL: Detected lcore 0 as core 0 on socket 0 00:05:34.582 EAL: Detected lcore 1 as core 1 on socket 0 00:05:34.582 EAL: Detected lcore 2 as core 2 on socket 0 00:05:34.582 EAL: Detected lcore 3 as core 3 on socket 0 00:05:34.582 EAL: Detected lcore 4 as core 4 on socket 0 00:05:34.582 EAL: Detected lcore 5 as core 5 on socket 0 00:05:34.582 EAL: Detected lcore 6 as core 8 on socket 0 00:05:34.582 EAL: Detected lcore 7 as core 9 on socket 0 00:05:34.582 EAL: Detected lcore 8 as core 10 on socket 0 00:05:34.582 EAL: Detected lcore 9 as core 11 on socket 0 00:05:34.582 EAL: Detected lcore 10 as core 12 on socket 0 00:05:34.582 EAL: Detected lcore 11 as core 13 on socket 0 00:05:34.582 EAL: Detected lcore 12 as core 0 on socket 1 00:05:34.583 EAL: Detected lcore 13 as core 1 on socket 1 00:05:34.583 EAL: Detected lcore 14 as core 2 on socket 1 00:05:34.583 EAL: Detected lcore 15 as core 3 on socket 1 00:05:34.583 EAL: Detected lcore 16 as core 4 on socket 1 00:05:34.583 EAL: Detected lcore 17 as core 5 on socket 1 00:05:34.583 EAL: Detected lcore 18 as core 8 on socket 1 00:05:34.583 EAL: Detected lcore 19 as core 9 on socket 1 00:05:34.583 EAL: Detected lcore 20 as core 10 on socket 1 00:05:34.583 EAL: Detected lcore 21 as core 11 on socket 1 00:05:34.583 EAL: Detected lcore 22 as core 12 on socket 1 00:05:34.583 EAL: Detected lcore 23 as core 13 on socket 1 00:05:34.583 EAL: Detected lcore 24 as core 0 on socket 0 00:05:34.583 EAL: Detected lcore 25 as core 1 on socket 0 00:05:34.583 EAL: Detected lcore 26 as core 2 on socket 0 00:05:34.583 EAL: Detected lcore 27 as core 3 on socket 0 00:05:34.583 EAL: Detected lcore 28 as core 4 on socket 0 00:05:34.583 EAL: Detected lcore 29 as core 5 on socket 0 00:05:34.583 EAL: Detected lcore 30 as core 8 on socket 0 00:05:34.583 EAL: Detected lcore 31 as core 9 on socket 0 00:05:34.583 EAL: Detected lcore 32 as core 10 on socket 0 00:05:34.583 EAL: Detected lcore 33 as core 11 on socket 0 00:05:34.583 EAL: Detected lcore 34 as core 12 on socket 0 00:05:34.583 EAL: Detected lcore 35 as core 13 on socket 0 00:05:34.583 EAL: Detected lcore 36 as core 0 on socket 1 00:05:34.583 EAL: Detected lcore 37 as core 1 on socket 1 00:05:34.583 EAL: Detected lcore 38 as core 2 on socket 1 00:05:34.583 EAL: Detected lcore 39 as core 3 on socket 1 00:05:34.583 EAL: Detected lcore 40 as core 4 on socket 1 00:05:34.583 EAL: Detected lcore 41 as core 5 on socket 1 00:05:34.583 EAL: Detected lcore 42 as core 8 on socket 1 00:05:34.583 EAL: Detected lcore 43 as core 9 on socket 1 00:05:34.583 EAL: Detected lcore 44 as core 10 on socket 1 00:05:34.583 EAL: Detected lcore 45 as core 11 on socket 1 00:05:34.583 EAL: Detected lcore 46 as core 12 on socket 1 00:05:34.583 EAL: Detected lcore 47 as core 13 on socket 1 00:05:34.583 EAL: Maximum logical cores by configuration: 128 00:05:34.583 EAL: Detected CPU lcores: 48 00:05:34.583 EAL: Detected NUMA nodes: 2 00:05:34.583 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:34.583 EAL: Detected shared linkage of DPDK 00:05:34.583 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24.0 00:05:34.583 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24.0 00:05:34.583 EAL: Registered [vdev] bus. 00:05:34.583 EAL: bus.vdev log level changed from disabled to notice 00:05:34.583 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24.0 00:05:34.583 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24.0 00:05:34.583 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:34.583 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:34.583 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:05:34.583 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:05:34.583 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:05:34.583 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:05:34.583 EAL: No shared files mode enabled, IPC will be disabled 00:05:34.583 EAL: No shared files mode enabled, IPC is disabled 00:05:34.583 EAL: Bus pci wants IOVA as 'DC' 00:05:34.583 EAL: Bus vdev wants IOVA as 'DC' 00:05:34.583 EAL: Buses did not request a specific IOVA mode. 00:05:34.583 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:34.583 EAL: Selected IOVA mode 'VA' 00:05:34.583 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.583 EAL: Probing VFIO support... 00:05:34.583 EAL: IOMMU type 1 (Type 1) is supported 00:05:34.583 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:34.583 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:34.583 EAL: VFIO support initialized 00:05:34.583 EAL: Ask a virtual area of 0x2e000 bytes 00:05:34.583 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:34.583 EAL: Setting up physically contiguous memory... 00:05:34.583 EAL: Setting maximum number of open files to 524288 00:05:34.583 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:34.583 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:34.583 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:34.583 EAL: Ask a virtual area of 0x61000 bytes 00:05:34.583 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:34.583 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:34.583 EAL: Ask a virtual area of 0x400000000 bytes 00:05:34.583 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:34.583 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:34.583 EAL: Ask a virtual area of 0x61000 bytes 00:05:34.583 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:34.583 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:34.583 EAL: Ask a virtual area of 0x400000000 bytes 00:05:34.583 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:34.583 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:34.583 EAL: Ask a virtual area of 0x61000 bytes 00:05:34.583 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:34.583 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:34.583 EAL: Ask a virtual area of 0x400000000 bytes 00:05:34.583 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:34.583 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:34.583 EAL: Ask a virtual area of 0x61000 bytes 00:05:34.583 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:34.583 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:34.583 EAL: Ask a virtual area of 0x400000000 bytes 00:05:34.583 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:34.583 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:34.583 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:34.583 EAL: Ask a virtual area of 0x61000 bytes 00:05:34.583 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:34.583 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:34.583 EAL: Ask a virtual area of 0x400000000 bytes 00:05:34.583 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:34.583 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:34.583 EAL: Ask a virtual area of 0x61000 bytes 00:05:34.583 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:34.583 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:34.583 EAL: Ask a virtual area of 0x400000000 bytes 00:05:34.583 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:34.583 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:34.583 EAL: Ask a virtual area of 0x61000 bytes 00:05:34.583 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:34.583 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:34.583 EAL: Ask a virtual area of 0x400000000 bytes 00:05:34.583 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:34.583 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:34.583 EAL: Ask a virtual area of 0x61000 bytes 00:05:34.583 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:34.583 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:34.583 EAL: Ask a virtual area of 0x400000000 bytes 00:05:34.583 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:34.583 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:34.583 EAL: Hugepages will be freed exactly as allocated. 00:05:34.583 EAL: No shared files mode enabled, IPC is disabled 00:05:34.583 EAL: No shared files mode enabled, IPC is disabled 00:05:34.583 EAL: TSC frequency is ~2700000 KHz 00:05:34.583 EAL: Main lcore 0 is ready (tid=7f97d28fca00;cpuset=[0]) 00:05:34.583 EAL: Trying to obtain current memory policy. 00:05:34.583 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.583 EAL: Restoring previous memory policy: 0 00:05:34.583 EAL: request: mp_malloc_sync 00:05:34.583 EAL: No shared files mode enabled, IPC is disabled 00:05:34.583 EAL: Heap on socket 0 was expanded by 2MB 00:05:34.583 EAL: No shared files mode enabled, IPC is disabled 00:05:34.583 EAL: No shared files mode enabled, IPC is disabled 00:05:34.583 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:34.583 EAL: Mem event callback 'spdk:(nil)' registered 00:05:34.583 00:05:34.583 00:05:34.583 CUnit - A unit testing framework for C - Version 2.1-3 00:05:34.583 http://cunit.sourceforge.net/ 00:05:34.583 00:05:34.583 00:05:34.583 Suite: components_suite 00:05:34.583 Test: vtophys_malloc_test ...passed 00:05:34.583 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:34.583 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.583 EAL: Restoring previous memory policy: 4 00:05:34.583 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.583 EAL: request: mp_malloc_sync 00:05:34.583 EAL: No shared files mode enabled, IPC is disabled 00:05:34.583 EAL: Heap on socket 0 was expanded by 4MB 00:05:34.583 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.583 EAL: request: mp_malloc_sync 00:05:34.583 EAL: No shared files mode enabled, IPC is disabled 00:05:34.583 EAL: Heap on socket 0 was shrunk by 4MB 00:05:34.583 EAL: Trying to obtain current memory policy. 00:05:34.583 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.583 EAL: Restoring previous memory policy: 4 00:05:34.583 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.583 EAL: request: mp_malloc_sync 00:05:34.584 EAL: No shared files mode enabled, IPC is disabled 00:05:34.584 EAL: Heap on socket 0 was expanded by 6MB 00:05:34.584 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.584 EAL: request: mp_malloc_sync 00:05:34.584 EAL: No shared files mode enabled, IPC is disabled 00:05:34.584 EAL: Heap on socket 0 was shrunk by 6MB 00:05:34.584 EAL: Trying to obtain current memory policy. 00:05:34.584 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.584 EAL: Restoring previous memory policy: 4 00:05:34.584 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.584 EAL: request: mp_malloc_sync 00:05:34.584 EAL: No shared files mode enabled, IPC is disabled 00:05:34.584 EAL: Heap on socket 0 was expanded by 10MB 00:05:34.584 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.584 EAL: request: mp_malloc_sync 00:05:34.584 EAL: No shared files mode enabled, IPC is disabled 00:05:34.584 EAL: Heap on socket 0 was shrunk by 10MB 00:05:34.584 EAL: Trying to obtain current memory policy. 00:05:34.584 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.584 EAL: Restoring previous memory policy: 4 00:05:34.584 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.584 EAL: request: mp_malloc_sync 00:05:34.584 EAL: No shared files mode enabled, IPC is disabled 00:05:34.584 EAL: Heap on socket 0 was expanded by 18MB 00:05:34.584 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.584 EAL: request: mp_malloc_sync 00:05:34.584 EAL: No shared files mode enabled, IPC is disabled 00:05:34.584 EAL: Heap on socket 0 was shrunk by 18MB 00:05:34.584 EAL: Trying to obtain current memory policy. 00:05:34.584 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.584 EAL: Restoring previous memory policy: 4 00:05:34.584 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.584 EAL: request: mp_malloc_sync 00:05:34.584 EAL: No shared files mode enabled, IPC is disabled 00:05:34.584 EAL: Heap on socket 0 was expanded by 34MB 00:05:34.584 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.584 EAL: request: mp_malloc_sync 00:05:34.584 EAL: No shared files mode enabled, IPC is disabled 00:05:34.584 EAL: Heap on socket 0 was shrunk by 34MB 00:05:34.584 EAL: Trying to obtain current memory policy. 00:05:34.584 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.584 EAL: Restoring previous memory policy: 4 00:05:34.584 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.584 EAL: request: mp_malloc_sync 00:05:34.584 EAL: No shared files mode enabled, IPC is disabled 00:05:34.584 EAL: Heap on socket 0 was expanded by 66MB 00:05:34.584 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.584 EAL: request: mp_malloc_sync 00:05:34.584 EAL: No shared files mode enabled, IPC is disabled 00:05:34.584 EAL: Heap on socket 0 was shrunk by 66MB 00:05:34.584 EAL: Trying to obtain current memory policy. 00:05:34.584 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.584 EAL: Restoring previous memory policy: 4 00:05:34.584 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.584 EAL: request: mp_malloc_sync 00:05:34.584 EAL: No shared files mode enabled, IPC is disabled 00:05:34.584 EAL: Heap on socket 0 was expanded by 130MB 00:05:34.842 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.842 EAL: request: mp_malloc_sync 00:05:34.842 EAL: No shared files mode enabled, IPC is disabled 00:05:34.842 EAL: Heap on socket 0 was shrunk by 130MB 00:05:34.842 EAL: Trying to obtain current memory policy. 00:05:34.842 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.842 EAL: Restoring previous memory policy: 4 00:05:34.842 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.842 EAL: request: mp_malloc_sync 00:05:34.842 EAL: No shared files mode enabled, IPC is disabled 00:05:34.842 EAL: Heap on socket 0 was expanded by 258MB 00:05:34.842 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.842 EAL: request: mp_malloc_sync 00:05:34.842 EAL: No shared files mode enabled, IPC is disabled 00:05:34.842 EAL: Heap on socket 0 was shrunk by 258MB 00:05:34.842 EAL: Trying to obtain current memory policy. 00:05:34.842 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:35.100 EAL: Restoring previous memory policy: 4 00:05:35.100 EAL: Calling mem event callback 'spdk:(nil)' 00:05:35.100 EAL: request: mp_malloc_sync 00:05:35.100 EAL: No shared files mode enabled, IPC is disabled 00:05:35.100 EAL: Heap on socket 0 was expanded by 514MB 00:05:35.100 EAL: Calling mem event callback 'spdk:(nil)' 00:05:35.358 EAL: request: mp_malloc_sync 00:05:35.358 EAL: No shared files mode enabled, IPC is disabled 00:05:35.358 EAL: Heap on socket 0 was shrunk by 514MB 00:05:35.358 EAL: Trying to obtain current memory policy. 00:05:35.358 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:35.615 EAL: Restoring previous memory policy: 4 00:05:35.615 EAL: Calling mem event callback 'spdk:(nil)' 00:05:35.615 EAL: request: mp_malloc_sync 00:05:35.615 EAL: No shared files mode enabled, IPC is disabled 00:05:35.615 EAL: Heap on socket 0 was expanded by 1026MB 00:05:35.872 EAL: Calling mem event callback 'spdk:(nil)' 00:05:35.872 EAL: request: mp_malloc_sync 00:05:35.872 EAL: No shared files mode enabled, IPC is disabled 00:05:35.872 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:35.872 passed 00:05:35.872 00:05:35.872 Run Summary: Type Total Ran Passed Failed Inactive 00:05:35.872 suites 1 1 n/a 0 0 00:05:35.872 tests 2 2 2 0 0 00:05:35.872 asserts 497 497 497 0 n/a 00:05:35.872 00:05:35.872 Elapsed time = 1.357 seconds 00:05:35.872 EAL: Calling mem event callback 'spdk:(nil)' 00:05:35.872 EAL: request: mp_malloc_sync 00:05:35.872 EAL: No shared files mode enabled, IPC is disabled 00:05:35.872 EAL: Heap on socket 0 was shrunk by 2MB 00:05:35.872 EAL: No shared files mode enabled, IPC is disabled 00:05:35.872 EAL: No shared files mode enabled, IPC is disabled 00:05:35.872 EAL: No shared files mode enabled, IPC is disabled 00:05:36.130 00:05:36.130 real 0m1.481s 00:05:36.130 user 0m0.836s 00:05:36.130 sys 0m0.606s 00:05:36.130 15:51:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.130 15:51:59 -- common/autotest_common.sh@10 -- # set +x 00:05:36.130 ************************************ 00:05:36.130 END TEST env_vtophys 00:05:36.130 ************************************ 00:05:36.130 15:51:59 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:36.130 15:51:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.130 15:51:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.130 15:51:59 -- common/autotest_common.sh@10 -- # set +x 00:05:36.130 ************************************ 00:05:36.130 START TEST env_pci 00:05:36.130 ************************************ 00:05:36.130 15:51:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:36.130 00:05:36.130 00:05:36.130 CUnit - A unit testing framework for C - Version 2.1-3 00:05:36.130 http://cunit.sourceforge.net/ 00:05:36.130 00:05:36.130 00:05:36.130 Suite: pci 00:05:36.130 Test: pci_hook ...[2024-11-18 15:51:59.497002] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1457800 has claimed it 00:05:36.130 EAL: Cannot find device (10000:00:01.0) 00:05:36.130 EAL: Failed to attach device on primary process 00:05:36.130 passed 00:05:36.130 00:05:36.130 Run Summary: Type Total Ran Passed Failed Inactive 00:05:36.130 suites 1 1 n/a 0 0 00:05:36.130 tests 1 1 1 0 0 00:05:36.130 asserts 25 25 25 0 n/a 00:05:36.130 00:05:36.130 Elapsed time = 0.021 seconds 00:05:36.130 00:05:36.130 real 0m0.033s 00:05:36.130 user 0m0.012s 00:05:36.130 sys 0m0.021s 00:05:36.130 15:51:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.130 15:51:59 -- common/autotest_common.sh@10 -- # set +x 00:05:36.130 ************************************ 00:05:36.130 END TEST env_pci 00:05:36.130 ************************************ 00:05:36.130 15:51:59 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:36.130 15:51:59 -- env/env.sh@15 -- # uname 00:05:36.130 15:51:59 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:36.130 15:51:59 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:36.130 15:51:59 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:36.130 15:51:59 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:36.130 15:51:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.130 15:51:59 -- common/autotest_common.sh@10 -- # set +x 00:05:36.130 ************************************ 00:05:36.130 START TEST env_dpdk_post_init 00:05:36.130 ************************************ 00:05:36.130 15:51:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:36.130 EAL: Detected CPU lcores: 48 00:05:36.130 EAL: Detected NUMA nodes: 2 00:05:36.130 EAL: Detected shared linkage of DPDK 00:05:36.130 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:36.130 EAL: Selected IOVA mode 'VA' 00:05:36.130 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.130 EAL: VFIO support initialized 00:05:36.130 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:36.130 EAL: Using IOMMU type 1 (Type 1) 00:05:36.130 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:36.130 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:36.130 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:36.130 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:36.130 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:36.388 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:36.388 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:36.388 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:36.388 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:36.388 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:36.388 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:36.388 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:36.388 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:36.388 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:36.388 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:36.388 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:37.321 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:40.601 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:40.601 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:40.601 Starting DPDK initialization... 00:05:40.601 Starting SPDK post initialization... 00:05:40.601 SPDK NVMe probe 00:05:40.601 Attaching to 0000:88:00.0 00:05:40.601 Attached to 0000:88:00.0 00:05:40.601 Cleaning up... 00:05:40.601 00:05:40.601 real 0m4.396s 00:05:40.601 user 0m3.254s 00:05:40.601 sys 0m0.200s 00:05:40.601 15:52:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.601 15:52:03 -- common/autotest_common.sh@10 -- # set +x 00:05:40.601 ************************************ 00:05:40.601 END TEST env_dpdk_post_init 00:05:40.601 ************************************ 00:05:40.601 15:52:03 -- env/env.sh@26 -- # uname 00:05:40.601 15:52:03 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:40.601 15:52:03 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:40.601 15:52:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.601 15:52:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.601 15:52:03 -- common/autotest_common.sh@10 -- # set +x 00:05:40.601 ************************************ 00:05:40.601 START TEST env_mem_callbacks 00:05:40.601 ************************************ 00:05:40.601 15:52:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:40.601 EAL: Detected CPU lcores: 48 00:05:40.601 EAL: Detected NUMA nodes: 2 00:05:40.601 EAL: Detected shared linkage of DPDK 00:05:40.601 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:40.601 EAL: Selected IOVA mode 'VA' 00:05:40.601 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.601 EAL: VFIO support initialized 00:05:40.601 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:40.601 00:05:40.601 00:05:40.601 CUnit - A unit testing framework for C - Version 2.1-3 00:05:40.601 http://cunit.sourceforge.net/ 00:05:40.601 00:05:40.601 00:05:40.601 Suite: memory 00:05:40.601 Test: test ... 00:05:40.601 register 0x200000200000 2097152 00:05:40.601 malloc 3145728 00:05:40.601 register 0x200000400000 4194304 00:05:40.601 buf 0x200000500000 len 3145728 PASSED 00:05:40.601 malloc 64 00:05:40.601 buf 0x2000004fff40 len 64 PASSED 00:05:40.601 malloc 4194304 00:05:40.601 register 0x200000800000 6291456 00:05:40.601 buf 0x200000a00000 len 4194304 PASSED 00:05:40.601 free 0x200000500000 3145728 00:05:40.601 free 0x2000004fff40 64 00:05:40.601 unregister 0x200000400000 4194304 PASSED 00:05:40.601 free 0x200000a00000 4194304 00:05:40.601 unregister 0x200000800000 6291456 PASSED 00:05:40.601 malloc 8388608 00:05:40.601 register 0x200000400000 10485760 00:05:40.601 buf 0x200000600000 len 8388608 PASSED 00:05:40.601 free 0x200000600000 8388608 00:05:40.601 unregister 0x200000400000 10485760 PASSED 00:05:40.601 passed 00:05:40.601 00:05:40.601 Run Summary: Type Total Ran Passed Failed Inactive 00:05:40.601 suites 1 1 n/a 0 0 00:05:40.601 tests 1 1 1 0 0 00:05:40.601 asserts 15 15 15 0 n/a 00:05:40.601 00:05:40.601 Elapsed time = 0.005 seconds 00:05:40.601 00:05:40.601 real 0m0.047s 00:05:40.601 user 0m0.009s 00:05:40.601 sys 0m0.037s 00:05:40.601 15:52:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.602 15:52:04 -- common/autotest_common.sh@10 -- # set +x 00:05:40.602 ************************************ 00:05:40.602 END TEST env_mem_callbacks 00:05:40.602 ************************************ 00:05:40.602 00:05:40.602 real 0m6.377s 00:05:40.602 user 0m4.395s 00:05:40.602 sys 0m1.029s 00:05:40.602 15:52:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.602 15:52:04 -- common/autotest_common.sh@10 -- # set +x 00:05:40.602 ************************************ 00:05:40.602 END TEST env 00:05:40.602 ************************************ 00:05:40.602 15:52:04 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:40.602 15:52:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.602 15:52:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.602 15:52:04 -- common/autotest_common.sh@10 -- # set +x 00:05:40.602 ************************************ 00:05:40.602 START TEST rpc 00:05:40.602 ************************************ 00:05:40.602 15:52:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:40.602 * Looking for test storage... 00:05:40.602 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:40.602 15:52:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:40.602 15:52:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:40.602 15:52:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:40.602 15:52:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:40.602 15:52:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:40.602 15:52:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:40.602 15:52:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:40.602 15:52:04 -- scripts/common.sh@335 -- # IFS=.-: 00:05:40.602 15:52:04 -- scripts/common.sh@335 -- # read -ra ver1 00:05:40.602 15:52:04 -- scripts/common.sh@336 -- # IFS=.-: 00:05:40.602 15:52:04 -- scripts/common.sh@336 -- # read -ra ver2 00:05:40.602 15:52:04 -- scripts/common.sh@337 -- # local 'op=<' 00:05:40.602 15:52:04 -- scripts/common.sh@339 -- # ver1_l=2 00:05:40.602 15:52:04 -- scripts/common.sh@340 -- # ver2_l=1 00:05:40.602 15:52:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:40.861 15:52:04 -- scripts/common.sh@343 -- # case "$op" in 00:05:40.861 15:52:04 -- scripts/common.sh@344 -- # : 1 00:05:40.861 15:52:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:40.861 15:52:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:40.861 15:52:04 -- scripts/common.sh@364 -- # decimal 1 00:05:40.861 15:52:04 -- scripts/common.sh@352 -- # local d=1 00:05:40.861 15:52:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:40.861 15:52:04 -- scripts/common.sh@354 -- # echo 1 00:05:40.861 15:52:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:40.861 15:52:04 -- scripts/common.sh@365 -- # decimal 2 00:05:40.861 15:52:04 -- scripts/common.sh@352 -- # local d=2 00:05:40.861 15:52:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:40.861 15:52:04 -- scripts/common.sh@354 -- # echo 2 00:05:40.861 15:52:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:40.861 15:52:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:40.861 15:52:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:40.861 15:52:04 -- scripts/common.sh@367 -- # return 0 00:05:40.861 15:52:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:40.861 15:52:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:40.861 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.861 --rc genhtml_branch_coverage=1 00:05:40.861 --rc genhtml_function_coverage=1 00:05:40.861 --rc genhtml_legend=1 00:05:40.861 --rc geninfo_all_blocks=1 00:05:40.861 --rc geninfo_unexecuted_blocks=1 00:05:40.861 00:05:40.861 ' 00:05:40.861 15:52:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:40.861 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.861 --rc genhtml_branch_coverage=1 00:05:40.861 --rc genhtml_function_coverage=1 00:05:40.861 --rc genhtml_legend=1 00:05:40.861 --rc geninfo_all_blocks=1 00:05:40.861 --rc geninfo_unexecuted_blocks=1 00:05:40.861 00:05:40.861 ' 00:05:40.861 15:52:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:40.861 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.861 --rc genhtml_branch_coverage=1 00:05:40.861 --rc genhtml_function_coverage=1 00:05:40.861 --rc genhtml_legend=1 00:05:40.861 --rc geninfo_all_blocks=1 00:05:40.861 --rc geninfo_unexecuted_blocks=1 00:05:40.861 00:05:40.861 ' 00:05:40.861 15:52:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:40.861 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:40.861 --rc genhtml_branch_coverage=1 00:05:40.861 --rc genhtml_function_coverage=1 00:05:40.861 --rc genhtml_legend=1 00:05:40.861 --rc geninfo_all_blocks=1 00:05:40.861 --rc geninfo_unexecuted_blocks=1 00:05:40.861 00:05:40.861 ' 00:05:40.861 15:52:04 -- rpc/rpc.sh@65 -- # spdk_pid=1458476 00:05:40.861 15:52:04 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:40.861 15:52:04 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:40.861 15:52:04 -- rpc/rpc.sh@67 -- # waitforlisten 1458476 00:05:40.861 15:52:04 -- common/autotest_common.sh@829 -- # '[' -z 1458476 ']' 00:05:40.861 15:52:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:40.861 15:52:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:40.861 15:52:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:40.861 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:40.861 15:52:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:40.861 15:52:04 -- common/autotest_common.sh@10 -- # set +x 00:05:40.861 [2024-11-18 15:52:04.248283] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.861 [2024-11-18 15:52:04.248365] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1458476 ] 00:05:40.861 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.861 [2024-11-18 15:52:04.305119] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.861 [2024-11-18 15:52:04.391150] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:40.861 [2024-11-18 15:52:04.391323] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:40.861 [2024-11-18 15:52:04.391339] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1458476' to capture a snapshot of events at runtime. 00:05:40.861 [2024-11-18 15:52:04.391351] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1458476 for offline analysis/debug. 00:05:40.861 [2024-11-18 15:52:04.391385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.796 15:52:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:41.796 15:52:05 -- common/autotest_common.sh@862 -- # return 0 00:05:41.796 15:52:05 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:41.796 15:52:05 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:41.796 15:52:05 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:41.796 15:52:05 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:41.796 15:52:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.796 15:52:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.796 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:41.796 ************************************ 00:05:41.796 START TEST rpc_integrity 00:05:41.796 ************************************ 00:05:41.796 15:52:05 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:41.796 15:52:05 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:41.796 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.796 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:41.796 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.796 15:52:05 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:41.796 15:52:05 -- rpc/rpc.sh@13 -- # jq length 00:05:41.796 15:52:05 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:41.796 15:52:05 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:41.796 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.796 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:41.796 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.796 15:52:05 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:41.796 15:52:05 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:41.796 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.796 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:41.796 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.796 15:52:05 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:41.796 { 00:05:41.796 "name": "Malloc0", 00:05:41.796 "aliases": [ 00:05:41.796 "f87da231-bd66-423e-8b18-5b06a87058fe" 00:05:41.796 ], 00:05:41.796 "product_name": "Malloc disk", 00:05:41.796 "block_size": 512, 00:05:41.796 "num_blocks": 16384, 00:05:41.796 "uuid": "f87da231-bd66-423e-8b18-5b06a87058fe", 00:05:41.796 "assigned_rate_limits": { 00:05:41.796 "rw_ios_per_sec": 0, 00:05:41.796 "rw_mbytes_per_sec": 0, 00:05:41.797 "r_mbytes_per_sec": 0, 00:05:41.797 "w_mbytes_per_sec": 0 00:05:41.797 }, 00:05:41.797 "claimed": false, 00:05:41.797 "zoned": false, 00:05:41.797 "supported_io_types": { 00:05:41.797 "read": true, 00:05:41.797 "write": true, 00:05:41.797 "unmap": true, 00:05:41.797 "write_zeroes": true, 00:05:41.797 "flush": true, 00:05:41.797 "reset": true, 00:05:41.797 "compare": false, 00:05:41.797 "compare_and_write": false, 00:05:41.797 "abort": true, 00:05:41.797 "nvme_admin": false, 00:05:41.797 "nvme_io": false 00:05:41.797 }, 00:05:41.797 "memory_domains": [ 00:05:41.797 { 00:05:41.797 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.797 "dma_device_type": 2 00:05:41.797 } 00:05:41.797 ], 00:05:41.797 "driver_specific": {} 00:05:41.797 } 00:05:41.797 ]' 00:05:41.797 15:52:05 -- rpc/rpc.sh@17 -- # jq length 00:05:41.797 15:52:05 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:41.797 15:52:05 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:41.797 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.797 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:41.797 [2024-11-18 15:52:05.303509] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:41.797 [2024-11-18 15:52:05.303556] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:41.797 [2024-11-18 15:52:05.303582] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xad5bf0 00:05:41.797 [2024-11-18 15:52:05.303598] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:41.797 [2024-11-18 15:52:05.305054] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:41.797 [2024-11-18 15:52:05.305082] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:41.797 Passthru0 00:05:41.797 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.797 15:52:05 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:41.797 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.797 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:41.797 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.797 15:52:05 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:41.797 { 00:05:41.797 "name": "Malloc0", 00:05:41.797 "aliases": [ 00:05:41.797 "f87da231-bd66-423e-8b18-5b06a87058fe" 00:05:41.797 ], 00:05:41.797 "product_name": "Malloc disk", 00:05:41.797 "block_size": 512, 00:05:41.797 "num_blocks": 16384, 00:05:41.797 "uuid": "f87da231-bd66-423e-8b18-5b06a87058fe", 00:05:41.797 "assigned_rate_limits": { 00:05:41.797 "rw_ios_per_sec": 0, 00:05:41.797 "rw_mbytes_per_sec": 0, 00:05:41.797 "r_mbytes_per_sec": 0, 00:05:41.797 "w_mbytes_per_sec": 0 00:05:41.797 }, 00:05:41.797 "claimed": true, 00:05:41.797 "claim_type": "exclusive_write", 00:05:41.797 "zoned": false, 00:05:41.797 "supported_io_types": { 00:05:41.797 "read": true, 00:05:41.797 "write": true, 00:05:41.797 "unmap": true, 00:05:41.797 "write_zeroes": true, 00:05:41.797 "flush": true, 00:05:41.797 "reset": true, 00:05:41.797 "compare": false, 00:05:41.797 "compare_and_write": false, 00:05:41.797 "abort": true, 00:05:41.797 "nvme_admin": false, 00:05:41.797 "nvme_io": false 00:05:41.797 }, 00:05:41.797 "memory_domains": [ 00:05:41.797 { 00:05:41.797 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.797 "dma_device_type": 2 00:05:41.797 } 00:05:41.797 ], 00:05:41.797 "driver_specific": {} 00:05:41.797 }, 00:05:41.797 { 00:05:41.797 "name": "Passthru0", 00:05:41.797 "aliases": [ 00:05:41.797 "2901ab98-8d6d-5429-a763-f8524d831822" 00:05:41.797 ], 00:05:41.797 "product_name": "passthru", 00:05:41.797 "block_size": 512, 00:05:41.797 "num_blocks": 16384, 00:05:41.797 "uuid": "2901ab98-8d6d-5429-a763-f8524d831822", 00:05:41.797 "assigned_rate_limits": { 00:05:41.797 "rw_ios_per_sec": 0, 00:05:41.797 "rw_mbytes_per_sec": 0, 00:05:41.797 "r_mbytes_per_sec": 0, 00:05:41.797 "w_mbytes_per_sec": 0 00:05:41.797 }, 00:05:41.797 "claimed": false, 00:05:41.797 "zoned": false, 00:05:41.797 "supported_io_types": { 00:05:41.797 "read": true, 00:05:41.797 "write": true, 00:05:41.797 "unmap": true, 00:05:41.797 "write_zeroes": true, 00:05:41.797 "flush": true, 00:05:41.797 "reset": true, 00:05:41.797 "compare": false, 00:05:41.797 "compare_and_write": false, 00:05:41.797 "abort": true, 00:05:41.797 "nvme_admin": false, 00:05:41.797 "nvme_io": false 00:05:41.797 }, 00:05:41.797 "memory_domains": [ 00:05:41.797 { 00:05:41.797 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.797 "dma_device_type": 2 00:05:41.797 } 00:05:41.797 ], 00:05:41.797 "driver_specific": { 00:05:41.797 "passthru": { 00:05:41.797 "name": "Passthru0", 00:05:41.797 "base_bdev_name": "Malloc0" 00:05:41.797 } 00:05:41.797 } 00:05:41.797 } 00:05:41.797 ]' 00:05:41.797 15:52:05 -- rpc/rpc.sh@21 -- # jq length 00:05:41.797 15:52:05 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:41.797 15:52:05 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:41.797 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.797 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:41.797 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.797 15:52:05 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:41.797 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.797 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:41.797 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.797 15:52:05 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:41.797 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.797 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:41.797 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.797 15:52:05 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:41.797 15:52:05 -- rpc/rpc.sh@26 -- # jq length 00:05:42.055 15:52:05 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:42.055 00:05:42.055 real 0m0.228s 00:05:42.055 user 0m0.154s 00:05:42.055 sys 0m0.017s 00:05:42.055 15:52:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.055 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.055 ************************************ 00:05:42.055 END TEST rpc_integrity 00:05:42.055 ************************************ 00:05:42.055 15:52:05 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:42.055 15:52:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:42.055 15:52:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.055 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.055 ************************************ 00:05:42.055 START TEST rpc_plugins 00:05:42.055 ************************************ 00:05:42.055 15:52:05 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:42.055 15:52:05 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:42.055 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.055 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.055 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.055 15:52:05 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:42.055 15:52:05 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:42.055 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.055 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.055 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.055 15:52:05 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:42.055 { 00:05:42.055 "name": "Malloc1", 00:05:42.055 "aliases": [ 00:05:42.055 "0cf9315c-c64a-4a56-990c-d79859f7fdce" 00:05:42.055 ], 00:05:42.055 "product_name": "Malloc disk", 00:05:42.055 "block_size": 4096, 00:05:42.055 "num_blocks": 256, 00:05:42.055 "uuid": "0cf9315c-c64a-4a56-990c-d79859f7fdce", 00:05:42.055 "assigned_rate_limits": { 00:05:42.055 "rw_ios_per_sec": 0, 00:05:42.055 "rw_mbytes_per_sec": 0, 00:05:42.055 "r_mbytes_per_sec": 0, 00:05:42.055 "w_mbytes_per_sec": 0 00:05:42.055 }, 00:05:42.055 "claimed": false, 00:05:42.055 "zoned": false, 00:05:42.055 "supported_io_types": { 00:05:42.055 "read": true, 00:05:42.055 "write": true, 00:05:42.055 "unmap": true, 00:05:42.055 "write_zeroes": true, 00:05:42.055 "flush": true, 00:05:42.055 "reset": true, 00:05:42.055 "compare": false, 00:05:42.055 "compare_and_write": false, 00:05:42.055 "abort": true, 00:05:42.055 "nvme_admin": false, 00:05:42.055 "nvme_io": false 00:05:42.055 }, 00:05:42.055 "memory_domains": [ 00:05:42.055 { 00:05:42.055 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:42.055 "dma_device_type": 2 00:05:42.055 } 00:05:42.055 ], 00:05:42.055 "driver_specific": {} 00:05:42.055 } 00:05:42.055 ]' 00:05:42.055 15:52:05 -- rpc/rpc.sh@32 -- # jq length 00:05:42.055 15:52:05 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:42.055 15:52:05 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:42.055 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.055 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.055 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.055 15:52:05 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:42.055 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.055 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.055 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.055 15:52:05 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:42.055 15:52:05 -- rpc/rpc.sh@36 -- # jq length 00:05:42.055 15:52:05 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:42.055 00:05:42.055 real 0m0.111s 00:05:42.055 user 0m0.073s 00:05:42.055 sys 0m0.010s 00:05:42.055 15:52:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.055 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.055 ************************************ 00:05:42.055 END TEST rpc_plugins 00:05:42.055 ************************************ 00:05:42.055 15:52:05 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:42.055 15:52:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:42.055 15:52:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.055 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.055 ************************************ 00:05:42.055 START TEST rpc_trace_cmd_test 00:05:42.055 ************************************ 00:05:42.055 15:52:05 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:42.055 15:52:05 -- rpc/rpc.sh@40 -- # local info 00:05:42.055 15:52:05 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:42.056 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.056 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.056 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.056 15:52:05 -- rpc/rpc.sh@42 -- # info='{ 00:05:42.056 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1458476", 00:05:42.056 "tpoint_group_mask": "0x8", 00:05:42.056 "iscsi_conn": { 00:05:42.056 "mask": "0x2", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 }, 00:05:42.056 "scsi": { 00:05:42.056 "mask": "0x4", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 }, 00:05:42.056 "bdev": { 00:05:42.056 "mask": "0x8", 00:05:42.056 "tpoint_mask": "0xffffffffffffffff" 00:05:42.056 }, 00:05:42.056 "nvmf_rdma": { 00:05:42.056 "mask": "0x10", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 }, 00:05:42.056 "nvmf_tcp": { 00:05:42.056 "mask": "0x20", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 }, 00:05:42.056 "ftl": { 00:05:42.056 "mask": "0x40", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 }, 00:05:42.056 "blobfs": { 00:05:42.056 "mask": "0x80", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 }, 00:05:42.056 "dsa": { 00:05:42.056 "mask": "0x200", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 }, 00:05:42.056 "thread": { 00:05:42.056 "mask": "0x400", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 }, 00:05:42.056 "nvme_pcie": { 00:05:42.056 "mask": "0x800", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 }, 00:05:42.056 "iaa": { 00:05:42.056 "mask": "0x1000", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 }, 00:05:42.056 "nvme_tcp": { 00:05:42.056 "mask": "0x2000", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 }, 00:05:42.056 "bdev_nvme": { 00:05:42.056 "mask": "0x4000", 00:05:42.056 "tpoint_mask": "0x0" 00:05:42.056 } 00:05:42.056 }' 00:05:42.056 15:52:05 -- rpc/rpc.sh@43 -- # jq length 00:05:42.056 15:52:05 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:42.056 15:52:05 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:42.313 15:52:05 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:42.314 15:52:05 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:42.314 15:52:05 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:42.314 15:52:05 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:42.314 15:52:05 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:42.314 15:52:05 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:42.314 15:52:05 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:42.314 00:05:42.314 real 0m0.197s 00:05:42.314 user 0m0.174s 00:05:42.314 sys 0m0.016s 00:05:42.314 15:52:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.314 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.314 ************************************ 00:05:42.314 END TEST rpc_trace_cmd_test 00:05:42.314 ************************************ 00:05:42.314 15:52:05 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:42.314 15:52:05 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:42.314 15:52:05 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:42.314 15:52:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:42.314 15:52:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.314 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.314 ************************************ 00:05:42.314 START TEST rpc_daemon_integrity 00:05:42.314 ************************************ 00:05:42.314 15:52:05 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:42.314 15:52:05 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:42.314 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.314 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.314 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.314 15:52:05 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:42.314 15:52:05 -- rpc/rpc.sh@13 -- # jq length 00:05:42.314 15:52:05 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:42.314 15:52:05 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:42.314 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.314 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.314 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.314 15:52:05 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:42.314 15:52:05 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:42.314 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.314 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.314 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.314 15:52:05 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:42.314 { 00:05:42.314 "name": "Malloc2", 00:05:42.314 "aliases": [ 00:05:42.314 "77886b93-555c-4626-a50b-4546708016b1" 00:05:42.314 ], 00:05:42.314 "product_name": "Malloc disk", 00:05:42.314 "block_size": 512, 00:05:42.314 "num_blocks": 16384, 00:05:42.314 "uuid": "77886b93-555c-4626-a50b-4546708016b1", 00:05:42.314 "assigned_rate_limits": { 00:05:42.314 "rw_ios_per_sec": 0, 00:05:42.314 "rw_mbytes_per_sec": 0, 00:05:42.314 "r_mbytes_per_sec": 0, 00:05:42.314 "w_mbytes_per_sec": 0 00:05:42.314 }, 00:05:42.314 "claimed": false, 00:05:42.314 "zoned": false, 00:05:42.314 "supported_io_types": { 00:05:42.314 "read": true, 00:05:42.314 "write": true, 00:05:42.314 "unmap": true, 00:05:42.314 "write_zeroes": true, 00:05:42.314 "flush": true, 00:05:42.314 "reset": true, 00:05:42.314 "compare": false, 00:05:42.314 "compare_and_write": false, 00:05:42.314 "abort": true, 00:05:42.314 "nvme_admin": false, 00:05:42.314 "nvme_io": false 00:05:42.314 }, 00:05:42.314 "memory_domains": [ 00:05:42.314 { 00:05:42.314 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:42.314 "dma_device_type": 2 00:05:42.314 } 00:05:42.314 ], 00:05:42.314 "driver_specific": {} 00:05:42.314 } 00:05:42.314 ]' 00:05:42.314 15:52:05 -- rpc/rpc.sh@17 -- # jq length 00:05:42.572 15:52:05 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:42.572 15:52:05 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:42.572 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.572 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.572 [2024-11-18 15:52:05.909282] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:42.572 [2024-11-18 15:52:05.909332] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:42.572 [2024-11-18 15:52:05.909357] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xc75940 00:05:42.572 [2024-11-18 15:52:05.909373] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:42.572 [2024-11-18 15:52:05.910701] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:42.572 [2024-11-18 15:52:05.910727] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:42.573 Passthru0 00:05:42.573 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.573 15:52:05 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:42.573 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.573 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.573 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.573 15:52:05 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:42.573 { 00:05:42.573 "name": "Malloc2", 00:05:42.573 "aliases": [ 00:05:42.573 "77886b93-555c-4626-a50b-4546708016b1" 00:05:42.573 ], 00:05:42.573 "product_name": "Malloc disk", 00:05:42.573 "block_size": 512, 00:05:42.573 "num_blocks": 16384, 00:05:42.573 "uuid": "77886b93-555c-4626-a50b-4546708016b1", 00:05:42.573 "assigned_rate_limits": { 00:05:42.573 "rw_ios_per_sec": 0, 00:05:42.573 "rw_mbytes_per_sec": 0, 00:05:42.573 "r_mbytes_per_sec": 0, 00:05:42.573 "w_mbytes_per_sec": 0 00:05:42.573 }, 00:05:42.573 "claimed": true, 00:05:42.573 "claim_type": "exclusive_write", 00:05:42.573 "zoned": false, 00:05:42.573 "supported_io_types": { 00:05:42.573 "read": true, 00:05:42.573 "write": true, 00:05:42.573 "unmap": true, 00:05:42.573 "write_zeroes": true, 00:05:42.573 "flush": true, 00:05:42.573 "reset": true, 00:05:42.573 "compare": false, 00:05:42.573 "compare_and_write": false, 00:05:42.573 "abort": true, 00:05:42.573 "nvme_admin": false, 00:05:42.573 "nvme_io": false 00:05:42.573 }, 00:05:42.573 "memory_domains": [ 00:05:42.573 { 00:05:42.573 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:42.573 "dma_device_type": 2 00:05:42.573 } 00:05:42.573 ], 00:05:42.573 "driver_specific": {} 00:05:42.573 }, 00:05:42.573 { 00:05:42.573 "name": "Passthru0", 00:05:42.573 "aliases": [ 00:05:42.573 "2b7ebd30-02ba-5fde-9e6e-3833c68f981f" 00:05:42.573 ], 00:05:42.573 "product_name": "passthru", 00:05:42.573 "block_size": 512, 00:05:42.573 "num_blocks": 16384, 00:05:42.573 "uuid": "2b7ebd30-02ba-5fde-9e6e-3833c68f981f", 00:05:42.573 "assigned_rate_limits": { 00:05:42.573 "rw_ios_per_sec": 0, 00:05:42.573 "rw_mbytes_per_sec": 0, 00:05:42.573 "r_mbytes_per_sec": 0, 00:05:42.573 "w_mbytes_per_sec": 0 00:05:42.573 }, 00:05:42.573 "claimed": false, 00:05:42.573 "zoned": false, 00:05:42.573 "supported_io_types": { 00:05:42.573 "read": true, 00:05:42.573 "write": true, 00:05:42.573 "unmap": true, 00:05:42.573 "write_zeroes": true, 00:05:42.573 "flush": true, 00:05:42.573 "reset": true, 00:05:42.573 "compare": false, 00:05:42.573 "compare_and_write": false, 00:05:42.573 "abort": true, 00:05:42.573 "nvme_admin": false, 00:05:42.573 "nvme_io": false 00:05:42.573 }, 00:05:42.573 "memory_domains": [ 00:05:42.573 { 00:05:42.573 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:42.573 "dma_device_type": 2 00:05:42.573 } 00:05:42.573 ], 00:05:42.573 "driver_specific": { 00:05:42.573 "passthru": { 00:05:42.573 "name": "Passthru0", 00:05:42.573 "base_bdev_name": "Malloc2" 00:05:42.573 } 00:05:42.573 } 00:05:42.573 } 00:05:42.573 ]' 00:05:42.573 15:52:05 -- rpc/rpc.sh@21 -- # jq length 00:05:42.573 15:52:05 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:42.573 15:52:05 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:42.573 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.573 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.573 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.573 15:52:05 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:42.573 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.573 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.573 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.573 15:52:05 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:42.573 15:52:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.573 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.573 15:52:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.573 15:52:05 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:42.573 15:52:05 -- rpc/rpc.sh@26 -- # jq length 00:05:42.573 15:52:06 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:42.573 00:05:42.573 real 0m0.220s 00:05:42.573 user 0m0.150s 00:05:42.573 sys 0m0.018s 00:05:42.573 15:52:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.573 15:52:06 -- common/autotest_common.sh@10 -- # set +x 00:05:42.573 ************************************ 00:05:42.573 END TEST rpc_daemon_integrity 00:05:42.573 ************************************ 00:05:42.573 15:52:06 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:42.573 15:52:06 -- rpc/rpc.sh@84 -- # killprocess 1458476 00:05:42.573 15:52:06 -- common/autotest_common.sh@936 -- # '[' -z 1458476 ']' 00:05:42.573 15:52:06 -- common/autotest_common.sh@940 -- # kill -0 1458476 00:05:42.573 15:52:06 -- common/autotest_common.sh@941 -- # uname 00:05:42.573 15:52:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:42.573 15:52:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1458476 00:05:42.573 15:52:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:42.573 15:52:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:42.573 15:52:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1458476' 00:05:42.573 killing process with pid 1458476 00:05:42.573 15:52:06 -- common/autotest_common.sh@955 -- # kill 1458476 00:05:42.573 15:52:06 -- common/autotest_common.sh@960 -- # wait 1458476 00:05:43.139 00:05:43.139 real 0m2.419s 00:05:43.139 user 0m3.063s 00:05:43.139 sys 0m0.582s 00:05:43.139 15:52:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.139 15:52:06 -- common/autotest_common.sh@10 -- # set +x 00:05:43.139 ************************************ 00:05:43.139 END TEST rpc 00:05:43.139 ************************************ 00:05:43.139 15:52:06 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:43.139 15:52:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:43.139 15:52:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.139 15:52:06 -- common/autotest_common.sh@10 -- # set +x 00:05:43.139 ************************************ 00:05:43.139 START TEST rpc_client 00:05:43.139 ************************************ 00:05:43.139 15:52:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:43.139 * Looking for test storage... 00:05:43.139 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:43.139 15:52:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:43.139 15:52:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:43.139 15:52:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:43.139 15:52:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:43.139 15:52:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:43.139 15:52:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:43.139 15:52:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:43.139 15:52:06 -- scripts/common.sh@335 -- # IFS=.-: 00:05:43.139 15:52:06 -- scripts/common.sh@335 -- # read -ra ver1 00:05:43.139 15:52:06 -- scripts/common.sh@336 -- # IFS=.-: 00:05:43.139 15:52:06 -- scripts/common.sh@336 -- # read -ra ver2 00:05:43.139 15:52:06 -- scripts/common.sh@337 -- # local 'op=<' 00:05:43.139 15:52:06 -- scripts/common.sh@339 -- # ver1_l=2 00:05:43.139 15:52:06 -- scripts/common.sh@340 -- # ver2_l=1 00:05:43.139 15:52:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:43.139 15:52:06 -- scripts/common.sh@343 -- # case "$op" in 00:05:43.139 15:52:06 -- scripts/common.sh@344 -- # : 1 00:05:43.139 15:52:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:43.139 15:52:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:43.139 15:52:06 -- scripts/common.sh@364 -- # decimal 1 00:05:43.139 15:52:06 -- scripts/common.sh@352 -- # local d=1 00:05:43.139 15:52:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:43.139 15:52:06 -- scripts/common.sh@354 -- # echo 1 00:05:43.139 15:52:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:43.139 15:52:06 -- scripts/common.sh@365 -- # decimal 2 00:05:43.139 15:52:06 -- scripts/common.sh@352 -- # local d=2 00:05:43.139 15:52:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:43.139 15:52:06 -- scripts/common.sh@354 -- # echo 2 00:05:43.139 15:52:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:43.139 15:52:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:43.139 15:52:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:43.139 15:52:06 -- scripts/common.sh@367 -- # return 0 00:05:43.139 15:52:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:43.139 15:52:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:43.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.139 --rc genhtml_branch_coverage=1 00:05:43.139 --rc genhtml_function_coverage=1 00:05:43.139 --rc genhtml_legend=1 00:05:43.139 --rc geninfo_all_blocks=1 00:05:43.139 --rc geninfo_unexecuted_blocks=1 00:05:43.139 00:05:43.139 ' 00:05:43.139 15:52:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:43.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.139 --rc genhtml_branch_coverage=1 00:05:43.139 --rc genhtml_function_coverage=1 00:05:43.139 --rc genhtml_legend=1 00:05:43.139 --rc geninfo_all_blocks=1 00:05:43.139 --rc geninfo_unexecuted_blocks=1 00:05:43.139 00:05:43.139 ' 00:05:43.139 15:52:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:43.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.139 --rc genhtml_branch_coverage=1 00:05:43.139 --rc genhtml_function_coverage=1 00:05:43.139 --rc genhtml_legend=1 00:05:43.139 --rc geninfo_all_blocks=1 00:05:43.139 --rc geninfo_unexecuted_blocks=1 00:05:43.139 00:05:43.139 ' 00:05:43.139 15:52:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:43.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.139 --rc genhtml_branch_coverage=1 00:05:43.139 --rc genhtml_function_coverage=1 00:05:43.139 --rc genhtml_legend=1 00:05:43.139 --rc geninfo_all_blocks=1 00:05:43.139 --rc geninfo_unexecuted_blocks=1 00:05:43.139 00:05:43.139 ' 00:05:43.139 15:52:06 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:43.139 OK 00:05:43.139 15:52:06 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:43.139 00:05:43.139 real 0m0.155s 00:05:43.139 user 0m0.103s 00:05:43.139 sys 0m0.061s 00:05:43.139 15:52:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.139 15:52:06 -- common/autotest_common.sh@10 -- # set +x 00:05:43.139 ************************************ 00:05:43.139 END TEST rpc_client 00:05:43.139 ************************************ 00:05:43.139 15:52:06 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:43.139 15:52:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:43.139 15:52:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.140 15:52:06 -- common/autotest_common.sh@10 -- # set +x 00:05:43.140 ************************************ 00:05:43.140 START TEST json_config 00:05:43.140 ************************************ 00:05:43.140 15:52:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:43.140 15:52:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:43.140 15:52:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:43.140 15:52:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:43.399 15:52:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:43.399 15:52:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:43.399 15:52:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:43.399 15:52:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:43.399 15:52:06 -- scripts/common.sh@335 -- # IFS=.-: 00:05:43.399 15:52:06 -- scripts/common.sh@335 -- # read -ra ver1 00:05:43.399 15:52:06 -- scripts/common.sh@336 -- # IFS=.-: 00:05:43.399 15:52:06 -- scripts/common.sh@336 -- # read -ra ver2 00:05:43.399 15:52:06 -- scripts/common.sh@337 -- # local 'op=<' 00:05:43.399 15:52:06 -- scripts/common.sh@339 -- # ver1_l=2 00:05:43.399 15:52:06 -- scripts/common.sh@340 -- # ver2_l=1 00:05:43.399 15:52:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:43.399 15:52:06 -- scripts/common.sh@343 -- # case "$op" in 00:05:43.399 15:52:06 -- scripts/common.sh@344 -- # : 1 00:05:43.399 15:52:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:43.399 15:52:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:43.399 15:52:06 -- scripts/common.sh@364 -- # decimal 1 00:05:43.399 15:52:06 -- scripts/common.sh@352 -- # local d=1 00:05:43.399 15:52:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:43.399 15:52:06 -- scripts/common.sh@354 -- # echo 1 00:05:43.399 15:52:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:43.399 15:52:06 -- scripts/common.sh@365 -- # decimal 2 00:05:43.399 15:52:06 -- scripts/common.sh@352 -- # local d=2 00:05:43.399 15:52:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:43.399 15:52:06 -- scripts/common.sh@354 -- # echo 2 00:05:43.399 15:52:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:43.399 15:52:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:43.399 15:52:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:43.399 15:52:06 -- scripts/common.sh@367 -- # return 0 00:05:43.399 15:52:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:43.399 15:52:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:43.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.399 --rc genhtml_branch_coverage=1 00:05:43.399 --rc genhtml_function_coverage=1 00:05:43.399 --rc genhtml_legend=1 00:05:43.399 --rc geninfo_all_blocks=1 00:05:43.399 --rc geninfo_unexecuted_blocks=1 00:05:43.399 00:05:43.399 ' 00:05:43.399 15:52:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:43.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.399 --rc genhtml_branch_coverage=1 00:05:43.399 --rc genhtml_function_coverage=1 00:05:43.399 --rc genhtml_legend=1 00:05:43.399 --rc geninfo_all_blocks=1 00:05:43.399 --rc geninfo_unexecuted_blocks=1 00:05:43.399 00:05:43.399 ' 00:05:43.399 15:52:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:43.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.399 --rc genhtml_branch_coverage=1 00:05:43.399 --rc genhtml_function_coverage=1 00:05:43.399 --rc genhtml_legend=1 00:05:43.399 --rc geninfo_all_blocks=1 00:05:43.399 --rc geninfo_unexecuted_blocks=1 00:05:43.399 00:05:43.399 ' 00:05:43.399 15:52:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:43.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:43.399 --rc genhtml_branch_coverage=1 00:05:43.399 --rc genhtml_function_coverage=1 00:05:43.399 --rc genhtml_legend=1 00:05:43.399 --rc geninfo_all_blocks=1 00:05:43.399 --rc geninfo_unexecuted_blocks=1 00:05:43.399 00:05:43.399 ' 00:05:43.399 15:52:06 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:43.399 15:52:06 -- nvmf/common.sh@7 -- # uname -s 00:05:43.399 15:52:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:43.399 15:52:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:43.399 15:52:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:43.399 15:52:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:43.399 15:52:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:43.399 15:52:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:43.399 15:52:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:43.399 15:52:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:43.399 15:52:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:43.399 15:52:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:43.399 15:52:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:43.399 15:52:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:43.399 15:52:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:43.399 15:52:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:43.399 15:52:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:43.399 15:52:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:43.399 15:52:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:43.399 15:52:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:43.399 15:52:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:43.399 15:52:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:43.399 15:52:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:43.399 15:52:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:43.399 15:52:06 -- paths/export.sh@5 -- # export PATH 00:05:43.399 15:52:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:43.399 15:52:06 -- nvmf/common.sh@46 -- # : 0 00:05:43.399 15:52:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:43.399 15:52:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:43.399 15:52:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:43.399 15:52:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:43.399 15:52:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:43.399 15:52:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:43.399 15:52:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:43.399 15:52:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:43.399 15:52:06 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:43.399 15:52:06 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:43.399 15:52:06 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:43.399 15:52:06 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:43.399 15:52:06 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:43.399 15:52:06 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:43.399 15:52:06 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:43.399 15:52:06 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:43.399 15:52:06 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:43.399 15:52:06 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:43.399 15:52:06 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:43.399 15:52:06 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:43.399 15:52:06 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:43.399 15:52:06 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:43.399 15:52:06 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:43.399 INFO: JSON configuration test init 00:05:43.399 15:52:06 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:43.399 15:52:06 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:43.399 15:52:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:43.399 15:52:06 -- common/autotest_common.sh@10 -- # set +x 00:05:43.399 15:52:06 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:43.399 15:52:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:43.399 15:52:06 -- common/autotest_common.sh@10 -- # set +x 00:05:43.399 15:52:06 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:43.399 15:52:06 -- json_config/json_config.sh@98 -- # local app=target 00:05:43.399 15:52:06 -- json_config/json_config.sh@99 -- # shift 00:05:43.400 15:52:06 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:43.400 15:52:06 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:43.400 15:52:06 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:43.400 15:52:06 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:43.400 15:52:06 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:43.400 15:52:06 -- json_config/json_config.sh@111 -- # app_pid[$app]=1458988 00:05:43.400 15:52:06 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:43.400 15:52:06 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:43.400 Waiting for target to run... 00:05:43.400 15:52:06 -- json_config/json_config.sh@114 -- # waitforlisten 1458988 /var/tmp/spdk_tgt.sock 00:05:43.400 15:52:06 -- common/autotest_common.sh@829 -- # '[' -z 1458988 ']' 00:05:43.400 15:52:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:43.400 15:52:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:43.400 15:52:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:43.400 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:43.400 15:52:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:43.400 15:52:06 -- common/autotest_common.sh@10 -- # set +x 00:05:43.400 [2024-11-18 15:52:06.880932] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.400 [2024-11-18 15:52:06.881022] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1458988 ] 00:05:43.400 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.966 [2024-11-18 15:52:07.366060] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.966 [2024-11-18 15:52:07.445756] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:43.966 [2024-11-18 15:52:07.445954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.531 15:52:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:44.531 15:52:07 -- common/autotest_common.sh@862 -- # return 0 00:05:44.531 15:52:07 -- json_config/json_config.sh@115 -- # echo '' 00:05:44.531 00:05:44.531 15:52:07 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:44.531 15:52:07 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:44.531 15:52:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:44.531 15:52:07 -- common/autotest_common.sh@10 -- # set +x 00:05:44.531 15:52:07 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:44.531 15:52:07 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:44.531 15:52:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:44.531 15:52:07 -- common/autotest_common.sh@10 -- # set +x 00:05:44.531 15:52:07 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:44.531 15:52:07 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:44.531 15:52:07 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:47.812 15:52:11 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:47.812 15:52:11 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:47.812 15:52:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:47.812 15:52:11 -- common/autotest_common.sh@10 -- # set +x 00:05:47.812 15:52:11 -- json_config/json_config.sh@48 -- # local ret=0 00:05:47.812 15:52:11 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:47.812 15:52:11 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:47.812 15:52:11 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:47.812 15:52:11 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:47.812 15:52:11 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:47.812 15:52:11 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:47.812 15:52:11 -- json_config/json_config.sh@51 -- # local get_types 00:05:47.812 15:52:11 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:47.812 15:52:11 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:47.812 15:52:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:47.812 15:52:11 -- common/autotest_common.sh@10 -- # set +x 00:05:47.812 15:52:11 -- json_config/json_config.sh@58 -- # return 0 00:05:47.812 15:52:11 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:47.812 15:52:11 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:47.812 15:52:11 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:47.812 15:52:11 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:47.812 15:52:11 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:47.812 15:52:11 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:47.812 15:52:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:47.812 15:52:11 -- common/autotest_common.sh@10 -- # set +x 00:05:47.812 15:52:11 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:47.812 15:52:11 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:47.812 15:52:11 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:47.812 15:52:11 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:47.812 15:52:11 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:48.070 MallocForNvmf0 00:05:48.070 15:52:11 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:48.070 15:52:11 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:48.328 MallocForNvmf1 00:05:48.328 15:52:11 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:48.328 15:52:11 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:48.586 [2024-11-18 15:52:12.095514] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:48.586 15:52:12 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:48.586 15:52:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:48.844 15:52:12 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:48.844 15:52:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:49.102 15:52:12 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:49.102 15:52:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:49.359 15:52:12 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:49.360 15:52:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:49.617 [2024-11-18 15:52:13.106870] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:49.617 15:52:13 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:49.617 15:52:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:49.617 15:52:13 -- common/autotest_common.sh@10 -- # set +x 00:05:49.617 15:52:13 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:49.617 15:52:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:49.617 15:52:13 -- common/autotest_common.sh@10 -- # set +x 00:05:49.617 15:52:13 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:49.617 15:52:13 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:49.617 15:52:13 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:49.875 MallocBdevForConfigChangeCheck 00:05:49.875 15:52:13 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:49.875 15:52:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:49.876 15:52:13 -- common/autotest_common.sh@10 -- # set +x 00:05:49.876 15:52:13 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:49.876 15:52:13 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:50.441 15:52:13 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:50.441 INFO: shutting down applications... 00:05:50.441 15:52:13 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:50.441 15:52:13 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:50.441 15:52:13 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:50.441 15:52:13 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:52.341 Calling clear_iscsi_subsystem 00:05:52.342 Calling clear_nvmf_subsystem 00:05:52.342 Calling clear_nbd_subsystem 00:05:52.342 Calling clear_ublk_subsystem 00:05:52.342 Calling clear_vhost_blk_subsystem 00:05:52.342 Calling clear_vhost_scsi_subsystem 00:05:52.342 Calling clear_scheduler_subsystem 00:05:52.342 Calling clear_bdev_subsystem 00:05:52.342 Calling clear_accel_subsystem 00:05:52.342 Calling clear_vmd_subsystem 00:05:52.342 Calling clear_sock_subsystem 00:05:52.342 Calling clear_iobuf_subsystem 00:05:52.342 15:52:15 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:52.342 15:52:15 -- json_config/json_config.sh@396 -- # count=100 00:05:52.342 15:52:15 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:52.342 15:52:15 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:52.342 15:52:15 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:52.342 15:52:15 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:52.342 15:52:15 -- json_config/json_config.sh@398 -- # break 00:05:52.342 15:52:15 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:52.342 15:52:15 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:52.342 15:52:15 -- json_config/json_config.sh@120 -- # local app=target 00:05:52.342 15:52:15 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:52.342 15:52:15 -- json_config/json_config.sh@124 -- # [[ -n 1458988 ]] 00:05:52.342 15:52:15 -- json_config/json_config.sh@127 -- # kill -SIGINT 1458988 00:05:52.342 15:52:15 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:52.342 15:52:15 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:52.342 15:52:15 -- json_config/json_config.sh@130 -- # kill -0 1458988 00:05:52.342 15:52:15 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:52.907 15:52:16 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:52.907 15:52:16 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:52.907 15:52:16 -- json_config/json_config.sh@130 -- # kill -0 1458988 00:05:52.907 15:52:16 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:52.907 15:52:16 -- json_config/json_config.sh@132 -- # break 00:05:52.907 15:52:16 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:52.907 15:52:16 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:52.907 SPDK target shutdown done 00:05:52.908 15:52:16 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:52.908 INFO: relaunching applications... 00:05:52.908 15:52:16 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:52.908 15:52:16 -- json_config/json_config.sh@98 -- # local app=target 00:05:52.908 15:52:16 -- json_config/json_config.sh@99 -- # shift 00:05:52.908 15:52:16 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:52.908 15:52:16 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:52.908 15:52:16 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:52.908 15:52:16 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:52.908 15:52:16 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:52.908 15:52:16 -- json_config/json_config.sh@111 -- # app_pid[$app]=1460335 00:05:52.908 15:52:16 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:52.908 15:52:16 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:52.908 Waiting for target to run... 00:05:52.908 15:52:16 -- json_config/json_config.sh@114 -- # waitforlisten 1460335 /var/tmp/spdk_tgt.sock 00:05:52.908 15:52:16 -- common/autotest_common.sh@829 -- # '[' -z 1460335 ']' 00:05:52.908 15:52:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:52.908 15:52:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:52.908 15:52:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:52.908 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:52.908 15:52:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:52.908 15:52:16 -- common/autotest_common.sh@10 -- # set +x 00:05:52.908 [2024-11-18 15:52:16.409519] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.908 [2024-11-18 15:52:16.409597] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1460335 ] 00:05:52.908 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.166 [2024-11-18 15:52:16.730761] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.425 [2024-11-18 15:52:16.797599] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:53.425 [2024-11-18 15:52:16.797769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.708 [2024-11-18 15:52:19.820457] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:56.708 [2024-11-18 15:52:19.852993] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:56.995 15:52:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:56.995 15:52:20 -- common/autotest_common.sh@862 -- # return 0 00:05:56.995 15:52:20 -- json_config/json_config.sh@115 -- # echo '' 00:05:56.995 00:05:56.995 15:52:20 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:56.995 15:52:20 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:56.995 INFO: Checking if target configuration is the same... 00:05:56.995 15:52:20 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:56.995 15:52:20 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:56.995 15:52:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:56.995 + '[' 2 -ne 2 ']' 00:05:56.995 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:56.995 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:56.995 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:56.995 +++ basename /dev/fd/62 00:05:56.995 ++ mktemp /tmp/62.XXX 00:05:56.995 + tmp_file_1=/tmp/62.Rb3 00:05:56.995 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:56.995 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:56.995 + tmp_file_2=/tmp/spdk_tgt_config.json.0Ny 00:05:56.995 + ret=0 00:05:56.995 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:57.253 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:57.253 + diff -u /tmp/62.Rb3 /tmp/spdk_tgt_config.json.0Ny 00:05:57.253 + echo 'INFO: JSON config files are the same' 00:05:57.253 INFO: JSON config files are the same 00:05:57.253 + rm /tmp/62.Rb3 /tmp/spdk_tgt_config.json.0Ny 00:05:57.253 + exit 0 00:05:57.253 15:52:20 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:57.253 15:52:20 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:57.253 INFO: changing configuration and checking if this can be detected... 00:05:57.253 15:52:20 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:57.253 15:52:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:57.511 15:52:21 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:57.511 15:52:21 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:57.511 15:52:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:57.511 + '[' 2 -ne 2 ']' 00:05:57.511 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:57.511 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:57.511 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:57.511 +++ basename /dev/fd/62 00:05:57.511 ++ mktemp /tmp/62.XXX 00:05:57.511 + tmp_file_1=/tmp/62.j6X 00:05:57.511 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:57.511 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:57.511 + tmp_file_2=/tmp/spdk_tgt_config.json.mjr 00:05:57.511 + ret=0 00:05:57.511 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:58.078 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:58.078 + diff -u /tmp/62.j6X /tmp/spdk_tgt_config.json.mjr 00:05:58.078 + ret=1 00:05:58.078 + echo '=== Start of file: /tmp/62.j6X ===' 00:05:58.078 + cat /tmp/62.j6X 00:05:58.078 + echo '=== End of file: /tmp/62.j6X ===' 00:05:58.078 + echo '' 00:05:58.078 + echo '=== Start of file: /tmp/spdk_tgt_config.json.mjr ===' 00:05:58.078 + cat /tmp/spdk_tgt_config.json.mjr 00:05:58.078 + echo '=== End of file: /tmp/spdk_tgt_config.json.mjr ===' 00:05:58.078 + echo '' 00:05:58.078 + rm /tmp/62.j6X /tmp/spdk_tgt_config.json.mjr 00:05:58.078 + exit 1 00:05:58.078 15:52:21 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:58.078 INFO: configuration change detected. 00:05:58.078 15:52:21 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:58.078 15:52:21 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:58.078 15:52:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:58.078 15:52:21 -- common/autotest_common.sh@10 -- # set +x 00:05:58.078 15:52:21 -- json_config/json_config.sh@360 -- # local ret=0 00:05:58.078 15:52:21 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:58.078 15:52:21 -- json_config/json_config.sh@370 -- # [[ -n 1460335 ]] 00:05:58.078 15:52:21 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:58.078 15:52:21 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:58.078 15:52:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:58.078 15:52:21 -- common/autotest_common.sh@10 -- # set +x 00:05:58.078 15:52:21 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:58.078 15:52:21 -- json_config/json_config.sh@246 -- # uname -s 00:05:58.078 15:52:21 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:58.078 15:52:21 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:58.078 15:52:21 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:58.078 15:52:21 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:58.078 15:52:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:58.078 15:52:21 -- common/autotest_common.sh@10 -- # set +x 00:05:58.078 15:52:21 -- json_config/json_config.sh@376 -- # killprocess 1460335 00:05:58.078 15:52:21 -- common/autotest_common.sh@936 -- # '[' -z 1460335 ']' 00:05:58.078 15:52:21 -- common/autotest_common.sh@940 -- # kill -0 1460335 00:05:58.078 15:52:21 -- common/autotest_common.sh@941 -- # uname 00:05:58.078 15:52:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:58.078 15:52:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1460335 00:05:58.078 15:52:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:58.078 15:52:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:58.078 15:52:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1460335' 00:05:58.078 killing process with pid 1460335 00:05:58.078 15:52:21 -- common/autotest_common.sh@955 -- # kill 1460335 00:05:58.078 15:52:21 -- common/autotest_common.sh@960 -- # wait 1460335 00:05:59.979 15:52:23 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:59.979 15:52:23 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:59.979 15:52:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:59.979 15:52:23 -- common/autotest_common.sh@10 -- # set +x 00:05:59.979 15:52:23 -- json_config/json_config.sh@381 -- # return 0 00:05:59.979 15:52:23 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:59.979 INFO: Success 00:05:59.979 00:05:59.979 real 0m16.469s 00:05:59.979 user 0m19.098s 00:05:59.979 sys 0m2.064s 00:05:59.979 15:52:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.979 15:52:23 -- common/autotest_common.sh@10 -- # set +x 00:05:59.979 ************************************ 00:05:59.979 END TEST json_config 00:05:59.979 ************************************ 00:05:59.979 15:52:23 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:59.979 15:52:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:59.979 15:52:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.979 15:52:23 -- common/autotest_common.sh@10 -- # set +x 00:05:59.979 ************************************ 00:05:59.979 START TEST json_config_extra_key 00:05:59.979 ************************************ 00:05:59.979 15:52:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:59.979 15:52:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:59.979 15:52:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:59.979 15:52:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:59.979 15:52:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:59.979 15:52:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:59.979 15:52:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:59.979 15:52:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:59.979 15:52:23 -- scripts/common.sh@335 -- # IFS=.-: 00:05:59.979 15:52:23 -- scripts/common.sh@335 -- # read -ra ver1 00:05:59.979 15:52:23 -- scripts/common.sh@336 -- # IFS=.-: 00:05:59.979 15:52:23 -- scripts/common.sh@336 -- # read -ra ver2 00:05:59.979 15:52:23 -- scripts/common.sh@337 -- # local 'op=<' 00:05:59.979 15:52:23 -- scripts/common.sh@339 -- # ver1_l=2 00:05:59.979 15:52:23 -- scripts/common.sh@340 -- # ver2_l=1 00:05:59.979 15:52:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:59.979 15:52:23 -- scripts/common.sh@343 -- # case "$op" in 00:05:59.979 15:52:23 -- scripts/common.sh@344 -- # : 1 00:05:59.979 15:52:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:59.979 15:52:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:59.979 15:52:23 -- scripts/common.sh@364 -- # decimal 1 00:05:59.979 15:52:23 -- scripts/common.sh@352 -- # local d=1 00:05:59.979 15:52:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:59.979 15:52:23 -- scripts/common.sh@354 -- # echo 1 00:05:59.979 15:52:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:59.979 15:52:23 -- scripts/common.sh@365 -- # decimal 2 00:05:59.979 15:52:23 -- scripts/common.sh@352 -- # local d=2 00:05:59.979 15:52:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:59.979 15:52:23 -- scripts/common.sh@354 -- # echo 2 00:05:59.979 15:52:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:59.979 15:52:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:59.979 15:52:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:59.979 15:52:23 -- scripts/common.sh@367 -- # return 0 00:05:59.979 15:52:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:59.979 15:52:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:59.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.979 --rc genhtml_branch_coverage=1 00:05:59.979 --rc genhtml_function_coverage=1 00:05:59.979 --rc genhtml_legend=1 00:05:59.979 --rc geninfo_all_blocks=1 00:05:59.979 --rc geninfo_unexecuted_blocks=1 00:05:59.979 00:05:59.979 ' 00:05:59.979 15:52:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:59.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.980 --rc genhtml_branch_coverage=1 00:05:59.980 --rc genhtml_function_coverage=1 00:05:59.980 --rc genhtml_legend=1 00:05:59.980 --rc geninfo_all_blocks=1 00:05:59.980 --rc geninfo_unexecuted_blocks=1 00:05:59.980 00:05:59.980 ' 00:05:59.980 15:52:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:59.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.980 --rc genhtml_branch_coverage=1 00:05:59.980 --rc genhtml_function_coverage=1 00:05:59.980 --rc genhtml_legend=1 00:05:59.980 --rc geninfo_all_blocks=1 00:05:59.980 --rc geninfo_unexecuted_blocks=1 00:05:59.980 00:05:59.980 ' 00:05:59.980 15:52:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:59.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.980 --rc genhtml_branch_coverage=1 00:05:59.980 --rc genhtml_function_coverage=1 00:05:59.980 --rc genhtml_legend=1 00:05:59.980 --rc geninfo_all_blocks=1 00:05:59.980 --rc geninfo_unexecuted_blocks=1 00:05:59.980 00:05:59.980 ' 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:59.980 15:52:23 -- nvmf/common.sh@7 -- # uname -s 00:05:59.980 15:52:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:59.980 15:52:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:59.980 15:52:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:59.980 15:52:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:59.980 15:52:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:59.980 15:52:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:59.980 15:52:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:59.980 15:52:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:59.980 15:52:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:59.980 15:52:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:59.980 15:52:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:59.980 15:52:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:59.980 15:52:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:59.980 15:52:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:59.980 15:52:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:59.980 15:52:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:59.980 15:52:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:59.980 15:52:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:59.980 15:52:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:59.980 15:52:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:59.980 15:52:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:59.980 15:52:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:59.980 15:52:23 -- paths/export.sh@5 -- # export PATH 00:05:59.980 15:52:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:59.980 15:52:23 -- nvmf/common.sh@46 -- # : 0 00:05:59.980 15:52:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:59.980 15:52:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:59.980 15:52:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:59.980 15:52:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:59.980 15:52:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:59.980 15:52:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:59.980 15:52:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:59.980 15:52:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:59.980 INFO: launching applications... 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1461285 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:59.980 Waiting for target to run... 00:05:59.980 15:52:23 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1461285 /var/tmp/spdk_tgt.sock 00:05:59.980 15:52:23 -- common/autotest_common.sh@829 -- # '[' -z 1461285 ']' 00:05:59.980 15:52:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:59.980 15:52:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:59.980 15:52:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:59.980 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:59.980 15:52:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:59.980 15:52:23 -- common/autotest_common.sh@10 -- # set +x 00:05:59.980 [2024-11-18 15:52:23.368943] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.980 [2024-11-18 15:52:23.369034] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1461285 ] 00:05:59.980 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.547 [2024-11-18 15:52:23.878160] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.547 [2024-11-18 15:52:23.957758] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:00.547 [2024-11-18 15:52:23.957957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.805 15:52:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:00.805 15:52:24 -- common/autotest_common.sh@862 -- # return 0 00:06:00.805 15:52:24 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:06:00.805 00:06:00.805 15:52:24 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:06:00.805 INFO: shutting down applications... 00:06:00.805 15:52:24 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:06:00.805 15:52:24 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:06:00.805 15:52:24 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:06:00.805 15:52:24 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1461285 ]] 00:06:00.805 15:52:24 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1461285 00:06:00.805 15:52:24 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:06:00.805 15:52:24 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:00.805 15:52:24 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1461285 00:06:00.805 15:52:24 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:06:01.371 15:52:24 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:06:01.371 15:52:24 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:01.371 15:52:24 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1461285 00:06:01.371 15:52:24 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:06:01.371 15:52:24 -- json_config/json_config_extra_key.sh@52 -- # break 00:06:01.371 15:52:24 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:06:01.371 15:52:24 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:06:01.371 SPDK target shutdown done 00:06:01.371 15:52:24 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:06:01.371 Success 00:06:01.371 00:06:01.371 real 0m1.693s 00:06:01.371 user 0m1.528s 00:06:01.371 sys 0m0.608s 00:06:01.371 15:52:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.371 15:52:24 -- common/autotest_common.sh@10 -- # set +x 00:06:01.371 ************************************ 00:06:01.371 END TEST json_config_extra_key 00:06:01.371 ************************************ 00:06:01.371 15:52:24 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:01.371 15:52:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:01.371 15:52:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.371 15:52:24 -- common/autotest_common.sh@10 -- # set +x 00:06:01.371 ************************************ 00:06:01.371 START TEST alias_rpc 00:06:01.371 ************************************ 00:06:01.371 15:52:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:01.371 * Looking for test storage... 00:06:01.371 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:06:01.372 15:52:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:01.372 15:52:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:01.372 15:52:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:01.630 15:52:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:01.630 15:52:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:01.630 15:52:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:01.630 15:52:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:01.630 15:52:25 -- scripts/common.sh@335 -- # IFS=.-: 00:06:01.630 15:52:25 -- scripts/common.sh@335 -- # read -ra ver1 00:06:01.630 15:52:25 -- scripts/common.sh@336 -- # IFS=.-: 00:06:01.630 15:52:25 -- scripts/common.sh@336 -- # read -ra ver2 00:06:01.630 15:52:25 -- scripts/common.sh@337 -- # local 'op=<' 00:06:01.630 15:52:25 -- scripts/common.sh@339 -- # ver1_l=2 00:06:01.630 15:52:25 -- scripts/common.sh@340 -- # ver2_l=1 00:06:01.630 15:52:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:01.630 15:52:25 -- scripts/common.sh@343 -- # case "$op" in 00:06:01.630 15:52:25 -- scripts/common.sh@344 -- # : 1 00:06:01.630 15:52:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:01.630 15:52:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:01.630 15:52:25 -- scripts/common.sh@364 -- # decimal 1 00:06:01.630 15:52:25 -- scripts/common.sh@352 -- # local d=1 00:06:01.630 15:52:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:01.630 15:52:25 -- scripts/common.sh@354 -- # echo 1 00:06:01.630 15:52:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:01.630 15:52:25 -- scripts/common.sh@365 -- # decimal 2 00:06:01.630 15:52:25 -- scripts/common.sh@352 -- # local d=2 00:06:01.630 15:52:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:01.630 15:52:25 -- scripts/common.sh@354 -- # echo 2 00:06:01.630 15:52:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:01.630 15:52:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:01.630 15:52:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:01.630 15:52:25 -- scripts/common.sh@367 -- # return 0 00:06:01.630 15:52:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:01.630 15:52:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:01.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.630 --rc genhtml_branch_coverage=1 00:06:01.630 --rc genhtml_function_coverage=1 00:06:01.630 --rc genhtml_legend=1 00:06:01.630 --rc geninfo_all_blocks=1 00:06:01.630 --rc geninfo_unexecuted_blocks=1 00:06:01.630 00:06:01.630 ' 00:06:01.630 15:52:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:01.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.630 --rc genhtml_branch_coverage=1 00:06:01.630 --rc genhtml_function_coverage=1 00:06:01.630 --rc genhtml_legend=1 00:06:01.630 --rc geninfo_all_blocks=1 00:06:01.631 --rc geninfo_unexecuted_blocks=1 00:06:01.631 00:06:01.631 ' 00:06:01.631 15:52:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:01.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.631 --rc genhtml_branch_coverage=1 00:06:01.631 --rc genhtml_function_coverage=1 00:06:01.631 --rc genhtml_legend=1 00:06:01.631 --rc geninfo_all_blocks=1 00:06:01.631 --rc geninfo_unexecuted_blocks=1 00:06:01.631 00:06:01.631 ' 00:06:01.631 15:52:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:01.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.631 --rc genhtml_branch_coverage=1 00:06:01.631 --rc genhtml_function_coverage=1 00:06:01.631 --rc genhtml_legend=1 00:06:01.631 --rc geninfo_all_blocks=1 00:06:01.631 --rc geninfo_unexecuted_blocks=1 00:06:01.631 00:06:01.631 ' 00:06:01.631 15:52:25 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:01.631 15:52:25 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1461485 00:06:01.631 15:52:25 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:01.631 15:52:25 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1461485 00:06:01.631 15:52:25 -- common/autotest_common.sh@829 -- # '[' -z 1461485 ']' 00:06:01.631 15:52:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:01.631 15:52:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:01.631 15:52:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:01.631 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:01.631 15:52:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:01.631 15:52:25 -- common/autotest_common.sh@10 -- # set +x 00:06:01.631 [2024-11-18 15:52:25.095371] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.631 [2024-11-18 15:52:25.095470] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1461485 ] 00:06:01.631 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.631 [2024-11-18 15:52:25.158560] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.889 [2024-11-18 15:52:25.250649] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:01.889 [2024-11-18 15:52:25.250828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.822 15:52:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:02.822 15:52:26 -- common/autotest_common.sh@862 -- # return 0 00:06:02.822 15:52:26 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:02.822 15:52:26 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1461485 00:06:02.822 15:52:26 -- common/autotest_common.sh@936 -- # '[' -z 1461485 ']' 00:06:02.822 15:52:26 -- common/autotest_common.sh@940 -- # kill -0 1461485 00:06:02.822 15:52:26 -- common/autotest_common.sh@941 -- # uname 00:06:02.822 15:52:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:02.822 15:52:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1461485 00:06:02.822 15:52:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:02.822 15:52:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:02.822 15:52:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1461485' 00:06:02.822 killing process with pid 1461485 00:06:02.823 15:52:26 -- common/autotest_common.sh@955 -- # kill 1461485 00:06:02.823 15:52:26 -- common/autotest_common.sh@960 -- # wait 1461485 00:06:03.388 00:06:03.388 real 0m1.855s 00:06:03.388 user 0m2.139s 00:06:03.388 sys 0m0.481s 00:06:03.388 15:52:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.388 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:06:03.388 ************************************ 00:06:03.388 END TEST alias_rpc 00:06:03.388 ************************************ 00:06:03.388 15:52:26 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:06:03.388 15:52:26 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:03.388 15:52:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:03.388 15:52:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.388 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:06:03.388 ************************************ 00:06:03.388 START TEST spdkcli_tcp 00:06:03.388 ************************************ 00:06:03.388 15:52:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:03.389 * Looking for test storage... 00:06:03.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:06:03.389 15:52:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:03.389 15:52:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:03.389 15:52:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:03.389 15:52:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:03.389 15:52:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:03.389 15:52:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:03.389 15:52:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:03.389 15:52:26 -- scripts/common.sh@335 -- # IFS=.-: 00:06:03.389 15:52:26 -- scripts/common.sh@335 -- # read -ra ver1 00:06:03.389 15:52:26 -- scripts/common.sh@336 -- # IFS=.-: 00:06:03.389 15:52:26 -- scripts/common.sh@336 -- # read -ra ver2 00:06:03.389 15:52:26 -- scripts/common.sh@337 -- # local 'op=<' 00:06:03.389 15:52:26 -- scripts/common.sh@339 -- # ver1_l=2 00:06:03.389 15:52:26 -- scripts/common.sh@340 -- # ver2_l=1 00:06:03.389 15:52:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:03.389 15:52:26 -- scripts/common.sh@343 -- # case "$op" in 00:06:03.389 15:52:26 -- scripts/common.sh@344 -- # : 1 00:06:03.389 15:52:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:03.389 15:52:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:03.389 15:52:26 -- scripts/common.sh@364 -- # decimal 1 00:06:03.389 15:52:26 -- scripts/common.sh@352 -- # local d=1 00:06:03.389 15:52:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:03.389 15:52:26 -- scripts/common.sh@354 -- # echo 1 00:06:03.389 15:52:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:03.389 15:52:26 -- scripts/common.sh@365 -- # decimal 2 00:06:03.389 15:52:26 -- scripts/common.sh@352 -- # local d=2 00:06:03.389 15:52:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:03.389 15:52:26 -- scripts/common.sh@354 -- # echo 2 00:06:03.389 15:52:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:03.389 15:52:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:03.389 15:52:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:03.389 15:52:26 -- scripts/common.sh@367 -- # return 0 00:06:03.389 15:52:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:03.389 15:52:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:03.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.389 --rc genhtml_branch_coverage=1 00:06:03.389 --rc genhtml_function_coverage=1 00:06:03.389 --rc genhtml_legend=1 00:06:03.389 --rc geninfo_all_blocks=1 00:06:03.389 --rc geninfo_unexecuted_blocks=1 00:06:03.389 00:06:03.389 ' 00:06:03.389 15:52:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:03.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.389 --rc genhtml_branch_coverage=1 00:06:03.389 --rc genhtml_function_coverage=1 00:06:03.389 --rc genhtml_legend=1 00:06:03.389 --rc geninfo_all_blocks=1 00:06:03.389 --rc geninfo_unexecuted_blocks=1 00:06:03.389 00:06:03.389 ' 00:06:03.389 15:52:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:03.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.389 --rc genhtml_branch_coverage=1 00:06:03.389 --rc genhtml_function_coverage=1 00:06:03.389 --rc genhtml_legend=1 00:06:03.389 --rc geninfo_all_blocks=1 00:06:03.389 --rc geninfo_unexecuted_blocks=1 00:06:03.389 00:06:03.389 ' 00:06:03.389 15:52:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:03.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.389 --rc genhtml_branch_coverage=1 00:06:03.389 --rc genhtml_function_coverage=1 00:06:03.389 --rc genhtml_legend=1 00:06:03.389 --rc geninfo_all_blocks=1 00:06:03.389 --rc geninfo_unexecuted_blocks=1 00:06:03.389 00:06:03.389 ' 00:06:03.389 15:52:26 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:06:03.389 15:52:26 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:03.389 15:52:26 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:06:03.389 15:52:26 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:03.389 15:52:26 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:03.389 15:52:26 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:03.389 15:52:26 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:03.389 15:52:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:03.389 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:06:03.389 15:52:26 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1461815 00:06:03.389 15:52:26 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:03.389 15:52:26 -- spdkcli/tcp.sh@27 -- # waitforlisten 1461815 00:06:03.389 15:52:26 -- common/autotest_common.sh@829 -- # '[' -z 1461815 ']' 00:06:03.389 15:52:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:03.389 15:52:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:03.389 15:52:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:03.389 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:03.389 15:52:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:03.389 15:52:26 -- common/autotest_common.sh@10 -- # set +x 00:06:03.389 [2024-11-18 15:52:26.977189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.389 [2024-11-18 15:52:26.977289] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1461815 ] 00:06:03.647 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.647 [2024-11-18 15:52:27.036355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:03.647 [2024-11-18 15:52:27.123354] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:03.647 [2024-11-18 15:52:27.123679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:03.647 [2024-11-18 15:52:27.123684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.615 15:52:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:04.615 15:52:27 -- common/autotest_common.sh@862 -- # return 0 00:06:04.615 15:52:27 -- spdkcli/tcp.sh@31 -- # socat_pid=1461954 00:06:04.615 15:52:27 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:04.615 15:52:27 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:04.900 [ 00:06:04.900 "bdev_malloc_delete", 00:06:04.900 "bdev_malloc_create", 00:06:04.900 "bdev_null_resize", 00:06:04.900 "bdev_null_delete", 00:06:04.900 "bdev_null_create", 00:06:04.900 "bdev_nvme_cuse_unregister", 00:06:04.900 "bdev_nvme_cuse_register", 00:06:04.900 "bdev_opal_new_user", 00:06:04.900 "bdev_opal_set_lock_state", 00:06:04.900 "bdev_opal_delete", 00:06:04.900 "bdev_opal_get_info", 00:06:04.900 "bdev_opal_create", 00:06:04.900 "bdev_nvme_opal_revert", 00:06:04.900 "bdev_nvme_opal_init", 00:06:04.900 "bdev_nvme_send_cmd", 00:06:04.900 "bdev_nvme_get_path_iostat", 00:06:04.900 "bdev_nvme_get_mdns_discovery_info", 00:06:04.900 "bdev_nvme_stop_mdns_discovery", 00:06:04.900 "bdev_nvme_start_mdns_discovery", 00:06:04.900 "bdev_nvme_set_multipath_policy", 00:06:04.900 "bdev_nvme_set_preferred_path", 00:06:04.900 "bdev_nvme_get_io_paths", 00:06:04.900 "bdev_nvme_remove_error_injection", 00:06:04.900 "bdev_nvme_add_error_injection", 00:06:04.900 "bdev_nvme_get_discovery_info", 00:06:04.900 "bdev_nvme_stop_discovery", 00:06:04.900 "bdev_nvme_start_discovery", 00:06:04.900 "bdev_nvme_get_controller_health_info", 00:06:04.900 "bdev_nvme_disable_controller", 00:06:04.900 "bdev_nvme_enable_controller", 00:06:04.900 "bdev_nvme_reset_controller", 00:06:04.900 "bdev_nvme_get_transport_statistics", 00:06:04.900 "bdev_nvme_apply_firmware", 00:06:04.900 "bdev_nvme_detach_controller", 00:06:04.900 "bdev_nvme_get_controllers", 00:06:04.900 "bdev_nvme_attach_controller", 00:06:04.900 "bdev_nvme_set_hotplug", 00:06:04.900 "bdev_nvme_set_options", 00:06:04.900 "bdev_passthru_delete", 00:06:04.900 "bdev_passthru_create", 00:06:04.900 "bdev_lvol_grow_lvstore", 00:06:04.900 "bdev_lvol_get_lvols", 00:06:04.900 "bdev_lvol_get_lvstores", 00:06:04.900 "bdev_lvol_delete", 00:06:04.900 "bdev_lvol_set_read_only", 00:06:04.900 "bdev_lvol_resize", 00:06:04.900 "bdev_lvol_decouple_parent", 00:06:04.900 "bdev_lvol_inflate", 00:06:04.900 "bdev_lvol_rename", 00:06:04.900 "bdev_lvol_clone_bdev", 00:06:04.900 "bdev_lvol_clone", 00:06:04.900 "bdev_lvol_snapshot", 00:06:04.900 "bdev_lvol_create", 00:06:04.900 "bdev_lvol_delete_lvstore", 00:06:04.900 "bdev_lvol_rename_lvstore", 00:06:04.900 "bdev_lvol_create_lvstore", 00:06:04.900 "bdev_raid_set_options", 00:06:04.900 "bdev_raid_remove_base_bdev", 00:06:04.900 "bdev_raid_add_base_bdev", 00:06:04.900 "bdev_raid_delete", 00:06:04.900 "bdev_raid_create", 00:06:04.900 "bdev_raid_get_bdevs", 00:06:04.900 "bdev_error_inject_error", 00:06:04.900 "bdev_error_delete", 00:06:04.900 "bdev_error_create", 00:06:04.900 "bdev_split_delete", 00:06:04.900 "bdev_split_create", 00:06:04.900 "bdev_delay_delete", 00:06:04.900 "bdev_delay_create", 00:06:04.900 "bdev_delay_update_latency", 00:06:04.900 "bdev_zone_block_delete", 00:06:04.900 "bdev_zone_block_create", 00:06:04.900 "blobfs_create", 00:06:04.900 "blobfs_detect", 00:06:04.900 "blobfs_set_cache_size", 00:06:04.900 "bdev_aio_delete", 00:06:04.900 "bdev_aio_rescan", 00:06:04.900 "bdev_aio_create", 00:06:04.900 "bdev_ftl_set_property", 00:06:04.900 "bdev_ftl_get_properties", 00:06:04.900 "bdev_ftl_get_stats", 00:06:04.900 "bdev_ftl_unmap", 00:06:04.900 "bdev_ftl_unload", 00:06:04.900 "bdev_ftl_delete", 00:06:04.900 "bdev_ftl_load", 00:06:04.900 "bdev_ftl_create", 00:06:04.900 "bdev_virtio_attach_controller", 00:06:04.900 "bdev_virtio_scsi_get_devices", 00:06:04.900 "bdev_virtio_detach_controller", 00:06:04.900 "bdev_virtio_blk_set_hotplug", 00:06:04.900 "bdev_iscsi_delete", 00:06:04.900 "bdev_iscsi_create", 00:06:04.900 "bdev_iscsi_set_options", 00:06:04.900 "accel_error_inject_error", 00:06:04.900 "ioat_scan_accel_module", 00:06:04.900 "dsa_scan_accel_module", 00:06:04.900 "iaa_scan_accel_module", 00:06:04.900 "vfu_virtio_create_scsi_endpoint", 00:06:04.901 "vfu_virtio_scsi_remove_target", 00:06:04.901 "vfu_virtio_scsi_add_target", 00:06:04.901 "vfu_virtio_create_blk_endpoint", 00:06:04.901 "vfu_virtio_delete_endpoint", 00:06:04.901 "iscsi_set_options", 00:06:04.901 "iscsi_get_auth_groups", 00:06:04.901 "iscsi_auth_group_remove_secret", 00:06:04.901 "iscsi_auth_group_add_secret", 00:06:04.901 "iscsi_delete_auth_group", 00:06:04.901 "iscsi_create_auth_group", 00:06:04.901 "iscsi_set_discovery_auth", 00:06:04.901 "iscsi_get_options", 00:06:04.901 "iscsi_target_node_request_logout", 00:06:04.901 "iscsi_target_node_set_redirect", 00:06:04.901 "iscsi_target_node_set_auth", 00:06:04.901 "iscsi_target_node_add_lun", 00:06:04.901 "iscsi_get_connections", 00:06:04.901 "iscsi_portal_group_set_auth", 00:06:04.901 "iscsi_start_portal_group", 00:06:04.901 "iscsi_delete_portal_group", 00:06:04.901 "iscsi_create_portal_group", 00:06:04.901 "iscsi_get_portal_groups", 00:06:04.901 "iscsi_delete_target_node", 00:06:04.901 "iscsi_target_node_remove_pg_ig_maps", 00:06:04.901 "iscsi_target_node_add_pg_ig_maps", 00:06:04.901 "iscsi_create_target_node", 00:06:04.901 "iscsi_get_target_nodes", 00:06:04.901 "iscsi_delete_initiator_group", 00:06:04.901 "iscsi_initiator_group_remove_initiators", 00:06:04.901 "iscsi_initiator_group_add_initiators", 00:06:04.901 "iscsi_create_initiator_group", 00:06:04.901 "iscsi_get_initiator_groups", 00:06:04.901 "nvmf_set_crdt", 00:06:04.901 "nvmf_set_config", 00:06:04.901 "nvmf_set_max_subsystems", 00:06:04.901 "nvmf_subsystem_get_listeners", 00:06:04.901 "nvmf_subsystem_get_qpairs", 00:06:04.901 "nvmf_subsystem_get_controllers", 00:06:04.901 "nvmf_get_stats", 00:06:04.901 "nvmf_get_transports", 00:06:04.901 "nvmf_create_transport", 00:06:04.901 "nvmf_get_targets", 00:06:04.901 "nvmf_delete_target", 00:06:04.901 "nvmf_create_target", 00:06:04.901 "nvmf_subsystem_allow_any_host", 00:06:04.901 "nvmf_subsystem_remove_host", 00:06:04.901 "nvmf_subsystem_add_host", 00:06:04.901 "nvmf_subsystem_remove_ns", 00:06:04.901 "nvmf_subsystem_add_ns", 00:06:04.901 "nvmf_subsystem_listener_set_ana_state", 00:06:04.901 "nvmf_discovery_get_referrals", 00:06:04.901 "nvmf_discovery_remove_referral", 00:06:04.901 "nvmf_discovery_add_referral", 00:06:04.901 "nvmf_subsystem_remove_listener", 00:06:04.901 "nvmf_subsystem_add_listener", 00:06:04.901 "nvmf_delete_subsystem", 00:06:04.901 "nvmf_create_subsystem", 00:06:04.901 "nvmf_get_subsystems", 00:06:04.901 "env_dpdk_get_mem_stats", 00:06:04.901 "nbd_get_disks", 00:06:04.901 "nbd_stop_disk", 00:06:04.901 "nbd_start_disk", 00:06:04.901 "ublk_recover_disk", 00:06:04.901 "ublk_get_disks", 00:06:04.901 "ublk_stop_disk", 00:06:04.901 "ublk_start_disk", 00:06:04.901 "ublk_destroy_target", 00:06:04.901 "ublk_create_target", 00:06:04.901 "virtio_blk_create_transport", 00:06:04.901 "virtio_blk_get_transports", 00:06:04.901 "vhost_controller_set_coalescing", 00:06:04.901 "vhost_get_controllers", 00:06:04.901 "vhost_delete_controller", 00:06:04.901 "vhost_create_blk_controller", 00:06:04.901 "vhost_scsi_controller_remove_target", 00:06:04.901 "vhost_scsi_controller_add_target", 00:06:04.901 "vhost_start_scsi_controller", 00:06:04.901 "vhost_create_scsi_controller", 00:06:04.901 "thread_set_cpumask", 00:06:04.901 "framework_get_scheduler", 00:06:04.901 "framework_set_scheduler", 00:06:04.901 "framework_get_reactors", 00:06:04.901 "thread_get_io_channels", 00:06:04.901 "thread_get_pollers", 00:06:04.901 "thread_get_stats", 00:06:04.901 "framework_monitor_context_switch", 00:06:04.901 "spdk_kill_instance", 00:06:04.901 "log_enable_timestamps", 00:06:04.901 "log_get_flags", 00:06:04.901 "log_clear_flag", 00:06:04.901 "log_set_flag", 00:06:04.901 "log_get_level", 00:06:04.901 "log_set_level", 00:06:04.901 "log_get_print_level", 00:06:04.901 "log_set_print_level", 00:06:04.901 "framework_enable_cpumask_locks", 00:06:04.901 "framework_disable_cpumask_locks", 00:06:04.901 "framework_wait_init", 00:06:04.901 "framework_start_init", 00:06:04.901 "scsi_get_devices", 00:06:04.901 "bdev_get_histogram", 00:06:04.901 "bdev_enable_histogram", 00:06:04.901 "bdev_set_qos_limit", 00:06:04.901 "bdev_set_qd_sampling_period", 00:06:04.901 "bdev_get_bdevs", 00:06:04.901 "bdev_reset_iostat", 00:06:04.901 "bdev_get_iostat", 00:06:04.901 "bdev_examine", 00:06:04.901 "bdev_wait_for_examine", 00:06:04.901 "bdev_set_options", 00:06:04.901 "notify_get_notifications", 00:06:04.901 "notify_get_types", 00:06:04.901 "accel_get_stats", 00:06:04.901 "accel_set_options", 00:06:04.901 "accel_set_driver", 00:06:04.901 "accel_crypto_key_destroy", 00:06:04.901 "accel_crypto_keys_get", 00:06:04.901 "accel_crypto_key_create", 00:06:04.901 "accel_assign_opc", 00:06:04.901 "accel_get_module_info", 00:06:04.901 "accel_get_opc_assignments", 00:06:04.901 "vmd_rescan", 00:06:04.901 "vmd_remove_device", 00:06:04.901 "vmd_enable", 00:06:04.901 "sock_set_default_impl", 00:06:04.901 "sock_impl_set_options", 00:06:04.901 "sock_impl_get_options", 00:06:04.901 "iobuf_get_stats", 00:06:04.901 "iobuf_set_options", 00:06:04.901 "framework_get_pci_devices", 00:06:04.901 "framework_get_config", 00:06:04.901 "framework_get_subsystems", 00:06:04.901 "vfu_tgt_set_base_path", 00:06:04.901 "trace_get_info", 00:06:04.901 "trace_get_tpoint_group_mask", 00:06:04.901 "trace_disable_tpoint_group", 00:06:04.901 "trace_enable_tpoint_group", 00:06:04.901 "trace_clear_tpoint_mask", 00:06:04.901 "trace_set_tpoint_mask", 00:06:04.902 "spdk_get_version", 00:06:04.902 "rpc_get_methods" 00:06:04.902 ] 00:06:04.902 15:52:28 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:04.902 15:52:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:04.902 15:52:28 -- common/autotest_common.sh@10 -- # set +x 00:06:04.902 15:52:28 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:04.902 15:52:28 -- spdkcli/tcp.sh@38 -- # killprocess 1461815 00:06:04.902 15:52:28 -- common/autotest_common.sh@936 -- # '[' -z 1461815 ']' 00:06:04.902 15:52:28 -- common/autotest_common.sh@940 -- # kill -0 1461815 00:06:04.902 15:52:28 -- common/autotest_common.sh@941 -- # uname 00:06:04.902 15:52:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:04.902 15:52:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1461815 00:06:04.902 15:52:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:04.902 15:52:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:04.902 15:52:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1461815' 00:06:04.902 killing process with pid 1461815 00:06:04.902 15:52:28 -- common/autotest_common.sh@955 -- # kill 1461815 00:06:04.902 15:52:28 -- common/autotest_common.sh@960 -- # wait 1461815 00:06:05.160 00:06:05.160 real 0m1.887s 00:06:05.160 user 0m3.662s 00:06:05.160 sys 0m0.506s 00:06:05.160 15:52:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.160 15:52:28 -- common/autotest_common.sh@10 -- # set +x 00:06:05.160 ************************************ 00:06:05.160 END TEST spdkcli_tcp 00:06:05.160 ************************************ 00:06:05.160 15:52:28 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:05.160 15:52:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.160 15:52:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.160 15:52:28 -- common/autotest_common.sh@10 -- # set +x 00:06:05.160 ************************************ 00:06:05.160 START TEST dpdk_mem_utility 00:06:05.160 ************************************ 00:06:05.160 15:52:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:05.160 * Looking for test storage... 00:06:05.419 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:06:05.419 15:52:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:05.419 15:52:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:05.419 15:52:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:05.419 15:52:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:05.419 15:52:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:05.419 15:52:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:05.419 15:52:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:05.419 15:52:28 -- scripts/common.sh@335 -- # IFS=.-: 00:06:05.419 15:52:28 -- scripts/common.sh@335 -- # read -ra ver1 00:06:05.419 15:52:28 -- scripts/common.sh@336 -- # IFS=.-: 00:06:05.419 15:52:28 -- scripts/common.sh@336 -- # read -ra ver2 00:06:05.419 15:52:28 -- scripts/common.sh@337 -- # local 'op=<' 00:06:05.419 15:52:28 -- scripts/common.sh@339 -- # ver1_l=2 00:06:05.419 15:52:28 -- scripts/common.sh@340 -- # ver2_l=1 00:06:05.419 15:52:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:05.419 15:52:28 -- scripts/common.sh@343 -- # case "$op" in 00:06:05.419 15:52:28 -- scripts/common.sh@344 -- # : 1 00:06:05.419 15:52:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:05.419 15:52:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:05.419 15:52:28 -- scripts/common.sh@364 -- # decimal 1 00:06:05.419 15:52:28 -- scripts/common.sh@352 -- # local d=1 00:06:05.419 15:52:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:05.419 15:52:28 -- scripts/common.sh@354 -- # echo 1 00:06:05.419 15:52:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:05.419 15:52:28 -- scripts/common.sh@365 -- # decimal 2 00:06:05.419 15:52:28 -- scripts/common.sh@352 -- # local d=2 00:06:05.419 15:52:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:05.419 15:52:28 -- scripts/common.sh@354 -- # echo 2 00:06:05.419 15:52:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:05.419 15:52:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:05.419 15:52:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:05.419 15:52:28 -- scripts/common.sh@367 -- # return 0 00:06:05.419 15:52:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:05.419 15:52:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:05.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.419 --rc genhtml_branch_coverage=1 00:06:05.419 --rc genhtml_function_coverage=1 00:06:05.419 --rc genhtml_legend=1 00:06:05.419 --rc geninfo_all_blocks=1 00:06:05.419 --rc geninfo_unexecuted_blocks=1 00:06:05.419 00:06:05.419 ' 00:06:05.419 15:52:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:05.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.419 --rc genhtml_branch_coverage=1 00:06:05.419 --rc genhtml_function_coverage=1 00:06:05.419 --rc genhtml_legend=1 00:06:05.419 --rc geninfo_all_blocks=1 00:06:05.419 --rc geninfo_unexecuted_blocks=1 00:06:05.419 00:06:05.419 ' 00:06:05.419 15:52:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:05.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.419 --rc genhtml_branch_coverage=1 00:06:05.419 --rc genhtml_function_coverage=1 00:06:05.419 --rc genhtml_legend=1 00:06:05.419 --rc geninfo_all_blocks=1 00:06:05.419 --rc geninfo_unexecuted_blocks=1 00:06:05.419 00:06:05.419 ' 00:06:05.419 15:52:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:05.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.419 --rc genhtml_branch_coverage=1 00:06:05.419 --rc genhtml_function_coverage=1 00:06:05.419 --rc genhtml_legend=1 00:06:05.419 --rc geninfo_all_blocks=1 00:06:05.419 --rc geninfo_unexecuted_blocks=1 00:06:05.419 00:06:05.419 ' 00:06:05.419 15:52:28 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:05.419 15:52:28 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1462158 00:06:05.419 15:52:28 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:05.419 15:52:28 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1462158 00:06:05.419 15:52:28 -- common/autotest_common.sh@829 -- # '[' -z 1462158 ']' 00:06:05.419 15:52:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:05.419 15:52:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:05.419 15:52:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:05.419 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:05.419 15:52:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:05.419 15:52:28 -- common/autotest_common.sh@10 -- # set +x 00:06:05.419 [2024-11-18 15:52:28.884265] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.419 [2024-11-18 15:52:28.884349] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1462158 ] 00:06:05.419 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.419 [2024-11-18 15:52:28.940958] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.678 [2024-11-18 15:52:29.038042] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:05.678 [2024-11-18 15:52:29.038228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.612 15:52:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:06.612 15:52:29 -- common/autotest_common.sh@862 -- # return 0 00:06:06.612 15:52:29 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:06.612 15:52:29 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:06.612 15:52:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:06.612 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:06:06.612 { 00:06:06.612 "filename": "/tmp/spdk_mem_dump.txt" 00:06:06.612 } 00:06:06.612 15:52:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:06.612 15:52:29 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:06.612 DPDK memory size 814.000000 MiB in 1 heap(s) 00:06:06.612 1 heaps totaling size 814.000000 MiB 00:06:06.612 size: 814.000000 MiB heap id: 0 00:06:06.612 end heaps---------- 00:06:06.612 8 mempools totaling size 598.116089 MiB 00:06:06.612 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:06.612 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:06.612 size: 84.521057 MiB name: bdev_io_1462158 00:06:06.612 size: 51.011292 MiB name: evtpool_1462158 00:06:06.612 size: 50.003479 MiB name: msgpool_1462158 00:06:06.612 size: 21.763794 MiB name: PDU_Pool 00:06:06.612 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:06.612 size: 0.026123 MiB name: Session_Pool 00:06:06.612 end mempools------- 00:06:06.612 6 memzones totaling size 4.142822 MiB 00:06:06.612 size: 1.000366 MiB name: RG_ring_0_1462158 00:06:06.612 size: 1.000366 MiB name: RG_ring_1_1462158 00:06:06.612 size: 1.000366 MiB name: RG_ring_4_1462158 00:06:06.612 size: 1.000366 MiB name: RG_ring_5_1462158 00:06:06.612 size: 0.125366 MiB name: RG_ring_2_1462158 00:06:06.612 size: 0.015991 MiB name: RG_ring_3_1462158 00:06:06.612 end memzones------- 00:06:06.612 15:52:29 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:06.612 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:06:06.612 list of free elements. size: 12.519348 MiB 00:06:06.612 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:06.612 element at address: 0x200018e00000 with size: 0.999878 MiB 00:06:06.612 element at address: 0x200019000000 with size: 0.999878 MiB 00:06:06.612 element at address: 0x200003e00000 with size: 0.996277 MiB 00:06:06.612 element at address: 0x200031c00000 with size: 0.994446 MiB 00:06:06.612 element at address: 0x200013800000 with size: 0.978699 MiB 00:06:06.612 element at address: 0x200007000000 with size: 0.959839 MiB 00:06:06.612 element at address: 0x200019200000 with size: 0.936584 MiB 00:06:06.612 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:06.612 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:06:06.612 element at address: 0x20000b200000 with size: 0.490723 MiB 00:06:06.612 element at address: 0x200000800000 with size: 0.487793 MiB 00:06:06.612 element at address: 0x200019400000 with size: 0.485657 MiB 00:06:06.612 element at address: 0x200027e00000 with size: 0.410034 MiB 00:06:06.612 element at address: 0x200003a00000 with size: 0.355530 MiB 00:06:06.612 list of standard malloc elements. size: 199.218079 MiB 00:06:06.612 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:06:06.612 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:06:06.612 element at address: 0x200018efff80 with size: 1.000122 MiB 00:06:06.612 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:06:06.612 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:06:06.612 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:06.612 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:06:06.612 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:06.612 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:06:06.612 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:06.612 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:06.612 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:06.612 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:06.612 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:06.612 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:06.613 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:06.613 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:06:06.613 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:06:06.613 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200003adb300 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200003adb500 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200003affa80 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:06.613 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:06:06.613 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:06:06.613 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:06:06.613 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:06:06.613 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:06:06.613 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:06:06.613 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:06:06.613 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:06:06.613 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:06:06.613 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200027e69040 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:06:06.613 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:06:06.613 list of memzone associated elements. size: 602.262573 MiB 00:06:06.613 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:06:06.613 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:06.613 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:06:06.613 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:06.613 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:06:06.613 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1462158_0 00:06:06.613 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:06.613 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1462158_0 00:06:06.613 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:06.613 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1462158_0 00:06:06.613 element at address: 0x2000195be940 with size: 20.255554 MiB 00:06:06.613 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:06.613 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:06:06.613 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:06.613 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:06.613 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1462158 00:06:06.613 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:06.613 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1462158 00:06:06.613 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:06.613 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1462158 00:06:06.613 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:06:06.613 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:06.613 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:06:06.613 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:06.613 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:06:06.613 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:06.613 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:06:06.613 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:06.613 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:06.613 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1462158 00:06:06.613 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:06.613 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1462158 00:06:06.613 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:06:06.613 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1462158 00:06:06.613 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:06:06.613 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1462158 00:06:06.613 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:06:06.613 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1462158 00:06:06.613 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:06:06.613 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:06.613 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:06:06.613 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:06.613 element at address: 0x20001947c540 with size: 0.250488 MiB 00:06:06.613 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:06.613 element at address: 0x200003adf880 with size: 0.125488 MiB 00:06:06.613 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1462158 00:06:06.613 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:06:06.613 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:06.613 element at address: 0x200027e69100 with size: 0.023743 MiB 00:06:06.613 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:06.613 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:06:06.613 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1462158 00:06:06.613 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:06:06.613 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:06.613 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:06.613 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1462158 00:06:06.613 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:06:06.613 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1462158 00:06:06.613 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:06:06.613 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:06.613 15:52:29 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:06.613 15:52:29 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1462158 00:06:06.613 15:52:29 -- common/autotest_common.sh@936 -- # '[' -z 1462158 ']' 00:06:06.613 15:52:29 -- common/autotest_common.sh@940 -- # kill -0 1462158 00:06:06.613 15:52:29 -- common/autotest_common.sh@941 -- # uname 00:06:06.613 15:52:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:06.613 15:52:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1462158 00:06:06.613 15:52:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:06.613 15:52:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:06.613 15:52:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1462158' 00:06:06.613 killing process with pid 1462158 00:06:06.613 15:52:30 -- common/autotest_common.sh@955 -- # kill 1462158 00:06:06.613 15:52:30 -- common/autotest_common.sh@960 -- # wait 1462158 00:06:06.872 00:06:06.872 real 0m1.708s 00:06:06.872 user 0m1.886s 00:06:06.872 sys 0m0.474s 00:06:06.872 15:52:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.872 15:52:30 -- common/autotest_common.sh@10 -- # set +x 00:06:06.872 ************************************ 00:06:06.872 END TEST dpdk_mem_utility 00:06:06.872 ************************************ 00:06:06.872 15:52:30 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:06.872 15:52:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:06.872 15:52:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.872 15:52:30 -- common/autotest_common.sh@10 -- # set +x 00:06:06.872 ************************************ 00:06:06.872 START TEST event 00:06:06.872 ************************************ 00:06:06.872 15:52:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:07.131 * Looking for test storage... 00:06:07.131 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:07.131 15:52:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:07.131 15:52:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:07.131 15:52:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:07.131 15:52:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:07.131 15:52:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:07.131 15:52:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:07.131 15:52:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:07.131 15:52:30 -- scripts/common.sh@335 -- # IFS=.-: 00:06:07.131 15:52:30 -- scripts/common.sh@335 -- # read -ra ver1 00:06:07.131 15:52:30 -- scripts/common.sh@336 -- # IFS=.-: 00:06:07.131 15:52:30 -- scripts/common.sh@336 -- # read -ra ver2 00:06:07.131 15:52:30 -- scripts/common.sh@337 -- # local 'op=<' 00:06:07.131 15:52:30 -- scripts/common.sh@339 -- # ver1_l=2 00:06:07.131 15:52:30 -- scripts/common.sh@340 -- # ver2_l=1 00:06:07.131 15:52:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:07.131 15:52:30 -- scripts/common.sh@343 -- # case "$op" in 00:06:07.131 15:52:30 -- scripts/common.sh@344 -- # : 1 00:06:07.131 15:52:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:07.131 15:52:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:07.131 15:52:30 -- scripts/common.sh@364 -- # decimal 1 00:06:07.131 15:52:30 -- scripts/common.sh@352 -- # local d=1 00:06:07.131 15:52:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:07.131 15:52:30 -- scripts/common.sh@354 -- # echo 1 00:06:07.131 15:52:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:07.131 15:52:30 -- scripts/common.sh@365 -- # decimal 2 00:06:07.131 15:52:30 -- scripts/common.sh@352 -- # local d=2 00:06:07.131 15:52:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:07.131 15:52:30 -- scripts/common.sh@354 -- # echo 2 00:06:07.131 15:52:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:07.131 15:52:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:07.131 15:52:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:07.131 15:52:30 -- scripts/common.sh@367 -- # return 0 00:06:07.131 15:52:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:07.131 15:52:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:07.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.131 --rc genhtml_branch_coverage=1 00:06:07.131 --rc genhtml_function_coverage=1 00:06:07.131 --rc genhtml_legend=1 00:06:07.131 --rc geninfo_all_blocks=1 00:06:07.131 --rc geninfo_unexecuted_blocks=1 00:06:07.131 00:06:07.131 ' 00:06:07.131 15:52:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:07.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.131 --rc genhtml_branch_coverage=1 00:06:07.131 --rc genhtml_function_coverage=1 00:06:07.131 --rc genhtml_legend=1 00:06:07.131 --rc geninfo_all_blocks=1 00:06:07.131 --rc geninfo_unexecuted_blocks=1 00:06:07.131 00:06:07.131 ' 00:06:07.131 15:52:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:07.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.131 --rc genhtml_branch_coverage=1 00:06:07.131 --rc genhtml_function_coverage=1 00:06:07.131 --rc genhtml_legend=1 00:06:07.131 --rc geninfo_all_blocks=1 00:06:07.131 --rc geninfo_unexecuted_blocks=1 00:06:07.131 00:06:07.131 ' 00:06:07.131 15:52:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:07.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:07.131 --rc genhtml_branch_coverage=1 00:06:07.131 --rc genhtml_function_coverage=1 00:06:07.131 --rc genhtml_legend=1 00:06:07.131 --rc geninfo_all_blocks=1 00:06:07.131 --rc geninfo_unexecuted_blocks=1 00:06:07.131 00:06:07.131 ' 00:06:07.131 15:52:30 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:07.131 15:52:30 -- bdev/nbd_common.sh@6 -- # set -e 00:06:07.131 15:52:30 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:07.131 15:52:30 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:07.131 15:52:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.131 15:52:30 -- common/autotest_common.sh@10 -- # set +x 00:06:07.131 ************************************ 00:06:07.131 START TEST event_perf 00:06:07.131 ************************************ 00:06:07.131 15:52:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:07.131 Running I/O for 1 seconds...[2024-11-18 15:52:30.599288] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.131 [2024-11-18 15:52:30.599373] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1462373 ] 00:06:07.131 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.131 [2024-11-18 15:52:30.660848] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:07.390 [2024-11-18 15:52:30.754466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:07.390 [2024-11-18 15:52:30.754524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:07.390 [2024-11-18 15:52:30.754643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:07.390 [2024-11-18 15:52:30.754647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.323 Running I/O for 1 seconds... 00:06:08.323 lcore 0: 230732 00:06:08.323 lcore 1: 230732 00:06:08.323 lcore 2: 230731 00:06:08.323 lcore 3: 230731 00:06:08.323 done. 00:06:08.323 00:06:08.323 real 0m1.254s 00:06:08.323 user 0m4.172s 00:06:08.323 sys 0m0.077s 00:06:08.323 15:52:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:08.323 15:52:31 -- common/autotest_common.sh@10 -- # set +x 00:06:08.323 ************************************ 00:06:08.323 END TEST event_perf 00:06:08.323 ************************************ 00:06:08.323 15:52:31 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:08.323 15:52:31 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:08.323 15:52:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.323 15:52:31 -- common/autotest_common.sh@10 -- # set +x 00:06:08.323 ************************************ 00:06:08.323 START TEST event_reactor 00:06:08.323 ************************************ 00:06:08.323 15:52:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:08.323 [2024-11-18 15:52:31.875513] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:08.323 [2024-11-18 15:52:31.875616] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1462530 ] 00:06:08.323 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.582 [2024-11-18 15:52:31.936036] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.582 [2024-11-18 15:52:32.025753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.518 test_start 00:06:09.518 oneshot 00:06:09.518 tick 100 00:06:09.518 tick 100 00:06:09.518 tick 250 00:06:09.518 tick 100 00:06:09.518 tick 100 00:06:09.518 tick 250 00:06:09.518 tick 500 00:06:09.518 tick 100 00:06:09.518 tick 100 00:06:09.518 tick 100 00:06:09.518 tick 250 00:06:09.518 tick 100 00:06:09.518 tick 100 00:06:09.518 test_end 00:06:09.518 00:06:09.518 real 0m1.242s 00:06:09.518 user 0m1.165s 00:06:09.518 sys 0m0.072s 00:06:09.518 15:52:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.518 15:52:33 -- common/autotest_common.sh@10 -- # set +x 00:06:09.518 ************************************ 00:06:09.518 END TEST event_reactor 00:06:09.518 ************************************ 00:06:09.776 15:52:33 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:09.776 15:52:33 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:09.776 15:52:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.776 15:52:33 -- common/autotest_common.sh@10 -- # set +x 00:06:09.776 ************************************ 00:06:09.776 START TEST event_reactor_perf 00:06:09.776 ************************************ 00:06:09.776 15:52:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:09.776 [2024-11-18 15:52:33.142269] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.776 [2024-11-18 15:52:33.142357] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1462715 ] 00:06:09.776 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.776 [2024-11-18 15:52:33.202356] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.776 [2024-11-18 15:52:33.292098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.150 test_start 00:06:11.150 test_end 00:06:11.150 Performance: 356734 events per second 00:06:11.150 00:06:11.150 real 0m1.240s 00:06:11.150 user 0m1.153s 00:06:11.150 sys 0m0.082s 00:06:11.150 15:52:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:11.150 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.150 ************************************ 00:06:11.150 END TEST event_reactor_perf 00:06:11.150 ************************************ 00:06:11.150 15:52:34 -- event/event.sh@49 -- # uname -s 00:06:11.150 15:52:34 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:11.150 15:52:34 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:11.150 15:52:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:11.150 15:52:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.150 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.150 ************************************ 00:06:11.150 START TEST event_scheduler 00:06:11.150 ************************************ 00:06:11.150 15:52:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:11.150 * Looking for test storage... 00:06:11.150 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:11.150 15:52:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:11.150 15:52:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:11.150 15:52:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:11.150 15:52:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:11.150 15:52:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:11.150 15:52:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:11.150 15:52:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:11.150 15:52:34 -- scripts/common.sh@335 -- # IFS=.-: 00:06:11.150 15:52:34 -- scripts/common.sh@335 -- # read -ra ver1 00:06:11.150 15:52:34 -- scripts/common.sh@336 -- # IFS=.-: 00:06:11.150 15:52:34 -- scripts/common.sh@336 -- # read -ra ver2 00:06:11.150 15:52:34 -- scripts/common.sh@337 -- # local 'op=<' 00:06:11.150 15:52:34 -- scripts/common.sh@339 -- # ver1_l=2 00:06:11.150 15:52:34 -- scripts/common.sh@340 -- # ver2_l=1 00:06:11.150 15:52:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:11.150 15:52:34 -- scripts/common.sh@343 -- # case "$op" in 00:06:11.150 15:52:34 -- scripts/common.sh@344 -- # : 1 00:06:11.150 15:52:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:11.150 15:52:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:11.150 15:52:34 -- scripts/common.sh@364 -- # decimal 1 00:06:11.150 15:52:34 -- scripts/common.sh@352 -- # local d=1 00:06:11.150 15:52:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:11.150 15:52:34 -- scripts/common.sh@354 -- # echo 1 00:06:11.150 15:52:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:11.150 15:52:34 -- scripts/common.sh@365 -- # decimal 2 00:06:11.150 15:52:34 -- scripts/common.sh@352 -- # local d=2 00:06:11.150 15:52:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:11.150 15:52:34 -- scripts/common.sh@354 -- # echo 2 00:06:11.150 15:52:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:11.150 15:52:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:11.150 15:52:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:11.150 15:52:34 -- scripts/common.sh@367 -- # return 0 00:06:11.150 15:52:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:11.150 15:52:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:11.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.150 --rc genhtml_branch_coverage=1 00:06:11.150 --rc genhtml_function_coverage=1 00:06:11.150 --rc genhtml_legend=1 00:06:11.150 --rc geninfo_all_blocks=1 00:06:11.150 --rc geninfo_unexecuted_blocks=1 00:06:11.150 00:06:11.150 ' 00:06:11.150 15:52:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:11.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.150 --rc genhtml_branch_coverage=1 00:06:11.150 --rc genhtml_function_coverage=1 00:06:11.150 --rc genhtml_legend=1 00:06:11.150 --rc geninfo_all_blocks=1 00:06:11.150 --rc geninfo_unexecuted_blocks=1 00:06:11.150 00:06:11.150 ' 00:06:11.150 15:52:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:11.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.150 --rc genhtml_branch_coverage=1 00:06:11.150 --rc genhtml_function_coverage=1 00:06:11.150 --rc genhtml_legend=1 00:06:11.150 --rc geninfo_all_blocks=1 00:06:11.150 --rc geninfo_unexecuted_blocks=1 00:06:11.150 00:06:11.150 ' 00:06:11.150 15:52:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:11.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:11.151 --rc genhtml_branch_coverage=1 00:06:11.151 --rc genhtml_function_coverage=1 00:06:11.151 --rc genhtml_legend=1 00:06:11.151 --rc geninfo_all_blocks=1 00:06:11.151 --rc geninfo_unexecuted_blocks=1 00:06:11.151 00:06:11.151 ' 00:06:11.151 15:52:34 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:11.151 15:52:34 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1463002 00:06:11.151 15:52:34 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:11.151 15:52:34 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:11.151 15:52:34 -- scheduler/scheduler.sh@37 -- # waitforlisten 1463002 00:06:11.151 15:52:34 -- common/autotest_common.sh@829 -- # '[' -z 1463002 ']' 00:06:11.151 15:52:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:11.151 15:52:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:11.151 15:52:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:11.151 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:11.151 15:52:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:11.151 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.151 [2024-11-18 15:52:34.574527] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:11.151 [2024-11-18 15:52:34.574634] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1463002 ] 00:06:11.151 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.151 [2024-11-18 15:52:34.632471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:11.151 [2024-11-18 15:52:34.721983] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.151 [2024-11-18 15:52:34.722042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:11.151 [2024-11-18 15:52:34.722107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:11.151 [2024-11-18 15:52:34.722110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:11.409 15:52:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:11.409 15:52:34 -- common/autotest_common.sh@862 -- # return 0 00:06:11.409 15:52:34 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:11.409 15:52:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.409 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.409 POWER: Env isn't set yet! 00:06:11.409 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:11.409 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:11.409 POWER: Cannot get available frequencies of lcore 0 00:06:11.409 POWER: Attempting to initialise PSTAT power management... 00:06:11.409 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:11.409 POWER: Initialized successfully for lcore 0 power management 00:06:11.409 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:11.409 POWER: Initialized successfully for lcore 1 power management 00:06:11.409 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:11.409 POWER: Initialized successfully for lcore 2 power management 00:06:11.409 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:11.409 POWER: Initialized successfully for lcore 3 power management 00:06:11.409 [2024-11-18 15:52:34.821787] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:11.409 [2024-11-18 15:52:34.821805] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:11.409 [2024-11-18 15:52:34.821816] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:11.409 15:52:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.409 15:52:34 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:11.409 15:52:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.409 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.409 [2024-11-18 15:52:34.921208] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:11.409 15:52:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.409 15:52:34 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:11.409 15:52:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:11.409 15:52:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.409 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.409 ************************************ 00:06:11.409 START TEST scheduler_create_thread 00:06:11.409 ************************************ 00:06:11.409 15:52:34 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:06:11.409 15:52:34 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:11.409 15:52:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.409 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.409 2 00:06:11.410 15:52:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.410 15:52:34 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:11.410 15:52:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.410 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.410 3 00:06:11.410 15:52:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.410 15:52:34 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:11.410 15:52:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.410 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.410 4 00:06:11.410 15:52:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.410 15:52:34 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:11.410 15:52:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.410 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.410 5 00:06:11.410 15:52:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.410 15:52:34 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:11.410 15:52:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.410 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.410 6 00:06:11.410 15:52:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.410 15:52:34 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:11.410 15:52:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.410 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.410 7 00:06:11.410 15:52:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.410 15:52:34 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:11.410 15:52:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.410 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:11.668 8 00:06:11.668 15:52:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.668 15:52:35 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:11.668 15:52:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.668 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:06:11.668 9 00:06:11.668 15:52:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.668 15:52:35 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:11.668 15:52:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.668 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:06:11.668 10 00:06:11.668 15:52:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.668 15:52:35 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:11.668 15:52:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.668 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:06:11.668 15:52:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.668 15:52:35 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:11.668 15:52:35 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:11.668 15:52:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.668 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:06:11.926 15:52:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.926 15:52:35 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:11.927 15:52:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.927 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:06:13.826 15:52:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:13.826 15:52:36 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:13.826 15:52:36 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:13.826 15:52:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:13.826 15:52:36 -- common/autotest_common.sh@10 -- # set +x 00:06:14.759 15:52:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:14.759 00:06:14.759 real 0m3.099s 00:06:14.759 user 0m0.011s 00:06:14.759 sys 0m0.002s 00:06:14.759 15:52:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:14.759 15:52:38 -- common/autotest_common.sh@10 -- # set +x 00:06:14.759 ************************************ 00:06:14.759 END TEST scheduler_create_thread 00:06:14.759 ************************************ 00:06:14.759 15:52:38 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:14.759 15:52:38 -- scheduler/scheduler.sh@46 -- # killprocess 1463002 00:06:14.759 15:52:38 -- common/autotest_common.sh@936 -- # '[' -z 1463002 ']' 00:06:14.759 15:52:38 -- common/autotest_common.sh@940 -- # kill -0 1463002 00:06:14.759 15:52:38 -- common/autotest_common.sh@941 -- # uname 00:06:14.759 15:52:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:14.759 15:52:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1463002 00:06:14.759 15:52:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:14.759 15:52:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:14.759 15:52:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1463002' 00:06:14.759 killing process with pid 1463002 00:06:14.759 15:52:38 -- common/autotest_common.sh@955 -- # kill 1463002 00:06:14.759 15:52:38 -- common/autotest_common.sh@960 -- # wait 1463002 00:06:15.017 [2024-11-18 15:52:38.405229] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:15.017 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:15.017 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:15.017 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:15.017 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:15.017 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:15.017 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:15.017 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:15.017 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:15.276 00:06:15.276 real 0m4.259s 00:06:15.276 user 0m6.946s 00:06:15.276 sys 0m0.318s 00:06:15.276 15:52:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:15.276 15:52:38 -- common/autotest_common.sh@10 -- # set +x 00:06:15.276 ************************************ 00:06:15.276 END TEST event_scheduler 00:06:15.276 ************************************ 00:06:15.276 15:52:38 -- event/event.sh@51 -- # modprobe -n nbd 00:06:15.276 15:52:38 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:15.276 15:52:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:15.276 15:52:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.276 15:52:38 -- common/autotest_common.sh@10 -- # set +x 00:06:15.276 ************************************ 00:06:15.276 START TEST app_repeat 00:06:15.276 ************************************ 00:06:15.276 15:52:38 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:06:15.276 15:52:38 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.276 15:52:38 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.276 15:52:38 -- event/event.sh@13 -- # local nbd_list 00:06:15.276 15:52:38 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:15.276 15:52:38 -- event/event.sh@14 -- # local bdev_list 00:06:15.276 15:52:38 -- event/event.sh@15 -- # local repeat_times=4 00:06:15.276 15:52:38 -- event/event.sh@17 -- # modprobe nbd 00:06:15.276 15:52:38 -- event/event.sh@19 -- # repeat_pid=1463473 00:06:15.276 15:52:38 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:15.276 15:52:38 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:15.276 15:52:38 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1463473' 00:06:15.276 Process app_repeat pid: 1463473 00:06:15.276 15:52:38 -- event/event.sh@23 -- # for i in {0..2} 00:06:15.276 15:52:38 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:15.276 spdk_app_start Round 0 00:06:15.276 15:52:38 -- event/event.sh@25 -- # waitforlisten 1463473 /var/tmp/spdk-nbd.sock 00:06:15.276 15:52:38 -- common/autotest_common.sh@829 -- # '[' -z 1463473 ']' 00:06:15.276 15:52:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:15.276 15:52:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:15.276 15:52:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:15.276 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:15.276 15:52:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:15.276 15:52:38 -- common/autotest_common.sh@10 -- # set +x 00:06:15.276 [2024-11-18 15:52:38.717463] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.276 [2024-11-18 15:52:38.717541] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1463473 ] 00:06:15.276 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.276 [2024-11-18 15:52:38.778579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:15.534 [2024-11-18 15:52:38.873808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:15.534 [2024-11-18 15:52:38.873813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.467 15:52:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:16.467 15:52:39 -- common/autotest_common.sh@862 -- # return 0 00:06:16.467 15:52:39 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:16.467 Malloc0 00:06:16.467 15:52:39 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:16.725 Malloc1 00:06:16.725 15:52:40 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@12 -- # local i 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:16.725 15:52:40 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:16.983 /dev/nbd0 00:06:16.983 15:52:40 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:16.983 15:52:40 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:16.983 15:52:40 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:16.983 15:52:40 -- common/autotest_common.sh@867 -- # local i 00:06:16.983 15:52:40 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:16.983 15:52:40 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:16.983 15:52:40 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:16.983 15:52:40 -- common/autotest_common.sh@871 -- # break 00:06:16.983 15:52:40 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:16.983 15:52:40 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:16.983 15:52:40 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:16.983 1+0 records in 00:06:16.983 1+0 records out 00:06:16.983 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00024072 s, 17.0 MB/s 00:06:16.983 15:52:40 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:16.983 15:52:40 -- common/autotest_common.sh@884 -- # size=4096 00:06:16.983 15:52:40 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:16.983 15:52:40 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:16.983 15:52:40 -- common/autotest_common.sh@887 -- # return 0 00:06:16.983 15:52:40 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:16.983 15:52:40 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:16.983 15:52:40 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:17.242 /dev/nbd1 00:06:17.242 15:52:40 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:17.242 15:52:40 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:17.242 15:52:40 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:17.242 15:52:40 -- common/autotest_common.sh@867 -- # local i 00:06:17.242 15:52:40 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:17.242 15:52:40 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:17.242 15:52:40 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:17.242 15:52:40 -- common/autotest_common.sh@871 -- # break 00:06:17.242 15:52:40 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:17.242 15:52:40 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:17.242 15:52:40 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:17.499 1+0 records in 00:06:17.499 1+0 records out 00:06:17.499 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000207516 s, 19.7 MB/s 00:06:17.499 15:52:40 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:17.499 15:52:40 -- common/autotest_common.sh@884 -- # size=4096 00:06:17.499 15:52:40 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:17.499 15:52:40 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:17.499 15:52:40 -- common/autotest_common.sh@887 -- # return 0 00:06:17.499 15:52:40 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:17.499 15:52:40 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:17.499 15:52:40 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:17.499 15:52:40 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:17.499 15:52:40 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:17.757 { 00:06:17.757 "nbd_device": "/dev/nbd0", 00:06:17.757 "bdev_name": "Malloc0" 00:06:17.757 }, 00:06:17.757 { 00:06:17.757 "nbd_device": "/dev/nbd1", 00:06:17.757 "bdev_name": "Malloc1" 00:06:17.757 } 00:06:17.757 ]' 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:17.757 { 00:06:17.757 "nbd_device": "/dev/nbd0", 00:06:17.757 "bdev_name": "Malloc0" 00:06:17.757 }, 00:06:17.757 { 00:06:17.757 "nbd_device": "/dev/nbd1", 00:06:17.757 "bdev_name": "Malloc1" 00:06:17.757 } 00:06:17.757 ]' 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:17.757 /dev/nbd1' 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:17.757 /dev/nbd1' 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@65 -- # count=2 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@95 -- # count=2 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:17.757 256+0 records in 00:06:17.757 256+0 records out 00:06:17.757 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00514663 s, 204 MB/s 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:17.757 256+0 records in 00:06:17.757 256+0 records out 00:06:17.757 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194158 s, 54.0 MB/s 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:17.757 256+0 records in 00:06:17.757 256+0 records out 00:06:17.757 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235467 s, 44.5 MB/s 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:17.757 15:52:41 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:17.758 15:52:41 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:17.758 15:52:41 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:17.758 15:52:41 -- bdev/nbd_common.sh@51 -- # local i 00:06:17.758 15:52:41 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:17.758 15:52:41 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:18.015 15:52:41 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:18.015 15:52:41 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:18.015 15:52:41 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:18.015 15:52:41 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:18.015 15:52:41 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:18.015 15:52:41 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:18.015 15:52:41 -- bdev/nbd_common.sh@41 -- # break 00:06:18.015 15:52:41 -- bdev/nbd_common.sh@45 -- # return 0 00:06:18.015 15:52:41 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:18.015 15:52:41 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:18.273 15:52:41 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:18.273 15:52:41 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:18.273 15:52:41 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:18.273 15:52:41 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:18.273 15:52:41 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:18.273 15:52:41 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:18.273 15:52:41 -- bdev/nbd_common.sh@41 -- # break 00:06:18.273 15:52:41 -- bdev/nbd_common.sh@45 -- # return 0 00:06:18.273 15:52:41 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:18.273 15:52:41 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:18.273 15:52:41 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@65 -- # true 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@65 -- # count=0 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@104 -- # count=0 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:18.531 15:52:42 -- bdev/nbd_common.sh@109 -- # return 0 00:06:18.531 15:52:42 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:18.788 15:52:42 -- event/event.sh@35 -- # sleep 3 00:06:19.047 [2024-11-18 15:52:42.577470] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:19.305 [2024-11-18 15:52:42.665906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.305 [2024-11-18 15:52:42.665907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:19.305 [2024-11-18 15:52:42.727259] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:19.305 [2024-11-18 15:52:42.727343] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:21.830 15:52:45 -- event/event.sh@23 -- # for i in {0..2} 00:06:21.830 15:52:45 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:21.830 spdk_app_start Round 1 00:06:21.830 15:52:45 -- event/event.sh@25 -- # waitforlisten 1463473 /var/tmp/spdk-nbd.sock 00:06:21.830 15:52:45 -- common/autotest_common.sh@829 -- # '[' -z 1463473 ']' 00:06:21.830 15:52:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:21.830 15:52:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:21.830 15:52:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:21.830 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:21.830 15:52:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:21.830 15:52:45 -- common/autotest_common.sh@10 -- # set +x 00:06:22.088 15:52:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:22.088 15:52:45 -- common/autotest_common.sh@862 -- # return 0 00:06:22.088 15:52:45 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:22.346 Malloc0 00:06:22.346 15:52:45 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:22.605 Malloc1 00:06:22.605 15:52:46 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@12 -- # local i 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:22.605 15:52:46 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:22.863 /dev/nbd0 00:06:22.863 15:52:46 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:22.863 15:52:46 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:22.863 15:52:46 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:22.863 15:52:46 -- common/autotest_common.sh@867 -- # local i 00:06:22.863 15:52:46 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:22.863 15:52:46 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:22.863 15:52:46 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:22.863 15:52:46 -- common/autotest_common.sh@871 -- # break 00:06:22.863 15:52:46 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:22.863 15:52:46 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:22.863 15:52:46 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:22.863 1+0 records in 00:06:22.863 1+0 records out 00:06:22.863 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000151513 s, 27.0 MB/s 00:06:22.863 15:52:46 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:22.863 15:52:46 -- common/autotest_common.sh@884 -- # size=4096 00:06:22.863 15:52:46 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:22.863 15:52:46 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:22.863 15:52:46 -- common/autotest_common.sh@887 -- # return 0 00:06:22.863 15:52:46 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:22.863 15:52:46 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:22.863 15:52:46 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:23.121 /dev/nbd1 00:06:23.379 15:52:46 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:23.379 15:52:46 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:23.379 15:52:46 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:23.379 15:52:46 -- common/autotest_common.sh@867 -- # local i 00:06:23.379 15:52:46 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:23.379 15:52:46 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:23.379 15:52:46 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:23.379 15:52:46 -- common/autotest_common.sh@871 -- # break 00:06:23.379 15:52:46 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:23.379 15:52:46 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:23.379 15:52:46 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:23.379 1+0 records in 00:06:23.379 1+0 records out 00:06:23.379 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000196097 s, 20.9 MB/s 00:06:23.379 15:52:46 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:23.379 15:52:46 -- common/autotest_common.sh@884 -- # size=4096 00:06:23.379 15:52:46 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:23.379 15:52:46 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:23.379 15:52:46 -- common/autotest_common.sh@887 -- # return 0 00:06:23.379 15:52:46 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:23.379 15:52:46 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:23.379 15:52:46 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:23.379 15:52:46 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:23.379 15:52:46 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:23.637 15:52:46 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:23.637 { 00:06:23.637 "nbd_device": "/dev/nbd0", 00:06:23.637 "bdev_name": "Malloc0" 00:06:23.637 }, 00:06:23.637 { 00:06:23.637 "nbd_device": "/dev/nbd1", 00:06:23.637 "bdev_name": "Malloc1" 00:06:23.637 } 00:06:23.637 ]' 00:06:23.637 15:52:46 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:23.637 { 00:06:23.637 "nbd_device": "/dev/nbd0", 00:06:23.637 "bdev_name": "Malloc0" 00:06:23.637 }, 00:06:23.637 { 00:06:23.637 "nbd_device": "/dev/nbd1", 00:06:23.637 "bdev_name": "Malloc1" 00:06:23.637 } 00:06:23.637 ]' 00:06:23.637 15:52:46 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:23.637 /dev/nbd1' 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:23.637 /dev/nbd1' 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@65 -- # count=2 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@95 -- # count=2 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:23.637 256+0 records in 00:06:23.637 256+0 records out 00:06:23.637 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00514198 s, 204 MB/s 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:23.637 256+0 records in 00:06:23.637 256+0 records out 00:06:23.637 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021925 s, 47.8 MB/s 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:23.637 256+0 records in 00:06:23.637 256+0 records out 00:06:23.637 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021078 s, 49.7 MB/s 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:23.637 15:52:47 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@51 -- # local i 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:23.638 15:52:47 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:23.896 15:52:47 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:23.896 15:52:47 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:23.896 15:52:47 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:23.896 15:52:47 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:23.896 15:52:47 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:23.896 15:52:47 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:23.896 15:52:47 -- bdev/nbd_common.sh@41 -- # break 00:06:23.896 15:52:47 -- bdev/nbd_common.sh@45 -- # return 0 00:06:23.896 15:52:47 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:23.896 15:52:47 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:24.154 15:52:47 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:24.154 15:52:47 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:24.154 15:52:47 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:24.154 15:52:47 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:24.154 15:52:47 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:24.154 15:52:47 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:24.154 15:52:47 -- bdev/nbd_common.sh@41 -- # break 00:06:24.154 15:52:47 -- bdev/nbd_common.sh@45 -- # return 0 00:06:24.154 15:52:47 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:24.154 15:52:47 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:24.154 15:52:47 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@65 -- # true 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@65 -- # count=0 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@104 -- # count=0 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:24.412 15:52:47 -- bdev/nbd_common.sh@109 -- # return 0 00:06:24.412 15:52:47 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:24.670 15:52:48 -- event/event.sh@35 -- # sleep 3 00:06:24.928 [2024-11-18 15:52:48.474181] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:25.186 [2024-11-18 15:52:48.562220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:25.186 [2024-11-18 15:52:48.562225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.186 [2024-11-18 15:52:48.621140] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:25.186 [2024-11-18 15:52:48.621212] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:27.714 15:52:51 -- event/event.sh@23 -- # for i in {0..2} 00:06:27.714 15:52:51 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:27.714 spdk_app_start Round 2 00:06:27.714 15:52:51 -- event/event.sh@25 -- # waitforlisten 1463473 /var/tmp/spdk-nbd.sock 00:06:27.714 15:52:51 -- common/autotest_common.sh@829 -- # '[' -z 1463473 ']' 00:06:27.714 15:52:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:27.714 15:52:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.714 15:52:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:27.714 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:27.714 15:52:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.714 15:52:51 -- common/autotest_common.sh@10 -- # set +x 00:06:27.972 15:52:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:27.972 15:52:51 -- common/autotest_common.sh@862 -- # return 0 00:06:27.972 15:52:51 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:28.230 Malloc0 00:06:28.231 15:52:51 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:28.489 Malloc1 00:06:28.489 15:52:52 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@12 -- # local i 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:28.489 15:52:52 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:28.748 /dev/nbd0 00:06:28.748 15:52:52 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:28.748 15:52:52 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:28.748 15:52:52 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:28.748 15:52:52 -- common/autotest_common.sh@867 -- # local i 00:06:28.748 15:52:52 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:28.748 15:52:52 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:28.748 15:52:52 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:28.748 15:52:52 -- common/autotest_common.sh@871 -- # break 00:06:28.748 15:52:52 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:28.748 15:52:52 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:28.748 15:52:52 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:28.748 1+0 records in 00:06:28.748 1+0 records out 00:06:28.748 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000208171 s, 19.7 MB/s 00:06:28.748 15:52:52 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:28.748 15:52:52 -- common/autotest_common.sh@884 -- # size=4096 00:06:28.748 15:52:52 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:28.748 15:52:52 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:28.748 15:52:52 -- common/autotest_common.sh@887 -- # return 0 00:06:28.748 15:52:52 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:28.748 15:52:52 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:28.748 15:52:52 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:29.006 /dev/nbd1 00:06:29.006 15:52:52 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:29.006 15:52:52 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:29.006 15:52:52 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:29.006 15:52:52 -- common/autotest_common.sh@867 -- # local i 00:06:29.006 15:52:52 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:29.006 15:52:52 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:29.006 15:52:52 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:29.006 15:52:52 -- common/autotest_common.sh@871 -- # break 00:06:29.006 15:52:52 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:29.006 15:52:52 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:29.006 15:52:52 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:29.006 1+0 records in 00:06:29.006 1+0 records out 00:06:29.006 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000212326 s, 19.3 MB/s 00:06:29.264 15:52:52 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:29.264 15:52:52 -- common/autotest_common.sh@884 -- # size=4096 00:06:29.264 15:52:52 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:29.264 15:52:52 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:29.264 15:52:52 -- common/autotest_common.sh@887 -- # return 0 00:06:29.264 15:52:52 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:29.264 15:52:52 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:29.264 15:52:52 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:29.264 15:52:52 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:29.264 15:52:52 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:29.264 15:52:52 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:29.264 { 00:06:29.264 "nbd_device": "/dev/nbd0", 00:06:29.264 "bdev_name": "Malloc0" 00:06:29.264 }, 00:06:29.264 { 00:06:29.264 "nbd_device": "/dev/nbd1", 00:06:29.264 "bdev_name": "Malloc1" 00:06:29.264 } 00:06:29.264 ]' 00:06:29.264 15:52:52 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:29.264 { 00:06:29.264 "nbd_device": "/dev/nbd0", 00:06:29.264 "bdev_name": "Malloc0" 00:06:29.264 }, 00:06:29.264 { 00:06:29.264 "nbd_device": "/dev/nbd1", 00:06:29.264 "bdev_name": "Malloc1" 00:06:29.264 } 00:06:29.264 ]' 00:06:29.264 15:52:52 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:29.523 /dev/nbd1' 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:29.523 /dev/nbd1' 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@65 -- # count=2 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@95 -- # count=2 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:29.523 256+0 records in 00:06:29.523 256+0 records out 00:06:29.523 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00507006 s, 207 MB/s 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:29.523 256+0 records in 00:06:29.523 256+0 records out 00:06:29.523 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204723 s, 51.2 MB/s 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:29.523 256+0 records in 00:06:29.523 256+0 records out 00:06:29.523 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023547 s, 44.5 MB/s 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@51 -- # local i 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:29.523 15:52:52 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:29.781 15:52:53 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:29.781 15:52:53 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:29.781 15:52:53 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:29.781 15:52:53 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:29.781 15:52:53 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:29.781 15:52:53 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:29.781 15:52:53 -- bdev/nbd_common.sh@41 -- # break 00:06:29.781 15:52:53 -- bdev/nbd_common.sh@45 -- # return 0 00:06:29.781 15:52:53 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:29.781 15:52:53 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:30.039 15:52:53 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:30.039 15:52:53 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:30.039 15:52:53 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:30.039 15:52:53 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:30.039 15:52:53 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:30.039 15:52:53 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:30.039 15:52:53 -- bdev/nbd_common.sh@41 -- # break 00:06:30.039 15:52:53 -- bdev/nbd_common.sh@45 -- # return 0 00:06:30.039 15:52:53 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:30.039 15:52:53 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:30.039 15:52:53 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@65 -- # true 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@65 -- # count=0 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@104 -- # count=0 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:30.296 15:52:53 -- bdev/nbd_common.sh@109 -- # return 0 00:06:30.296 15:52:53 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:30.554 15:52:54 -- event/event.sh@35 -- # sleep 3 00:06:30.812 [2024-11-18 15:52:54.326098] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:31.070 [2024-11-18 15:52:54.413799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:31.070 [2024-11-18 15:52:54.413804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.070 [2024-11-18 15:52:54.473083] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:31.070 [2024-11-18 15:52:54.473158] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:33.599 15:52:57 -- event/event.sh@38 -- # waitforlisten 1463473 /var/tmp/spdk-nbd.sock 00:06:33.599 15:52:57 -- common/autotest_common.sh@829 -- # '[' -z 1463473 ']' 00:06:33.599 15:52:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:33.599 15:52:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:33.599 15:52:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:33.599 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:33.599 15:52:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:33.599 15:52:57 -- common/autotest_common.sh@10 -- # set +x 00:06:33.858 15:52:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:33.858 15:52:57 -- common/autotest_common.sh@862 -- # return 0 00:06:33.858 15:52:57 -- event/event.sh@39 -- # killprocess 1463473 00:06:33.858 15:52:57 -- common/autotest_common.sh@936 -- # '[' -z 1463473 ']' 00:06:33.858 15:52:57 -- common/autotest_common.sh@940 -- # kill -0 1463473 00:06:33.858 15:52:57 -- common/autotest_common.sh@941 -- # uname 00:06:33.858 15:52:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:33.858 15:52:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1463473 00:06:33.858 15:52:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:33.858 15:52:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:33.858 15:52:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1463473' 00:06:33.858 killing process with pid 1463473 00:06:33.858 15:52:57 -- common/autotest_common.sh@955 -- # kill 1463473 00:06:33.858 15:52:57 -- common/autotest_common.sh@960 -- # wait 1463473 00:06:34.116 spdk_app_start is called in Round 0. 00:06:34.116 Shutdown signal received, stop current app iteration 00:06:34.116 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:34.116 spdk_app_start is called in Round 1. 00:06:34.116 Shutdown signal received, stop current app iteration 00:06:34.116 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:34.116 spdk_app_start is called in Round 2. 00:06:34.116 Shutdown signal received, stop current app iteration 00:06:34.116 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:34.116 spdk_app_start is called in Round 3. 00:06:34.116 Shutdown signal received, stop current app iteration 00:06:34.116 15:52:57 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:34.116 15:52:57 -- event/event.sh@42 -- # return 0 00:06:34.116 00:06:34.116 real 0m18.904s 00:06:34.116 user 0m41.539s 00:06:34.116 sys 0m3.155s 00:06:34.116 15:52:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.116 15:52:57 -- common/autotest_common.sh@10 -- # set +x 00:06:34.116 ************************************ 00:06:34.116 END TEST app_repeat 00:06:34.116 ************************************ 00:06:34.116 15:52:57 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:34.116 15:52:57 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:34.116 15:52:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:34.116 15:52:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.116 15:52:57 -- common/autotest_common.sh@10 -- # set +x 00:06:34.116 ************************************ 00:06:34.116 START TEST cpu_locks 00:06:34.116 ************************************ 00:06:34.116 15:52:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:34.116 * Looking for test storage... 00:06:34.116 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:34.116 15:52:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:34.116 15:52:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:34.116 15:52:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:34.375 15:52:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:34.375 15:52:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:34.375 15:52:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:34.375 15:52:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:34.375 15:52:57 -- scripts/common.sh@335 -- # IFS=.-: 00:06:34.375 15:52:57 -- scripts/common.sh@335 -- # read -ra ver1 00:06:34.375 15:52:57 -- scripts/common.sh@336 -- # IFS=.-: 00:06:34.375 15:52:57 -- scripts/common.sh@336 -- # read -ra ver2 00:06:34.375 15:52:57 -- scripts/common.sh@337 -- # local 'op=<' 00:06:34.375 15:52:57 -- scripts/common.sh@339 -- # ver1_l=2 00:06:34.375 15:52:57 -- scripts/common.sh@340 -- # ver2_l=1 00:06:34.375 15:52:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:34.375 15:52:57 -- scripts/common.sh@343 -- # case "$op" in 00:06:34.375 15:52:57 -- scripts/common.sh@344 -- # : 1 00:06:34.375 15:52:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:34.375 15:52:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:34.375 15:52:57 -- scripts/common.sh@364 -- # decimal 1 00:06:34.375 15:52:57 -- scripts/common.sh@352 -- # local d=1 00:06:34.375 15:52:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:34.375 15:52:57 -- scripts/common.sh@354 -- # echo 1 00:06:34.375 15:52:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:34.375 15:52:57 -- scripts/common.sh@365 -- # decimal 2 00:06:34.375 15:52:57 -- scripts/common.sh@352 -- # local d=2 00:06:34.375 15:52:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:34.375 15:52:57 -- scripts/common.sh@354 -- # echo 2 00:06:34.375 15:52:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:34.375 15:52:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:34.375 15:52:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:34.375 15:52:57 -- scripts/common.sh@367 -- # return 0 00:06:34.375 15:52:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:34.375 15:52:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:34.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.375 --rc genhtml_branch_coverage=1 00:06:34.375 --rc genhtml_function_coverage=1 00:06:34.375 --rc genhtml_legend=1 00:06:34.375 --rc geninfo_all_blocks=1 00:06:34.375 --rc geninfo_unexecuted_blocks=1 00:06:34.375 00:06:34.375 ' 00:06:34.375 15:52:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:34.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.375 --rc genhtml_branch_coverage=1 00:06:34.375 --rc genhtml_function_coverage=1 00:06:34.375 --rc genhtml_legend=1 00:06:34.375 --rc geninfo_all_blocks=1 00:06:34.375 --rc geninfo_unexecuted_blocks=1 00:06:34.375 00:06:34.375 ' 00:06:34.375 15:52:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:34.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.375 --rc genhtml_branch_coverage=1 00:06:34.375 --rc genhtml_function_coverage=1 00:06:34.375 --rc genhtml_legend=1 00:06:34.375 --rc geninfo_all_blocks=1 00:06:34.375 --rc geninfo_unexecuted_blocks=1 00:06:34.375 00:06:34.375 ' 00:06:34.375 15:52:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:34.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.375 --rc genhtml_branch_coverage=1 00:06:34.375 --rc genhtml_function_coverage=1 00:06:34.375 --rc genhtml_legend=1 00:06:34.375 --rc geninfo_all_blocks=1 00:06:34.375 --rc geninfo_unexecuted_blocks=1 00:06:34.375 00:06:34.375 ' 00:06:34.375 15:52:57 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:34.375 15:52:57 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:34.375 15:52:57 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:34.375 15:52:57 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:34.375 15:52:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:34.375 15:52:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.375 15:52:57 -- common/autotest_common.sh@10 -- # set +x 00:06:34.375 ************************************ 00:06:34.375 START TEST default_locks 00:06:34.375 ************************************ 00:06:34.375 15:52:57 -- common/autotest_common.sh@1114 -- # default_locks 00:06:34.375 15:52:57 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1466025 00:06:34.375 15:52:57 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:34.375 15:52:57 -- event/cpu_locks.sh@47 -- # waitforlisten 1466025 00:06:34.375 15:52:57 -- common/autotest_common.sh@829 -- # '[' -z 1466025 ']' 00:06:34.375 15:52:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:34.375 15:52:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:34.375 15:52:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:34.375 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:34.375 15:52:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:34.375 15:52:57 -- common/autotest_common.sh@10 -- # set +x 00:06:34.375 [2024-11-18 15:52:57.836347] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:34.375 [2024-11-18 15:52:57.836450] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1466025 ] 00:06:34.376 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.376 [2024-11-18 15:52:57.902532] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.634 [2024-11-18 15:52:57.996738] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:34.634 [2024-11-18 15:52:57.996887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.567 15:52:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:35.567 15:52:58 -- common/autotest_common.sh@862 -- # return 0 00:06:35.567 15:52:58 -- event/cpu_locks.sh@49 -- # locks_exist 1466025 00:06:35.567 15:52:58 -- event/cpu_locks.sh@22 -- # lslocks -p 1466025 00:06:35.567 15:52:58 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:35.567 lslocks: write error 00:06:35.567 15:52:59 -- event/cpu_locks.sh@50 -- # killprocess 1466025 00:06:35.567 15:52:59 -- common/autotest_common.sh@936 -- # '[' -z 1466025 ']' 00:06:35.567 15:52:59 -- common/autotest_common.sh@940 -- # kill -0 1466025 00:06:35.567 15:52:59 -- common/autotest_common.sh@941 -- # uname 00:06:35.567 15:52:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:35.567 15:52:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1466025 00:06:35.567 15:52:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:35.567 15:52:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:35.567 15:52:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1466025' 00:06:35.567 killing process with pid 1466025 00:06:35.567 15:52:59 -- common/autotest_common.sh@955 -- # kill 1466025 00:06:35.567 15:52:59 -- common/autotest_common.sh@960 -- # wait 1466025 00:06:36.132 15:52:59 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1466025 00:06:36.132 15:52:59 -- common/autotest_common.sh@650 -- # local es=0 00:06:36.132 15:52:59 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1466025 00:06:36.132 15:52:59 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:36.132 15:52:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:36.132 15:52:59 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:36.132 15:52:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:36.132 15:52:59 -- common/autotest_common.sh@653 -- # waitforlisten 1466025 00:06:36.132 15:52:59 -- common/autotest_common.sh@829 -- # '[' -z 1466025 ']' 00:06:36.132 15:52:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.132 15:52:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.132 15:52:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.132 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.132 15:52:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.132 15:52:59 -- common/autotest_common.sh@10 -- # set +x 00:06:36.132 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1466025) - No such process 00:06:36.132 ERROR: process (pid: 1466025) is no longer running 00:06:36.132 15:52:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:36.132 15:52:59 -- common/autotest_common.sh@862 -- # return 1 00:06:36.132 15:52:59 -- common/autotest_common.sh@653 -- # es=1 00:06:36.132 15:52:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:36.132 15:52:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:36.132 15:52:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:36.132 15:52:59 -- event/cpu_locks.sh@54 -- # no_locks 00:06:36.132 15:52:59 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:36.132 15:52:59 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:36.132 15:52:59 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:36.132 00:06:36.132 real 0m1.761s 00:06:36.132 user 0m1.943s 00:06:36.132 sys 0m0.576s 00:06:36.132 15:52:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.132 15:52:59 -- common/autotest_common.sh@10 -- # set +x 00:06:36.132 ************************************ 00:06:36.132 END TEST default_locks 00:06:36.132 ************************************ 00:06:36.132 15:52:59 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:36.132 15:52:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:36.132 15:52:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.132 15:52:59 -- common/autotest_common.sh@10 -- # set +x 00:06:36.132 ************************************ 00:06:36.132 START TEST default_locks_via_rpc 00:06:36.132 ************************************ 00:06:36.132 15:52:59 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:36.132 15:52:59 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1466319 00:06:36.132 15:52:59 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:36.132 15:52:59 -- event/cpu_locks.sh@63 -- # waitforlisten 1466319 00:06:36.132 15:52:59 -- common/autotest_common.sh@829 -- # '[' -z 1466319 ']' 00:06:36.132 15:52:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.132 15:52:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.132 15:52:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.132 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.132 15:52:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.132 15:52:59 -- common/autotest_common.sh@10 -- # set +x 00:06:36.132 [2024-11-18 15:52:59.624546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:36.132 [2024-11-18 15:52:59.624694] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1466319 ] 00:06:36.132 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.132 [2024-11-18 15:52:59.682422] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.391 [2024-11-18 15:52:59.771645] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.391 [2024-11-18 15:52:59.771853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.030 15:53:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:37.030 15:53:00 -- common/autotest_common.sh@862 -- # return 0 00:06:37.030 15:53:00 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:37.030 15:53:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.030 15:53:00 -- common/autotest_common.sh@10 -- # set +x 00:06:37.030 15:53:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.030 15:53:00 -- event/cpu_locks.sh@67 -- # no_locks 00:06:37.030 15:53:00 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:37.030 15:53:00 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:37.030 15:53:00 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:37.030 15:53:00 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:37.030 15:53:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.030 15:53:00 -- common/autotest_common.sh@10 -- # set +x 00:06:37.030 15:53:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.030 15:53:00 -- event/cpu_locks.sh@71 -- # locks_exist 1466319 00:06:37.303 15:53:00 -- event/cpu_locks.sh@22 -- # lslocks -p 1466319 00:06:37.303 15:53:00 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:37.563 15:53:01 -- event/cpu_locks.sh@73 -- # killprocess 1466319 00:06:37.563 15:53:01 -- common/autotest_common.sh@936 -- # '[' -z 1466319 ']' 00:06:37.563 15:53:01 -- common/autotest_common.sh@940 -- # kill -0 1466319 00:06:37.563 15:53:01 -- common/autotest_common.sh@941 -- # uname 00:06:37.563 15:53:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:37.563 15:53:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1466319 00:06:37.563 15:53:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:37.563 15:53:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:37.563 15:53:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1466319' 00:06:37.563 killing process with pid 1466319 00:06:37.563 15:53:01 -- common/autotest_common.sh@955 -- # kill 1466319 00:06:37.563 15:53:01 -- common/autotest_common.sh@960 -- # wait 1466319 00:06:38.131 00:06:38.131 real 0m1.929s 00:06:38.131 user 0m2.091s 00:06:38.131 sys 0m0.606s 00:06:38.131 15:53:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:38.131 15:53:01 -- common/autotest_common.sh@10 -- # set +x 00:06:38.131 ************************************ 00:06:38.131 END TEST default_locks_via_rpc 00:06:38.131 ************************************ 00:06:38.131 15:53:01 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:38.131 15:53:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:38.131 15:53:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.131 15:53:01 -- common/autotest_common.sh@10 -- # set +x 00:06:38.131 ************************************ 00:06:38.131 START TEST non_locking_app_on_locked_coremask 00:06:38.131 ************************************ 00:06:38.131 15:53:01 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:38.131 15:53:01 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1466622 00:06:38.131 15:53:01 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:38.131 15:53:01 -- event/cpu_locks.sh@81 -- # waitforlisten 1466622 /var/tmp/spdk.sock 00:06:38.131 15:53:01 -- common/autotest_common.sh@829 -- # '[' -z 1466622 ']' 00:06:38.131 15:53:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:38.131 15:53:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:38.131 15:53:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:38.131 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:38.131 15:53:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:38.131 15:53:01 -- common/autotest_common.sh@10 -- # set +x 00:06:38.131 [2024-11-18 15:53:01.580898] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:38.131 [2024-11-18 15:53:01.580994] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1466622 ] 00:06:38.131 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.131 [2024-11-18 15:53:01.642206] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.390 [2024-11-18 15:53:01.727712] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:38.390 [2024-11-18 15:53:01.727913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.960 15:53:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.960 15:53:02 -- common/autotest_common.sh@862 -- # return 0 00:06:38.960 15:53:02 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1466763 00:06:38.960 15:53:02 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:38.960 15:53:02 -- event/cpu_locks.sh@85 -- # waitforlisten 1466763 /var/tmp/spdk2.sock 00:06:38.960 15:53:02 -- common/autotest_common.sh@829 -- # '[' -z 1466763 ']' 00:06:38.960 15:53:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:38.960 15:53:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:38.960 15:53:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:38.960 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:38.960 15:53:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:38.960 15:53:02 -- common/autotest_common.sh@10 -- # set +x 00:06:39.218 [2024-11-18 15:53:02.588324] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:39.219 [2024-11-18 15:53:02.588408] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1466763 ] 00:06:39.219 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.219 [2024-11-18 15:53:02.685165] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:39.219 [2024-11-18 15:53:02.685207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.478 [2024-11-18 15:53:02.862695] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:39.479 [2024-11-18 15:53:02.862889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.045 15:53:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:40.045 15:53:03 -- common/autotest_common.sh@862 -- # return 0 00:06:40.045 15:53:03 -- event/cpu_locks.sh@87 -- # locks_exist 1466622 00:06:40.045 15:53:03 -- event/cpu_locks.sh@22 -- # lslocks -p 1466622 00:06:40.045 15:53:03 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:40.612 lslocks: write error 00:06:40.612 15:53:03 -- event/cpu_locks.sh@89 -- # killprocess 1466622 00:06:40.612 15:53:03 -- common/autotest_common.sh@936 -- # '[' -z 1466622 ']' 00:06:40.612 15:53:03 -- common/autotest_common.sh@940 -- # kill -0 1466622 00:06:40.612 15:53:03 -- common/autotest_common.sh@941 -- # uname 00:06:40.612 15:53:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:40.612 15:53:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1466622 00:06:40.612 15:53:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:40.612 15:53:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:40.612 15:53:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1466622' 00:06:40.612 killing process with pid 1466622 00:06:40.612 15:53:03 -- common/autotest_common.sh@955 -- # kill 1466622 00:06:40.612 15:53:03 -- common/autotest_common.sh@960 -- # wait 1466622 00:06:41.551 15:53:04 -- event/cpu_locks.sh@90 -- # killprocess 1466763 00:06:41.551 15:53:04 -- common/autotest_common.sh@936 -- # '[' -z 1466763 ']' 00:06:41.551 15:53:04 -- common/autotest_common.sh@940 -- # kill -0 1466763 00:06:41.551 15:53:04 -- common/autotest_common.sh@941 -- # uname 00:06:41.551 15:53:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:41.551 15:53:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1466763 00:06:41.551 15:53:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:41.551 15:53:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:41.551 15:53:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1466763' 00:06:41.551 killing process with pid 1466763 00:06:41.551 15:53:04 -- common/autotest_common.sh@955 -- # kill 1466763 00:06:41.551 15:53:04 -- common/autotest_common.sh@960 -- # wait 1466763 00:06:41.811 00:06:41.811 real 0m3.711s 00:06:41.811 user 0m4.075s 00:06:41.811 sys 0m1.059s 00:06:41.811 15:53:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:41.811 15:53:05 -- common/autotest_common.sh@10 -- # set +x 00:06:41.811 ************************************ 00:06:41.811 END TEST non_locking_app_on_locked_coremask 00:06:41.811 ************************************ 00:06:41.811 15:53:05 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:41.811 15:53:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:41.811 15:53:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.811 15:53:05 -- common/autotest_common.sh@10 -- # set +x 00:06:41.811 ************************************ 00:06:41.811 START TEST locking_app_on_unlocked_coremask 00:06:41.811 ************************************ 00:06:41.811 15:53:05 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:41.811 15:53:05 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1467074 00:06:41.811 15:53:05 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:41.811 15:53:05 -- event/cpu_locks.sh@99 -- # waitforlisten 1467074 /var/tmp/spdk.sock 00:06:41.811 15:53:05 -- common/autotest_common.sh@829 -- # '[' -z 1467074 ']' 00:06:41.811 15:53:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:41.811 15:53:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:41.811 15:53:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:41.811 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:41.811 15:53:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:41.811 15:53:05 -- common/autotest_common.sh@10 -- # set +x 00:06:41.811 [2024-11-18 15:53:05.320657] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:41.811 [2024-11-18 15:53:05.320768] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467074 ] 00:06:41.811 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.811 [2024-11-18 15:53:05.379719] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:41.811 [2024-11-18 15:53:05.379760] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.071 [2024-11-18 15:53:05.468816] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:42.071 [2024-11-18 15:53:05.469003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.011 15:53:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.011 15:53:06 -- common/autotest_common.sh@862 -- # return 0 00:06:43.011 15:53:06 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1467216 00:06:43.011 15:53:06 -- event/cpu_locks.sh@103 -- # waitforlisten 1467216 /var/tmp/spdk2.sock 00:06:43.011 15:53:06 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:43.011 15:53:06 -- common/autotest_common.sh@829 -- # '[' -z 1467216 ']' 00:06:43.011 15:53:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:43.011 15:53:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:43.011 15:53:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:43.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:43.011 15:53:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:43.011 15:53:06 -- common/autotest_common.sh@10 -- # set +x 00:06:43.011 [2024-11-18 15:53:06.330704] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:43.011 [2024-11-18 15:53:06.330797] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467216 ] 00:06:43.011 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.011 [2024-11-18 15:53:06.421443] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.011 [2024-11-18 15:53:06.598535] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:43.270 [2024-11-18 15:53:06.602746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.835 15:53:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.835 15:53:07 -- common/autotest_common.sh@862 -- # return 0 00:06:43.836 15:53:07 -- event/cpu_locks.sh@105 -- # locks_exist 1467216 00:06:43.836 15:53:07 -- event/cpu_locks.sh@22 -- # lslocks -p 1467216 00:06:43.836 15:53:07 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:44.402 lslocks: write error 00:06:44.402 15:53:07 -- event/cpu_locks.sh@107 -- # killprocess 1467074 00:06:44.402 15:53:07 -- common/autotest_common.sh@936 -- # '[' -z 1467074 ']' 00:06:44.402 15:53:07 -- common/autotest_common.sh@940 -- # kill -0 1467074 00:06:44.402 15:53:07 -- common/autotest_common.sh@941 -- # uname 00:06:44.402 15:53:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.402 15:53:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1467074 00:06:44.402 15:53:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:44.402 15:53:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:44.402 15:53:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1467074' 00:06:44.402 killing process with pid 1467074 00:06:44.402 15:53:07 -- common/autotest_common.sh@955 -- # kill 1467074 00:06:44.402 15:53:07 -- common/autotest_common.sh@960 -- # wait 1467074 00:06:45.341 15:53:08 -- event/cpu_locks.sh@108 -- # killprocess 1467216 00:06:45.341 15:53:08 -- common/autotest_common.sh@936 -- # '[' -z 1467216 ']' 00:06:45.341 15:53:08 -- common/autotest_common.sh@940 -- # kill -0 1467216 00:06:45.341 15:53:08 -- common/autotest_common.sh@941 -- # uname 00:06:45.341 15:53:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:45.341 15:53:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1467216 00:06:45.341 15:53:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:45.341 15:53:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:45.341 15:53:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1467216' 00:06:45.341 killing process with pid 1467216 00:06:45.341 15:53:08 -- common/autotest_common.sh@955 -- # kill 1467216 00:06:45.341 15:53:08 -- common/autotest_common.sh@960 -- # wait 1467216 00:06:45.599 00:06:45.599 real 0m3.784s 00:06:45.599 user 0m4.134s 00:06:45.599 sys 0m1.105s 00:06:45.599 15:53:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.599 15:53:09 -- common/autotest_common.sh@10 -- # set +x 00:06:45.599 ************************************ 00:06:45.599 END TEST locking_app_on_unlocked_coremask 00:06:45.599 ************************************ 00:06:45.599 15:53:09 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:45.599 15:53:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:45.599 15:53:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.599 15:53:09 -- common/autotest_common.sh@10 -- # set +x 00:06:45.599 ************************************ 00:06:45.599 START TEST locking_app_on_locked_coremask 00:06:45.599 ************************************ 00:06:45.599 15:53:09 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:45.599 15:53:09 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1467534 00:06:45.599 15:53:09 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:45.599 15:53:09 -- event/cpu_locks.sh@116 -- # waitforlisten 1467534 /var/tmp/spdk.sock 00:06:45.599 15:53:09 -- common/autotest_common.sh@829 -- # '[' -z 1467534 ']' 00:06:45.599 15:53:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.599 15:53:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:45.599 15:53:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.599 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.599 15:53:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:45.599 15:53:09 -- common/autotest_common.sh@10 -- # set +x 00:06:45.599 [2024-11-18 15:53:09.133465] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:45.599 [2024-11-18 15:53:09.133536] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467534 ] 00:06:45.599 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.859 [2024-11-18 15:53:09.195425] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.859 [2024-11-18 15:53:09.281250] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:45.859 [2024-11-18 15:53:09.281420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.795 15:53:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:46.795 15:53:10 -- common/autotest_common.sh@862 -- # return 0 00:06:46.795 15:53:10 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1467668 00:06:46.795 15:53:10 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:46.795 15:53:10 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1467668 /var/tmp/spdk2.sock 00:06:46.795 15:53:10 -- common/autotest_common.sh@650 -- # local es=0 00:06:46.795 15:53:10 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1467668 /var/tmp/spdk2.sock 00:06:46.795 15:53:10 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:46.795 15:53:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:46.795 15:53:10 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:46.795 15:53:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:46.795 15:53:10 -- common/autotest_common.sh@653 -- # waitforlisten 1467668 /var/tmp/spdk2.sock 00:06:46.795 15:53:10 -- common/autotest_common.sh@829 -- # '[' -z 1467668 ']' 00:06:46.795 15:53:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:46.795 15:53:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:46.795 15:53:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:46.795 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:46.795 15:53:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:46.795 15:53:10 -- common/autotest_common.sh@10 -- # set +x 00:06:46.795 [2024-11-18 15:53:10.155023] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:46.795 [2024-11-18 15:53:10.155105] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467668 ] 00:06:46.795 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.795 [2024-11-18 15:53:10.251163] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1467534 has claimed it. 00:06:46.795 [2024-11-18 15:53:10.251235] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:47.364 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1467668) - No such process 00:06:47.364 ERROR: process (pid: 1467668) is no longer running 00:06:47.364 15:53:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:47.364 15:53:10 -- common/autotest_common.sh@862 -- # return 1 00:06:47.364 15:53:10 -- common/autotest_common.sh@653 -- # es=1 00:06:47.364 15:53:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:47.364 15:53:10 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:47.364 15:53:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:47.364 15:53:10 -- event/cpu_locks.sh@122 -- # locks_exist 1467534 00:06:47.364 15:53:10 -- event/cpu_locks.sh@22 -- # lslocks -p 1467534 00:06:47.364 15:53:10 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:47.931 lslocks: write error 00:06:47.931 15:53:11 -- event/cpu_locks.sh@124 -- # killprocess 1467534 00:06:47.931 15:53:11 -- common/autotest_common.sh@936 -- # '[' -z 1467534 ']' 00:06:47.931 15:53:11 -- common/autotest_common.sh@940 -- # kill -0 1467534 00:06:47.931 15:53:11 -- common/autotest_common.sh@941 -- # uname 00:06:47.931 15:53:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:47.931 15:53:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1467534 00:06:47.931 15:53:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:47.931 15:53:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:47.931 15:53:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1467534' 00:06:47.931 killing process with pid 1467534 00:06:47.931 15:53:11 -- common/autotest_common.sh@955 -- # kill 1467534 00:06:47.931 15:53:11 -- common/autotest_common.sh@960 -- # wait 1467534 00:06:48.190 00:06:48.190 real 0m2.592s 00:06:48.190 user 0m2.976s 00:06:48.190 sys 0m0.704s 00:06:48.190 15:53:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.190 15:53:11 -- common/autotest_common.sh@10 -- # set +x 00:06:48.190 ************************************ 00:06:48.190 END TEST locking_app_on_locked_coremask 00:06:48.190 ************************************ 00:06:48.190 15:53:11 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:48.190 15:53:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:48.190 15:53:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.190 15:53:11 -- common/autotest_common.sh@10 -- # set +x 00:06:48.190 ************************************ 00:06:48.190 START TEST locking_overlapped_coremask 00:06:48.190 ************************************ 00:06:48.190 15:53:11 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:48.190 15:53:11 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1467963 00:06:48.190 15:53:11 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:48.190 15:53:11 -- event/cpu_locks.sh@133 -- # waitforlisten 1467963 /var/tmp/spdk.sock 00:06:48.190 15:53:11 -- common/autotest_common.sh@829 -- # '[' -z 1467963 ']' 00:06:48.190 15:53:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:48.190 15:53:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:48.190 15:53:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:48.190 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:48.190 15:53:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:48.190 15:53:11 -- common/autotest_common.sh@10 -- # set +x 00:06:48.190 [2024-11-18 15:53:11.754375] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:48.190 [2024-11-18 15:53:11.754466] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467963 ] 00:06:48.450 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.450 [2024-11-18 15:53:11.818627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:48.450 [2024-11-18 15:53:11.906470] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:48.450 [2024-11-18 15:53:11.906699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:48.450 [2024-11-18 15:53:11.906728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:48.450 [2024-11-18 15:53:11.906731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.388 15:53:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:49.388 15:53:12 -- common/autotest_common.sh@862 -- # return 0 00:06:49.388 15:53:12 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1468103 00:06:49.388 15:53:12 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:49.388 15:53:12 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1468103 /var/tmp/spdk2.sock 00:06:49.388 15:53:12 -- common/autotest_common.sh@650 -- # local es=0 00:06:49.388 15:53:12 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1468103 /var/tmp/spdk2.sock 00:06:49.388 15:53:12 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:49.388 15:53:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.388 15:53:12 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:49.388 15:53:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.388 15:53:12 -- common/autotest_common.sh@653 -- # waitforlisten 1468103 /var/tmp/spdk2.sock 00:06:49.388 15:53:12 -- common/autotest_common.sh@829 -- # '[' -z 1468103 ']' 00:06:49.388 15:53:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:49.388 15:53:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:49.388 15:53:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:49.388 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:49.388 15:53:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:49.388 15:53:12 -- common/autotest_common.sh@10 -- # set +x 00:06:49.388 [2024-11-18 15:53:12.760646] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:49.388 [2024-11-18 15:53:12.760730] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468103 ] 00:06:49.388 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.388 [2024-11-18 15:53:12.849167] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1467963 has claimed it. 00:06:49.388 [2024-11-18 15:53:12.849234] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:49.958 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1468103) - No such process 00:06:49.958 ERROR: process (pid: 1468103) is no longer running 00:06:49.958 15:53:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:49.958 15:53:13 -- common/autotest_common.sh@862 -- # return 1 00:06:49.958 15:53:13 -- common/autotest_common.sh@653 -- # es=1 00:06:49.958 15:53:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:49.958 15:53:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:49.958 15:53:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:49.958 15:53:13 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:49.958 15:53:13 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:49.958 15:53:13 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:49.958 15:53:13 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:49.958 15:53:13 -- event/cpu_locks.sh@141 -- # killprocess 1467963 00:06:49.958 15:53:13 -- common/autotest_common.sh@936 -- # '[' -z 1467963 ']' 00:06:49.958 15:53:13 -- common/autotest_common.sh@940 -- # kill -0 1467963 00:06:49.958 15:53:13 -- common/autotest_common.sh@941 -- # uname 00:06:49.958 15:53:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:49.958 15:53:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1467963 00:06:49.958 15:53:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:49.958 15:53:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:49.958 15:53:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1467963' 00:06:49.958 killing process with pid 1467963 00:06:49.958 15:53:13 -- common/autotest_common.sh@955 -- # kill 1467963 00:06:49.958 15:53:13 -- common/autotest_common.sh@960 -- # wait 1467963 00:06:50.527 00:06:50.527 real 0m2.185s 00:06:50.527 user 0m6.314s 00:06:50.527 sys 0m0.491s 00:06:50.527 15:53:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.527 15:53:13 -- common/autotest_common.sh@10 -- # set +x 00:06:50.527 ************************************ 00:06:50.527 END TEST locking_overlapped_coremask 00:06:50.527 ************************************ 00:06:50.527 15:53:13 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:50.527 15:53:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:50.527 15:53:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.527 15:53:13 -- common/autotest_common.sh@10 -- # set +x 00:06:50.527 ************************************ 00:06:50.527 START TEST locking_overlapped_coremask_via_rpc 00:06:50.527 ************************************ 00:06:50.527 15:53:13 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:50.527 15:53:13 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1468274 00:06:50.527 15:53:13 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:50.527 15:53:13 -- event/cpu_locks.sh@149 -- # waitforlisten 1468274 /var/tmp/spdk.sock 00:06:50.527 15:53:13 -- common/autotest_common.sh@829 -- # '[' -z 1468274 ']' 00:06:50.527 15:53:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:50.527 15:53:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:50.527 15:53:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:50.527 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:50.527 15:53:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:50.527 15:53:13 -- common/autotest_common.sh@10 -- # set +x 00:06:50.527 [2024-11-18 15:53:13.965512] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.527 [2024-11-18 15:53:13.965630] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468274 ] 00:06:50.527 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.527 [2024-11-18 15:53:14.023963] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:50.527 [2024-11-18 15:53:14.023999] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:50.527 [2024-11-18 15:53:14.114028] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:50.527 [2024-11-18 15:53:14.114233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:50.527 [2024-11-18 15:53:14.114266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:50.527 [2024-11-18 15:53:14.114268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.464 15:53:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:51.464 15:53:14 -- common/autotest_common.sh@862 -- # return 0 00:06:51.464 15:53:14 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1468415 00:06:51.464 15:53:14 -- event/cpu_locks.sh@153 -- # waitforlisten 1468415 /var/tmp/spdk2.sock 00:06:51.464 15:53:14 -- common/autotest_common.sh@829 -- # '[' -z 1468415 ']' 00:06:51.464 15:53:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:51.464 15:53:14 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:51.464 15:53:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:51.464 15:53:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:51.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:51.464 15:53:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:51.464 15:53:14 -- common/autotest_common.sh@10 -- # set +x 00:06:51.464 [2024-11-18 15:53:14.992127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:51.464 [2024-11-18 15:53:14.992209] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468415 ] 00:06:51.464 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.723 [2024-11-18 15:53:15.081399] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:51.723 [2024-11-18 15:53:15.081432] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:51.723 [2024-11-18 15:53:15.250110] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:51.723 [2024-11-18 15:53:15.250350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:51.723 [2024-11-18 15:53:15.253700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:51.723 [2024-11-18 15:53:15.253703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:52.659 15:53:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:52.660 15:53:15 -- common/autotest_common.sh@862 -- # return 0 00:06:52.660 15:53:15 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:52.660 15:53:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.660 15:53:15 -- common/autotest_common.sh@10 -- # set +x 00:06:52.660 15:53:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.660 15:53:15 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:52.660 15:53:15 -- common/autotest_common.sh@650 -- # local es=0 00:06:52.660 15:53:15 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:52.660 15:53:15 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:52.660 15:53:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:52.660 15:53:15 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:52.660 15:53:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:52.660 15:53:15 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:52.660 15:53:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.660 15:53:15 -- common/autotest_common.sh@10 -- # set +x 00:06:52.660 [2024-11-18 15:53:15.966707] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1468274 has claimed it. 00:06:52.660 request: 00:06:52.660 { 00:06:52.660 "method": "framework_enable_cpumask_locks", 00:06:52.660 "req_id": 1 00:06:52.660 } 00:06:52.660 Got JSON-RPC error response 00:06:52.660 response: 00:06:52.660 { 00:06:52.660 "code": -32603, 00:06:52.660 "message": "Failed to claim CPU core: 2" 00:06:52.660 } 00:06:52.660 15:53:15 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:52.660 15:53:15 -- common/autotest_common.sh@653 -- # es=1 00:06:52.660 15:53:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:52.660 15:53:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:52.660 15:53:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:52.660 15:53:15 -- event/cpu_locks.sh@158 -- # waitforlisten 1468274 /var/tmp/spdk.sock 00:06:52.660 15:53:15 -- common/autotest_common.sh@829 -- # '[' -z 1468274 ']' 00:06:52.660 15:53:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:52.660 15:53:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:52.660 15:53:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:52.660 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:52.660 15:53:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:52.660 15:53:15 -- common/autotest_common.sh@10 -- # set +x 00:06:52.660 15:53:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:52.660 15:53:16 -- common/autotest_common.sh@862 -- # return 0 00:06:52.660 15:53:16 -- event/cpu_locks.sh@159 -- # waitforlisten 1468415 /var/tmp/spdk2.sock 00:06:52.660 15:53:16 -- common/autotest_common.sh@829 -- # '[' -z 1468415 ']' 00:06:52.660 15:53:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:52.660 15:53:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:52.660 15:53:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:52.660 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:52.660 15:53:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:52.660 15:53:16 -- common/autotest_common.sh@10 -- # set +x 00:06:52.919 15:53:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:52.919 15:53:16 -- common/autotest_common.sh@862 -- # return 0 00:06:52.919 15:53:16 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:52.919 15:53:16 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:52.919 15:53:16 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:52.919 15:53:16 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:52.919 00:06:52.919 real 0m2.577s 00:06:52.919 user 0m1.297s 00:06:52.919 sys 0m0.206s 00:06:52.919 15:53:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:52.919 15:53:16 -- common/autotest_common.sh@10 -- # set +x 00:06:52.919 ************************************ 00:06:52.919 END TEST locking_overlapped_coremask_via_rpc 00:06:52.919 ************************************ 00:06:53.178 15:53:16 -- event/cpu_locks.sh@174 -- # cleanup 00:06:53.178 15:53:16 -- event/cpu_locks.sh@15 -- # [[ -z 1468274 ]] 00:06:53.178 15:53:16 -- event/cpu_locks.sh@15 -- # killprocess 1468274 00:06:53.178 15:53:16 -- common/autotest_common.sh@936 -- # '[' -z 1468274 ']' 00:06:53.178 15:53:16 -- common/autotest_common.sh@940 -- # kill -0 1468274 00:06:53.178 15:53:16 -- common/autotest_common.sh@941 -- # uname 00:06:53.178 15:53:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:53.178 15:53:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1468274 00:06:53.178 15:53:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:53.178 15:53:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:53.178 15:53:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1468274' 00:06:53.178 killing process with pid 1468274 00:06:53.178 15:53:16 -- common/autotest_common.sh@955 -- # kill 1468274 00:06:53.178 15:53:16 -- common/autotest_common.sh@960 -- # wait 1468274 00:06:53.436 15:53:16 -- event/cpu_locks.sh@16 -- # [[ -z 1468415 ]] 00:06:53.436 15:53:16 -- event/cpu_locks.sh@16 -- # killprocess 1468415 00:06:53.436 15:53:16 -- common/autotest_common.sh@936 -- # '[' -z 1468415 ']' 00:06:53.436 15:53:16 -- common/autotest_common.sh@940 -- # kill -0 1468415 00:06:53.436 15:53:16 -- common/autotest_common.sh@941 -- # uname 00:06:53.436 15:53:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:53.436 15:53:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1468415 00:06:53.436 15:53:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:53.436 15:53:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:53.436 15:53:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1468415' 00:06:53.436 killing process with pid 1468415 00:06:53.436 15:53:17 -- common/autotest_common.sh@955 -- # kill 1468415 00:06:53.436 15:53:17 -- common/autotest_common.sh@960 -- # wait 1468415 00:06:54.003 15:53:17 -- event/cpu_locks.sh@18 -- # rm -f 00:06:54.003 15:53:17 -- event/cpu_locks.sh@1 -- # cleanup 00:06:54.003 15:53:17 -- event/cpu_locks.sh@15 -- # [[ -z 1468274 ]] 00:06:54.003 15:53:17 -- event/cpu_locks.sh@15 -- # killprocess 1468274 00:06:54.003 15:53:17 -- common/autotest_common.sh@936 -- # '[' -z 1468274 ']' 00:06:54.003 15:53:17 -- common/autotest_common.sh@940 -- # kill -0 1468274 00:06:54.003 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1468274) - No such process 00:06:54.003 15:53:17 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1468274 is not found' 00:06:54.003 Process with pid 1468274 is not found 00:06:54.003 15:53:17 -- event/cpu_locks.sh@16 -- # [[ -z 1468415 ]] 00:06:54.003 15:53:17 -- event/cpu_locks.sh@16 -- # killprocess 1468415 00:06:54.003 15:53:17 -- common/autotest_common.sh@936 -- # '[' -z 1468415 ']' 00:06:54.003 15:53:17 -- common/autotest_common.sh@940 -- # kill -0 1468415 00:06:54.003 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1468415) - No such process 00:06:54.003 15:53:17 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1468415 is not found' 00:06:54.003 Process with pid 1468415 is not found 00:06:54.003 15:53:17 -- event/cpu_locks.sh@18 -- # rm -f 00:06:54.003 00:06:54.003 real 0m19.771s 00:06:54.003 user 0m35.632s 00:06:54.003 sys 0m5.597s 00:06:54.003 15:53:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:54.003 15:53:17 -- common/autotest_common.sh@10 -- # set +x 00:06:54.003 ************************************ 00:06:54.003 END TEST cpu_locks 00:06:54.003 ************************************ 00:06:54.003 00:06:54.003 real 0m46.985s 00:06:54.003 user 1m30.775s 00:06:54.003 sys 0m9.481s 00:06:54.003 15:53:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:54.003 15:53:17 -- common/autotest_common.sh@10 -- # set +x 00:06:54.003 ************************************ 00:06:54.003 END TEST event 00:06:54.003 ************************************ 00:06:54.003 15:53:17 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:54.003 15:53:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:54.003 15:53:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:54.003 15:53:17 -- common/autotest_common.sh@10 -- # set +x 00:06:54.003 ************************************ 00:06:54.003 START TEST thread 00:06:54.003 ************************************ 00:06:54.003 15:53:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:54.003 * Looking for test storage... 00:06:54.003 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:54.003 15:53:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:54.003 15:53:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:54.003 15:53:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:54.003 15:53:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:54.003 15:53:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:54.003 15:53:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:54.003 15:53:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:54.003 15:53:17 -- scripts/common.sh@335 -- # IFS=.-: 00:06:54.003 15:53:17 -- scripts/common.sh@335 -- # read -ra ver1 00:06:54.003 15:53:17 -- scripts/common.sh@336 -- # IFS=.-: 00:06:54.003 15:53:17 -- scripts/common.sh@336 -- # read -ra ver2 00:06:54.003 15:53:17 -- scripts/common.sh@337 -- # local 'op=<' 00:06:54.003 15:53:17 -- scripts/common.sh@339 -- # ver1_l=2 00:06:54.003 15:53:17 -- scripts/common.sh@340 -- # ver2_l=1 00:06:54.003 15:53:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:54.003 15:53:17 -- scripts/common.sh@343 -- # case "$op" in 00:06:54.003 15:53:17 -- scripts/common.sh@344 -- # : 1 00:06:54.003 15:53:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:54.003 15:53:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:54.003 15:53:17 -- scripts/common.sh@364 -- # decimal 1 00:06:54.003 15:53:17 -- scripts/common.sh@352 -- # local d=1 00:06:54.003 15:53:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:54.003 15:53:17 -- scripts/common.sh@354 -- # echo 1 00:06:54.003 15:53:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:54.003 15:53:17 -- scripts/common.sh@365 -- # decimal 2 00:06:54.003 15:53:17 -- scripts/common.sh@352 -- # local d=2 00:06:54.003 15:53:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:54.003 15:53:17 -- scripts/common.sh@354 -- # echo 2 00:06:54.003 15:53:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:54.003 15:53:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:54.004 15:53:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:54.004 15:53:17 -- scripts/common.sh@367 -- # return 0 00:06:54.004 15:53:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:54.004 15:53:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:54.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.004 --rc genhtml_branch_coverage=1 00:06:54.004 --rc genhtml_function_coverage=1 00:06:54.004 --rc genhtml_legend=1 00:06:54.004 --rc geninfo_all_blocks=1 00:06:54.004 --rc geninfo_unexecuted_blocks=1 00:06:54.004 00:06:54.004 ' 00:06:54.004 15:53:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:54.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.004 --rc genhtml_branch_coverage=1 00:06:54.004 --rc genhtml_function_coverage=1 00:06:54.004 --rc genhtml_legend=1 00:06:54.004 --rc geninfo_all_blocks=1 00:06:54.004 --rc geninfo_unexecuted_blocks=1 00:06:54.004 00:06:54.004 ' 00:06:54.004 15:53:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:54.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.004 --rc genhtml_branch_coverage=1 00:06:54.004 --rc genhtml_function_coverage=1 00:06:54.004 --rc genhtml_legend=1 00:06:54.004 --rc geninfo_all_blocks=1 00:06:54.004 --rc geninfo_unexecuted_blocks=1 00:06:54.004 00:06:54.004 ' 00:06:54.004 15:53:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:54.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.004 --rc genhtml_branch_coverage=1 00:06:54.004 --rc genhtml_function_coverage=1 00:06:54.004 --rc genhtml_legend=1 00:06:54.004 --rc geninfo_all_blocks=1 00:06:54.004 --rc geninfo_unexecuted_blocks=1 00:06:54.004 00:06:54.004 ' 00:06:54.004 15:53:17 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:54.004 15:53:17 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:54.004 15:53:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:54.004 15:53:17 -- common/autotest_common.sh@10 -- # set +x 00:06:54.004 ************************************ 00:06:54.004 START TEST thread_poller_perf 00:06:54.004 ************************************ 00:06:54.004 15:53:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:54.264 [2024-11-18 15:53:17.604886] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:54.264 [2024-11-18 15:53:17.604979] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468793 ] 00:06:54.264 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.264 [2024-11-18 15:53:17.664515] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.264 [2024-11-18 15:53:17.752695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.264 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:55.641 [2024-11-18T14:53:19.232Z] ====================================== 00:06:55.641 [2024-11-18T14:53:19.232Z] busy:2714611507 (cyc) 00:06:55.641 [2024-11-18T14:53:19.232Z] total_run_count: 281000 00:06:55.641 [2024-11-18T14:53:19.232Z] tsc_hz: 2700000000 (cyc) 00:06:55.641 [2024-11-18T14:53:19.232Z] ====================================== 00:06:55.641 [2024-11-18T14:53:19.232Z] poller_cost: 9660 (cyc), 3577 (nsec) 00:06:55.641 00:06:55.641 real 0m1.254s 00:06:55.641 user 0m1.168s 00:06:55.641 sys 0m0.080s 00:06:55.641 15:53:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:55.641 15:53:18 -- common/autotest_common.sh@10 -- # set +x 00:06:55.641 ************************************ 00:06:55.641 END TEST thread_poller_perf 00:06:55.641 ************************************ 00:06:55.641 15:53:18 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:55.641 15:53:18 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:55.641 15:53:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.641 15:53:18 -- common/autotest_common.sh@10 -- # set +x 00:06:55.641 ************************************ 00:06:55.641 START TEST thread_poller_perf 00:06:55.641 ************************************ 00:06:55.641 15:53:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:55.641 [2024-11-18 15:53:18.887245] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:55.641 [2024-11-18 15:53:18.887326] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468947 ] 00:06:55.641 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.641 [2024-11-18 15:53:18.952472] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.641 [2024-11-18 15:53:19.042377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.641 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:56.578 [2024-11-18T14:53:20.169Z] ====================================== 00:06:56.578 [2024-11-18T14:53:20.169Z] busy:2703800482 (cyc) 00:06:56.578 [2024-11-18T14:53:20.169Z] total_run_count: 3837000 00:06:56.578 [2024-11-18T14:53:20.169Z] tsc_hz: 2700000000 (cyc) 00:06:56.578 [2024-11-18T14:53:20.169Z] ====================================== 00:06:56.578 [2024-11-18T14:53:20.169Z] poller_cost: 704 (cyc), 260 (nsec) 00:06:56.578 00:06:56.578 real 0m1.253s 00:06:56.578 user 0m1.165s 00:06:56.578 sys 0m0.081s 00:06:56.578 15:53:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.578 15:53:20 -- common/autotest_common.sh@10 -- # set +x 00:06:56.578 ************************************ 00:06:56.578 END TEST thread_poller_perf 00:06:56.578 ************************************ 00:06:56.578 15:53:20 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:56.578 00:06:56.578 real 0m2.706s 00:06:56.578 user 0m2.447s 00:06:56.578 sys 0m0.263s 00:06:56.578 15:53:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.578 15:53:20 -- common/autotest_common.sh@10 -- # set +x 00:06:56.578 ************************************ 00:06:56.578 END TEST thread 00:06:56.578 ************************************ 00:06:56.837 15:53:20 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:56.837 15:53:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:56.837 15:53:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.837 15:53:20 -- common/autotest_common.sh@10 -- # set +x 00:06:56.837 ************************************ 00:06:56.837 START TEST accel 00:06:56.837 ************************************ 00:06:56.837 15:53:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:56.837 * Looking for test storage... 00:06:56.837 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:56.837 15:53:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:56.837 15:53:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:56.837 15:53:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:56.837 15:53:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:56.837 15:53:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:56.837 15:53:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:56.837 15:53:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:56.837 15:53:20 -- scripts/common.sh@335 -- # IFS=.-: 00:06:56.837 15:53:20 -- scripts/common.sh@335 -- # read -ra ver1 00:06:56.837 15:53:20 -- scripts/common.sh@336 -- # IFS=.-: 00:06:56.837 15:53:20 -- scripts/common.sh@336 -- # read -ra ver2 00:06:56.837 15:53:20 -- scripts/common.sh@337 -- # local 'op=<' 00:06:56.837 15:53:20 -- scripts/common.sh@339 -- # ver1_l=2 00:06:56.837 15:53:20 -- scripts/common.sh@340 -- # ver2_l=1 00:06:56.837 15:53:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:56.837 15:53:20 -- scripts/common.sh@343 -- # case "$op" in 00:06:56.837 15:53:20 -- scripts/common.sh@344 -- # : 1 00:06:56.837 15:53:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:56.837 15:53:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:56.837 15:53:20 -- scripts/common.sh@364 -- # decimal 1 00:06:56.837 15:53:20 -- scripts/common.sh@352 -- # local d=1 00:06:56.837 15:53:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:56.837 15:53:20 -- scripts/common.sh@354 -- # echo 1 00:06:56.837 15:53:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:56.837 15:53:20 -- scripts/common.sh@365 -- # decimal 2 00:06:56.837 15:53:20 -- scripts/common.sh@352 -- # local d=2 00:06:56.837 15:53:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:56.837 15:53:20 -- scripts/common.sh@354 -- # echo 2 00:06:56.837 15:53:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:56.837 15:53:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:56.837 15:53:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:56.837 15:53:20 -- scripts/common.sh@367 -- # return 0 00:06:56.837 15:53:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:56.837 15:53:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:56.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.837 --rc genhtml_branch_coverage=1 00:06:56.837 --rc genhtml_function_coverage=1 00:06:56.837 --rc genhtml_legend=1 00:06:56.837 --rc geninfo_all_blocks=1 00:06:56.837 --rc geninfo_unexecuted_blocks=1 00:06:56.837 00:06:56.837 ' 00:06:56.837 15:53:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:56.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.837 --rc genhtml_branch_coverage=1 00:06:56.837 --rc genhtml_function_coverage=1 00:06:56.837 --rc genhtml_legend=1 00:06:56.837 --rc geninfo_all_blocks=1 00:06:56.837 --rc geninfo_unexecuted_blocks=1 00:06:56.837 00:06:56.837 ' 00:06:56.837 15:53:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:56.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.837 --rc genhtml_branch_coverage=1 00:06:56.837 --rc genhtml_function_coverage=1 00:06:56.837 --rc genhtml_legend=1 00:06:56.837 --rc geninfo_all_blocks=1 00:06:56.837 --rc geninfo_unexecuted_blocks=1 00:06:56.837 00:06:56.837 ' 00:06:56.837 15:53:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:56.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.837 --rc genhtml_branch_coverage=1 00:06:56.837 --rc genhtml_function_coverage=1 00:06:56.837 --rc genhtml_legend=1 00:06:56.837 --rc geninfo_all_blocks=1 00:06:56.837 --rc geninfo_unexecuted_blocks=1 00:06:56.837 00:06:56.837 ' 00:06:56.837 15:53:20 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:56.837 15:53:20 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:56.837 15:53:20 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:56.837 15:53:20 -- accel/accel.sh@59 -- # spdk_tgt_pid=1469164 00:06:56.837 15:53:20 -- accel/accel.sh@60 -- # waitforlisten 1469164 00:06:56.837 15:53:20 -- common/autotest_common.sh@829 -- # '[' -z 1469164 ']' 00:06:56.837 15:53:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:56.837 15:53:20 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:56.837 15:53:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:56.837 15:53:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:56.837 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:56.837 15:53:20 -- accel/accel.sh@58 -- # build_accel_config 00:06:56.837 15:53:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:56.837 15:53:20 -- common/autotest_common.sh@10 -- # set +x 00:06:56.837 15:53:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.837 15:53:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.838 15:53:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.838 15:53:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.838 15:53:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.838 15:53:20 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.838 15:53:20 -- accel/accel.sh@42 -- # jq -r . 00:06:56.838 [2024-11-18 15:53:20.363298] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:56.838 [2024-11-18 15:53:20.363394] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469164 ] 00:06:56.838 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.096 [2024-11-18 15:53:20.428012] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.096 [2024-11-18 15:53:20.516619] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:57.096 [2024-11-18 15:53:20.516801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.035 15:53:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:58.035 15:53:21 -- common/autotest_common.sh@862 -- # return 0 00:06:58.035 15:53:21 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:58.035 15:53:21 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:58.035 15:53:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:58.035 15:53:21 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:58.035 15:53:21 -- common/autotest_common.sh@10 -- # set +x 00:06:58.035 15:53:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # IFS== 00:06:58.035 15:53:21 -- accel/accel.sh@64 -- # read -r opc module 00:06:58.035 15:53:21 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:58.035 15:53:21 -- accel/accel.sh@67 -- # killprocess 1469164 00:06:58.035 15:53:21 -- common/autotest_common.sh@936 -- # '[' -z 1469164 ']' 00:06:58.035 15:53:21 -- common/autotest_common.sh@940 -- # kill -0 1469164 00:06:58.035 15:53:21 -- common/autotest_common.sh@941 -- # uname 00:06:58.035 15:53:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:58.035 15:53:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1469164 00:06:58.035 15:53:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:58.035 15:53:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:58.035 15:53:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1469164' 00:06:58.035 killing process with pid 1469164 00:06:58.035 15:53:21 -- common/autotest_common.sh@955 -- # kill 1469164 00:06:58.035 15:53:21 -- common/autotest_common.sh@960 -- # wait 1469164 00:06:58.295 15:53:21 -- accel/accel.sh@68 -- # trap - ERR 00:06:58.295 15:53:21 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:58.295 15:53:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:58.295 15:53:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.295 15:53:21 -- common/autotest_common.sh@10 -- # set +x 00:06:58.295 15:53:21 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:58.295 15:53:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:58.295 15:53:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.295 15:53:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:58.295 15:53:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.295 15:53:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.295 15:53:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:58.295 15:53:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:58.295 15:53:21 -- accel/accel.sh@41 -- # local IFS=, 00:06:58.295 15:53:21 -- accel/accel.sh@42 -- # jq -r . 00:06:58.295 15:53:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:58.295 15:53:21 -- common/autotest_common.sh@10 -- # set +x 00:06:58.295 15:53:21 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:58.295 15:53:21 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:58.295 15:53:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.295 15:53:21 -- common/autotest_common.sh@10 -- # set +x 00:06:58.295 ************************************ 00:06:58.295 START TEST accel_missing_filename 00:06:58.295 ************************************ 00:06:58.295 15:53:21 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:58.295 15:53:21 -- common/autotest_common.sh@650 -- # local es=0 00:06:58.295 15:53:21 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:58.295 15:53:21 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:58.295 15:53:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:58.295 15:53:21 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:58.295 15:53:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:58.295 15:53:21 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:58.295 15:53:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:58.295 15:53:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.295 15:53:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:58.296 15:53:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.296 15:53:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.296 15:53:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:58.296 15:53:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:58.296 15:53:21 -- accel/accel.sh@41 -- # local IFS=, 00:06:58.296 15:53:21 -- accel/accel.sh@42 -- # jq -r . 00:06:58.296 [2024-11-18 15:53:21.853835] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:58.296 [2024-11-18 15:53:21.853933] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469452 ] 00:06:58.296 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.554 [2024-11-18 15:53:21.918168] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.554 [2024-11-18 15:53:22.008938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.554 [2024-11-18 15:53:22.069984] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:58.815 [2024-11-18 15:53:22.156937] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:58.815 A filename is required. 00:06:58.815 15:53:22 -- common/autotest_common.sh@653 -- # es=234 00:06:58.815 15:53:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:58.815 15:53:22 -- common/autotest_common.sh@662 -- # es=106 00:06:58.815 15:53:22 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:58.815 15:53:22 -- common/autotest_common.sh@670 -- # es=1 00:06:58.815 15:53:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:58.815 00:06:58.815 real 0m0.404s 00:06:58.815 user 0m0.290s 00:06:58.815 sys 0m0.148s 00:06:58.815 15:53:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:58.815 15:53:22 -- common/autotest_common.sh@10 -- # set +x 00:06:58.815 ************************************ 00:06:58.815 END TEST accel_missing_filename 00:06:58.815 ************************************ 00:06:58.815 15:53:22 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:58.815 15:53:22 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:58.815 15:53:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.815 15:53:22 -- common/autotest_common.sh@10 -- # set +x 00:06:58.815 ************************************ 00:06:58.815 START TEST accel_compress_verify 00:06:58.815 ************************************ 00:06:58.815 15:53:22 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:58.815 15:53:22 -- common/autotest_common.sh@650 -- # local es=0 00:06:58.815 15:53:22 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:58.815 15:53:22 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:58.815 15:53:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:58.815 15:53:22 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:58.815 15:53:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:58.815 15:53:22 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:58.815 15:53:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:58.815 15:53:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.815 15:53:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:58.815 15:53:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.815 15:53:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.815 15:53:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:58.815 15:53:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:58.815 15:53:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:58.815 15:53:22 -- accel/accel.sh@42 -- # jq -r . 00:06:58.815 [2024-11-18 15:53:22.282113] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:58.815 [2024-11-18 15:53:22.282207] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469479 ] 00:06:58.815 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.815 [2024-11-18 15:53:22.342758] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.075 [2024-11-18 15:53:22.433534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.075 [2024-11-18 15:53:22.495224] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:59.075 [2024-11-18 15:53:22.577794] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:59.075 00:06:59.075 Compression does not support the verify option, aborting. 00:06:59.075 15:53:22 -- common/autotest_common.sh@653 -- # es=161 00:06:59.075 15:53:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:59.075 15:53:22 -- common/autotest_common.sh@662 -- # es=33 00:06:59.075 15:53:22 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:59.075 15:53:22 -- common/autotest_common.sh@670 -- # es=1 00:06:59.075 15:53:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:59.075 00:06:59.075 real 0m0.390s 00:06:59.075 user 0m0.266s 00:06:59.075 sys 0m0.155s 00:06:59.075 15:53:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.076 15:53:22 -- common/autotest_common.sh@10 -- # set +x 00:06:59.076 ************************************ 00:06:59.076 END TEST accel_compress_verify 00:06:59.076 ************************************ 00:06:59.336 15:53:22 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:59.336 15:53:22 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:59.336 15:53:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.336 15:53:22 -- common/autotest_common.sh@10 -- # set +x 00:06:59.336 ************************************ 00:06:59.336 START TEST accel_wrong_workload 00:06:59.336 ************************************ 00:06:59.336 15:53:22 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:59.336 15:53:22 -- common/autotest_common.sh@650 -- # local es=0 00:06:59.336 15:53:22 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:59.336 15:53:22 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:59.336 15:53:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:59.336 15:53:22 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:59.336 15:53:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:59.336 15:53:22 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:59.336 15:53:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:59.336 15:53:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.336 15:53:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.336 15:53:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.336 15:53:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.336 15:53:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.336 15:53:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.336 15:53:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.336 15:53:22 -- accel/accel.sh@42 -- # jq -r . 00:06:59.336 Unsupported workload type: foobar 00:06:59.336 [2024-11-18 15:53:22.698082] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:59.336 accel_perf options: 00:06:59.336 [-h help message] 00:06:59.336 [-q queue depth per core] 00:06:59.336 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:59.336 [-T number of threads per core 00:06:59.336 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:59.336 [-t time in seconds] 00:06:59.336 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:59.336 [ dif_verify, , dif_generate, dif_generate_copy 00:06:59.336 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:59.336 [-l for compress/decompress workloads, name of uncompressed input file 00:06:59.336 [-S for crc32c workload, use this seed value (default 0) 00:06:59.336 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:59.336 [-f for fill workload, use this BYTE value (default 255) 00:06:59.336 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:59.336 [-y verify result if this switch is on] 00:06:59.336 [-a tasks to allocate per core (default: same value as -q)] 00:06:59.336 Can be used to spread operations across a wider range of memory. 00:06:59.336 15:53:22 -- common/autotest_common.sh@653 -- # es=1 00:06:59.336 15:53:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:59.336 15:53:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:59.336 15:53:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:59.336 00:06:59.336 real 0m0.021s 00:06:59.336 user 0m0.009s 00:06:59.336 sys 0m0.012s 00:06:59.336 15:53:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.336 15:53:22 -- common/autotest_common.sh@10 -- # set +x 00:06:59.336 ************************************ 00:06:59.336 END TEST accel_wrong_workload 00:06:59.336 ************************************ 00:06:59.336 Error: writing output failed: Broken pipe 00:06:59.336 15:53:22 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:59.336 15:53:22 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:59.336 15:53:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.336 15:53:22 -- common/autotest_common.sh@10 -- # set +x 00:06:59.336 ************************************ 00:06:59.336 START TEST accel_negative_buffers 00:06:59.336 ************************************ 00:06:59.336 15:53:22 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:59.336 15:53:22 -- common/autotest_common.sh@650 -- # local es=0 00:06:59.336 15:53:22 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:59.336 15:53:22 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:59.336 15:53:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:59.336 15:53:22 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:59.336 15:53:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:59.336 15:53:22 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:59.336 15:53:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:59.336 15:53:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.336 15:53:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.336 15:53:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.336 15:53:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.336 15:53:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.336 15:53:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.336 15:53:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.336 15:53:22 -- accel/accel.sh@42 -- # jq -r . 00:06:59.336 -x option must be non-negative. 00:06:59.336 [2024-11-18 15:53:22.746983] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:59.336 accel_perf options: 00:06:59.336 [-h help message] 00:06:59.336 [-q queue depth per core] 00:06:59.336 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:59.336 [-T number of threads per core 00:06:59.336 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:59.336 [-t time in seconds] 00:06:59.336 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:59.336 [ dif_verify, , dif_generate, dif_generate_copy 00:06:59.336 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:59.336 [-l for compress/decompress workloads, name of uncompressed input file 00:06:59.336 [-S for crc32c workload, use this seed value (default 0) 00:06:59.336 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:59.336 [-f for fill workload, use this BYTE value (default 255) 00:06:59.336 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:59.336 [-y verify result if this switch is on] 00:06:59.336 [-a tasks to allocate per core (default: same value as -q)] 00:06:59.336 Can be used to spread operations across a wider range of memory. 00:06:59.336 15:53:22 -- common/autotest_common.sh@653 -- # es=1 00:06:59.336 15:53:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:59.336 15:53:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:59.336 15:53:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:59.336 00:06:59.336 real 0m0.024s 00:06:59.336 user 0m0.011s 00:06:59.336 sys 0m0.013s 00:06:59.336 15:53:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.336 15:53:22 -- common/autotest_common.sh@10 -- # set +x 00:06:59.336 ************************************ 00:06:59.336 END TEST accel_negative_buffers 00:06:59.336 ************************************ 00:06:59.336 Error: writing output failed: Broken pipe 00:06:59.336 15:53:22 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:59.336 15:53:22 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:59.336 15:53:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.336 15:53:22 -- common/autotest_common.sh@10 -- # set +x 00:06:59.336 ************************************ 00:06:59.336 START TEST accel_crc32c 00:06:59.336 ************************************ 00:06:59.336 15:53:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:59.336 15:53:22 -- accel/accel.sh@16 -- # local accel_opc 00:06:59.336 15:53:22 -- accel/accel.sh@17 -- # local accel_module 00:06:59.336 15:53:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:59.337 15:53:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:59.337 15:53:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.337 15:53:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.337 15:53:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.337 15:53:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.337 15:53:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.337 15:53:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.337 15:53:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.337 15:53:22 -- accel/accel.sh@42 -- # jq -r . 00:06:59.337 [2024-11-18 15:53:22.792510] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:59.337 [2024-11-18 15:53:22.792577] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469651 ] 00:06:59.337 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.337 [2024-11-18 15:53:22.854404] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.597 [2024-11-18 15:53:22.948443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.976 15:53:24 -- accel/accel.sh@18 -- # out=' 00:07:00.976 SPDK Configuration: 00:07:00.976 Core mask: 0x1 00:07:00.976 00:07:00.976 Accel Perf Configuration: 00:07:00.976 Workload Type: crc32c 00:07:00.976 CRC-32C seed: 32 00:07:00.976 Transfer size: 4096 bytes 00:07:00.976 Vector count 1 00:07:00.976 Module: software 00:07:00.976 Queue depth: 32 00:07:00.976 Allocate depth: 32 00:07:00.976 # threads/core: 1 00:07:00.976 Run time: 1 seconds 00:07:00.976 Verify: Yes 00:07:00.976 00:07:00.976 Running for 1 seconds... 00:07:00.976 00:07:00.976 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:00.976 ------------------------------------------------------------------------------------ 00:07:00.976 0,0 407712/s 1592 MiB/s 0 0 00:07:00.976 ==================================================================================== 00:07:00.976 Total 407712/s 1592 MiB/s 0 0' 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:00.976 15:53:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:00.976 15:53:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.976 15:53:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.976 15:53:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.976 15:53:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.976 15:53:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.976 15:53:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.976 15:53:24 -- accel/accel.sh@42 -- # jq -r . 00:07:00.976 [2024-11-18 15:53:24.177616] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:00.976 [2024-11-18 15:53:24.177733] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469806 ] 00:07:00.976 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.976 [2024-11-18 15:53:24.238213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.976 [2024-11-18 15:53:24.328545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val= 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val= 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val=0x1 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val= 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val= 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val=crc32c 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val=32 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val= 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val=software 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@23 -- # accel_module=software 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val=32 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val=32 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val=1 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val=Yes 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val= 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.976 15:53:24 -- accel/accel.sh@21 -- # val= 00:07:00.976 15:53:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.976 15:53:24 -- accel/accel.sh@20 -- # read -r var val 00:07:02.362 15:53:25 -- accel/accel.sh@21 -- # val= 00:07:02.362 15:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:02.362 15:53:25 -- accel/accel.sh@21 -- # val= 00:07:02.362 15:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:02.362 15:53:25 -- accel/accel.sh@21 -- # val= 00:07:02.362 15:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:02.362 15:53:25 -- accel/accel.sh@21 -- # val= 00:07:02.362 15:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:02.362 15:53:25 -- accel/accel.sh@21 -- # val= 00:07:02.362 15:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:02.362 15:53:25 -- accel/accel.sh@21 -- # val= 00:07:02.362 15:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:02.362 15:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:02.362 15:53:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:02.362 15:53:25 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:02.362 15:53:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:02.362 00:07:02.362 real 0m2.787s 00:07:02.362 user 0m2.490s 00:07:02.362 sys 0m0.292s 00:07:02.362 15:53:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.362 15:53:25 -- common/autotest_common.sh@10 -- # set +x 00:07:02.362 ************************************ 00:07:02.362 END TEST accel_crc32c 00:07:02.362 ************************************ 00:07:02.362 15:53:25 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:07:02.362 15:53:25 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:02.362 15:53:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.362 15:53:25 -- common/autotest_common.sh@10 -- # set +x 00:07:02.362 ************************************ 00:07:02.362 START TEST accel_crc32c_C2 00:07:02.362 ************************************ 00:07:02.362 15:53:25 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:07:02.362 15:53:25 -- accel/accel.sh@16 -- # local accel_opc 00:07:02.362 15:53:25 -- accel/accel.sh@17 -- # local accel_module 00:07:02.362 15:53:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:02.362 15:53:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:02.362 15:53:25 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.362 15:53:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.362 15:53:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.362 15:53:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.362 15:53:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.362 15:53:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.362 15:53:25 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.362 15:53:25 -- accel/accel.sh@42 -- # jq -r . 00:07:02.363 [2024-11-18 15:53:25.607526] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:02.363 [2024-11-18 15:53:25.607621] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469960 ] 00:07:02.363 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.363 [2024-11-18 15:53:25.668576] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.363 [2024-11-18 15:53:25.759106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.752 15:53:26 -- accel/accel.sh@18 -- # out=' 00:07:03.752 SPDK Configuration: 00:07:03.752 Core mask: 0x1 00:07:03.752 00:07:03.752 Accel Perf Configuration: 00:07:03.752 Workload Type: crc32c 00:07:03.752 CRC-32C seed: 0 00:07:03.752 Transfer size: 4096 bytes 00:07:03.752 Vector count 2 00:07:03.752 Module: software 00:07:03.752 Queue depth: 32 00:07:03.752 Allocate depth: 32 00:07:03.752 # threads/core: 1 00:07:03.752 Run time: 1 seconds 00:07:03.752 Verify: Yes 00:07:03.752 00:07:03.752 Running for 1 seconds... 00:07:03.752 00:07:03.752 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:03.752 ------------------------------------------------------------------------------------ 00:07:03.752 0,0 320928/s 2507 MiB/s 0 0 00:07:03.752 ==================================================================================== 00:07:03.752 Total 320928/s 1253 MiB/s 0 0' 00:07:03.752 15:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:03.752 15:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:03.752 15:53:26 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.752 15:53:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.752 15:53:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.752 15:53:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.752 15:53:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.752 15:53:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.752 15:53:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.752 15:53:26 -- accel/accel.sh@42 -- # jq -r . 00:07:03.752 [2024-11-18 15:53:27.007937] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:03.752 [2024-11-18 15:53:27.008029] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1470100 ] 00:07:03.752 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.752 [2024-11-18 15:53:27.069892] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.752 [2024-11-18 15:53:27.162256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val= 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val= 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val=0x1 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val= 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val= 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val=crc32c 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val=0 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val= 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val=software 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@23 -- # accel_module=software 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val=32 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val=32 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val=1 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val=Yes 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val= 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.752 15:53:27 -- accel/accel.sh@21 -- # val= 00:07:03.752 15:53:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.752 15:53:27 -- accel/accel.sh@20 -- # read -r var val 00:07:05.129 15:53:28 -- accel/accel.sh@21 -- # val= 00:07:05.129 15:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:05.129 15:53:28 -- accel/accel.sh@21 -- # val= 00:07:05.129 15:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:05.129 15:53:28 -- accel/accel.sh@21 -- # val= 00:07:05.129 15:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:05.129 15:53:28 -- accel/accel.sh@21 -- # val= 00:07:05.129 15:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:05.129 15:53:28 -- accel/accel.sh@21 -- # val= 00:07:05.129 15:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:05.129 15:53:28 -- accel/accel.sh@21 -- # val= 00:07:05.129 15:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:05.129 15:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:05.129 15:53:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:05.129 15:53:28 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:05.129 15:53:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:05.129 00:07:05.129 real 0m2.789s 00:07:05.129 user 0m2.491s 00:07:05.129 sys 0m0.291s 00:07:05.129 15:53:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.129 15:53:28 -- common/autotest_common.sh@10 -- # set +x 00:07:05.129 ************************************ 00:07:05.129 END TEST accel_crc32c_C2 00:07:05.129 ************************************ 00:07:05.129 15:53:28 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:07:05.129 15:53:28 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:05.129 15:53:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.129 15:53:28 -- common/autotest_common.sh@10 -- # set +x 00:07:05.129 ************************************ 00:07:05.129 START TEST accel_copy 00:07:05.129 ************************************ 00:07:05.129 15:53:28 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:07:05.129 15:53:28 -- accel/accel.sh@16 -- # local accel_opc 00:07:05.129 15:53:28 -- accel/accel.sh@17 -- # local accel_module 00:07:05.129 15:53:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:07:05.129 15:53:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:05.129 15:53:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.129 15:53:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.129 15:53:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.129 15:53:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.129 15:53:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.129 15:53:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.129 15:53:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.129 15:53:28 -- accel/accel.sh@42 -- # jq -r . 00:07:05.129 [2024-11-18 15:53:28.421165] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:05.129 [2024-11-18 15:53:28.421257] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1470378 ] 00:07:05.129 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.129 [2024-11-18 15:53:28.481526] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.129 [2024-11-18 15:53:28.571858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.511 15:53:29 -- accel/accel.sh@18 -- # out=' 00:07:06.511 SPDK Configuration: 00:07:06.511 Core mask: 0x1 00:07:06.511 00:07:06.511 Accel Perf Configuration: 00:07:06.511 Workload Type: copy 00:07:06.512 Transfer size: 4096 bytes 00:07:06.512 Vector count 1 00:07:06.512 Module: software 00:07:06.512 Queue depth: 32 00:07:06.512 Allocate depth: 32 00:07:06.512 # threads/core: 1 00:07:06.512 Run time: 1 seconds 00:07:06.512 Verify: Yes 00:07:06.512 00:07:06.512 Running for 1 seconds... 00:07:06.512 00:07:06.512 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:06.512 ------------------------------------------------------------------------------------ 00:07:06.512 0,0 279776/s 1092 MiB/s 0 0 00:07:06.512 ==================================================================================== 00:07:06.512 Total 279776/s 1092 MiB/s 0 0' 00:07:06.512 15:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:07:06.512 15:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:06.512 15:53:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.512 15:53:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.512 15:53:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.512 15:53:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.512 15:53:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.512 15:53:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.512 15:53:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.512 15:53:29 -- accel/accel.sh@42 -- # jq -r . 00:07:06.512 [2024-11-18 15:53:29.822408] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:06.512 [2024-11-18 15:53:29.822493] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1470524 ] 00:07:06.512 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.512 [2024-11-18 15:53:29.884303] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.512 [2024-11-18 15:53:29.973604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val= 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val= 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val=0x1 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val= 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val= 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val=copy 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@24 -- # accel_opc=copy 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val= 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val=software 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@23 -- # accel_module=software 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val=32 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val=32 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val=1 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val=Yes 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val= 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:06.512 15:53:30 -- accel/accel.sh@21 -- # val= 00:07:06.512 15:53:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # IFS=: 00:07:06.512 15:53:30 -- accel/accel.sh@20 -- # read -r var val 00:07:07.894 15:53:31 -- accel/accel.sh@21 -- # val= 00:07:07.894 15:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:07.894 15:53:31 -- accel/accel.sh@21 -- # val= 00:07:07.894 15:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:07.894 15:53:31 -- accel/accel.sh@21 -- # val= 00:07:07.894 15:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:07.894 15:53:31 -- accel/accel.sh@21 -- # val= 00:07:07.894 15:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:07.894 15:53:31 -- accel/accel.sh@21 -- # val= 00:07:07.894 15:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:07.894 15:53:31 -- accel/accel.sh@21 -- # val= 00:07:07.894 15:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:07.894 15:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:07.894 15:53:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:07.894 15:53:31 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:07:07.894 15:53:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.894 00:07:07.894 real 0m2.804s 00:07:07.894 user 0m2.509s 00:07:07.894 sys 0m0.287s 00:07:07.894 15:53:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.894 15:53:31 -- common/autotest_common.sh@10 -- # set +x 00:07:07.894 ************************************ 00:07:07.894 END TEST accel_copy 00:07:07.894 ************************************ 00:07:07.894 15:53:31 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:07.894 15:53:31 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:07.894 15:53:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.894 15:53:31 -- common/autotest_common.sh@10 -- # set +x 00:07:07.894 ************************************ 00:07:07.894 START TEST accel_fill 00:07:07.894 ************************************ 00:07:07.894 15:53:31 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:07.894 15:53:31 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.894 15:53:31 -- accel/accel.sh@17 -- # local accel_module 00:07:07.894 15:53:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:07.894 15:53:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:07.894 15:53:31 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.894 15:53:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.894 15:53:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.894 15:53:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.894 15:53:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.894 15:53:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.894 15:53:31 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.894 15:53:31 -- accel/accel.sh@42 -- # jq -r . 00:07:07.894 [2024-11-18 15:53:31.249768] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:07.894 [2024-11-18 15:53:31.249856] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1470687 ] 00:07:07.894 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.895 [2024-11-18 15:53:31.312283] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.895 [2024-11-18 15:53:31.402873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.306 15:53:32 -- accel/accel.sh@18 -- # out=' 00:07:09.306 SPDK Configuration: 00:07:09.306 Core mask: 0x1 00:07:09.306 00:07:09.306 Accel Perf Configuration: 00:07:09.306 Workload Type: fill 00:07:09.306 Fill pattern: 0x80 00:07:09.306 Transfer size: 4096 bytes 00:07:09.306 Vector count 1 00:07:09.306 Module: software 00:07:09.306 Queue depth: 64 00:07:09.306 Allocate depth: 64 00:07:09.306 # threads/core: 1 00:07:09.306 Run time: 1 seconds 00:07:09.306 Verify: Yes 00:07:09.306 00:07:09.306 Running for 1 seconds... 00:07:09.306 00:07:09.306 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:09.306 ------------------------------------------------------------------------------------ 00:07:09.306 0,0 408128/s 1594 MiB/s 0 0 00:07:09.306 ==================================================================================== 00:07:09.306 Total 408128/s 1594 MiB/s 0 0' 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.306 15:53:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.306 15:53:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:09.306 15:53:32 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.306 15:53:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.306 15:53:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.306 15:53:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.306 15:53:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.306 15:53:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.306 15:53:32 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.306 15:53:32 -- accel/accel.sh@42 -- # jq -r . 00:07:09.306 [2024-11-18 15:53:32.654995] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:09.306 [2024-11-18 15:53:32.655091] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1470831 ] 00:07:09.306 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.306 [2024-11-18 15:53:32.715476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.306 [2024-11-18 15:53:32.809673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.306 15:53:32 -- accel/accel.sh@21 -- # val= 00:07:09.306 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.306 15:53:32 -- accel/accel.sh@21 -- # val= 00:07:09.306 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.306 15:53:32 -- accel/accel.sh@21 -- # val=0x1 00:07:09.306 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.306 15:53:32 -- accel/accel.sh@21 -- # val= 00:07:09.306 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.306 15:53:32 -- accel/accel.sh@21 -- # val= 00:07:09.306 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.306 15:53:32 -- accel/accel.sh@21 -- # val=fill 00:07:09.306 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.306 15:53:32 -- accel/accel.sh@24 -- # accel_opc=fill 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.306 15:53:32 -- accel/accel.sh@21 -- # val=0x80 00:07:09.306 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.306 15:53:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:09.306 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.306 15:53:32 -- accel/accel.sh@21 -- # val= 00:07:09.306 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.306 15:53:32 -- accel/accel.sh@21 -- # val=software 00:07:09.306 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.306 15:53:32 -- accel/accel.sh@23 -- # accel_module=software 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.306 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.306 15:53:32 -- accel/accel.sh@21 -- # val=64 00:07:09.307 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.307 15:53:32 -- accel/accel.sh@21 -- # val=64 00:07:09.307 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.307 15:53:32 -- accel/accel.sh@21 -- # val=1 00:07:09.307 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.307 15:53:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:09.307 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.307 15:53:32 -- accel/accel.sh@21 -- # val=Yes 00:07:09.307 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.307 15:53:32 -- accel/accel.sh@21 -- # val= 00:07:09.307 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:09.307 15:53:32 -- accel/accel.sh@21 -- # val= 00:07:09.307 15:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:09.307 15:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:10.680 15:53:34 -- accel/accel.sh@21 -- # val= 00:07:10.680 15:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.680 15:53:34 -- accel/accel.sh@21 -- # val= 00:07:10.680 15:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.680 15:53:34 -- accel/accel.sh@21 -- # val= 00:07:10.680 15:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.680 15:53:34 -- accel/accel.sh@21 -- # val= 00:07:10.680 15:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.680 15:53:34 -- accel/accel.sh@21 -- # val= 00:07:10.680 15:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.680 15:53:34 -- accel/accel.sh@21 -- # val= 00:07:10.680 15:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.680 15:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.680 15:53:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:10.680 15:53:34 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:10.680 15:53:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.680 00:07:10.680 real 0m2.813s 00:07:10.680 user 0m2.519s 00:07:10.680 sys 0m0.285s 00:07:10.680 15:53:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.680 15:53:34 -- common/autotest_common.sh@10 -- # set +x 00:07:10.680 ************************************ 00:07:10.680 END TEST accel_fill 00:07:10.680 ************************************ 00:07:10.680 15:53:34 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:10.680 15:53:34 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:10.680 15:53:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.680 15:53:34 -- common/autotest_common.sh@10 -- # set +x 00:07:10.680 ************************************ 00:07:10.680 START TEST accel_copy_crc32c 00:07:10.680 ************************************ 00:07:10.680 15:53:34 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:07:10.680 15:53:34 -- accel/accel.sh@16 -- # local accel_opc 00:07:10.680 15:53:34 -- accel/accel.sh@17 -- # local accel_module 00:07:10.680 15:53:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:10.680 15:53:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:10.680 15:53:34 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.680 15:53:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.680 15:53:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.680 15:53:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.680 15:53:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.680 15:53:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.680 15:53:34 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.680 15:53:34 -- accel/accel.sh@42 -- # jq -r . 00:07:10.680 [2024-11-18 15:53:34.083602] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:10.680 [2024-11-18 15:53:34.083710] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471103 ] 00:07:10.680 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.680 [2024-11-18 15:53:34.143323] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.680 [2024-11-18 15:53:34.233304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.051 15:53:35 -- accel/accel.sh@18 -- # out=' 00:07:12.051 SPDK Configuration: 00:07:12.051 Core mask: 0x1 00:07:12.051 00:07:12.051 Accel Perf Configuration: 00:07:12.051 Workload Type: copy_crc32c 00:07:12.051 CRC-32C seed: 0 00:07:12.051 Vector size: 4096 bytes 00:07:12.051 Transfer size: 4096 bytes 00:07:12.051 Vector count 1 00:07:12.051 Module: software 00:07:12.051 Queue depth: 32 00:07:12.051 Allocate depth: 32 00:07:12.051 # threads/core: 1 00:07:12.051 Run time: 1 seconds 00:07:12.051 Verify: Yes 00:07:12.051 00:07:12.051 Running for 1 seconds... 00:07:12.051 00:07:12.051 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:12.051 ------------------------------------------------------------------------------------ 00:07:12.051 0,0 219968/s 859 MiB/s 0 0 00:07:12.051 ==================================================================================== 00:07:12.051 Total 219968/s 859 MiB/s 0 0' 00:07:12.051 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.051 15:53:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:12.051 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.051 15:53:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:12.051 15:53:35 -- accel/accel.sh@12 -- # build_accel_config 00:07:12.051 15:53:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.051 15:53:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.051 15:53:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.051 15:53:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.051 15:53:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.051 15:53:35 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.051 15:53:35 -- accel/accel.sh@42 -- # jq -r . 00:07:12.051 [2024-11-18 15:53:35.483735] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:12.051 [2024-11-18 15:53:35.483819] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471255 ] 00:07:12.051 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.051 [2024-11-18 15:53:35.545332] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.051 [2024-11-18 15:53:35.635852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val= 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val= 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val=0x1 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val= 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val= 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val=0 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val= 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val=software 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@23 -- # accel_module=software 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val=32 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val=32 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val=1 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val=Yes 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val= 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:12.310 15:53:35 -- accel/accel.sh@21 -- # val= 00:07:12.310 15:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:12.310 15:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:13.337 15:53:36 -- accel/accel.sh@21 -- # val= 00:07:13.337 15:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:13.337 15:53:36 -- accel/accel.sh@21 -- # val= 00:07:13.337 15:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:13.337 15:53:36 -- accel/accel.sh@21 -- # val= 00:07:13.337 15:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:13.337 15:53:36 -- accel/accel.sh@21 -- # val= 00:07:13.337 15:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:13.337 15:53:36 -- accel/accel.sh@21 -- # val= 00:07:13.337 15:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:13.337 15:53:36 -- accel/accel.sh@21 -- # val= 00:07:13.337 15:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:13.337 15:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:13.337 15:53:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:13.337 15:53:36 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:13.337 15:53:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:13.337 00:07:13.337 real 0m2.801s 00:07:13.337 user 0m2.508s 00:07:13.337 sys 0m0.286s 00:07:13.338 15:53:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:13.338 15:53:36 -- common/autotest_common.sh@10 -- # set +x 00:07:13.338 ************************************ 00:07:13.338 END TEST accel_copy_crc32c 00:07:13.338 ************************************ 00:07:13.338 15:53:36 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:13.338 15:53:36 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:13.338 15:53:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.338 15:53:36 -- common/autotest_common.sh@10 -- # set +x 00:07:13.338 ************************************ 00:07:13.338 START TEST accel_copy_crc32c_C2 00:07:13.338 ************************************ 00:07:13.338 15:53:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:13.338 15:53:36 -- accel/accel.sh@16 -- # local accel_opc 00:07:13.338 15:53:36 -- accel/accel.sh@17 -- # local accel_module 00:07:13.338 15:53:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:13.338 15:53:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:13.338 15:53:36 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.338 15:53:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.338 15:53:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.338 15:53:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.338 15:53:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.338 15:53:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.338 15:53:36 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.338 15:53:36 -- accel/accel.sh@42 -- # jq -r . 00:07:13.338 [2024-11-18 15:53:36.910936] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:13.338 [2024-11-18 15:53:36.911025] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471412 ] 00:07:13.596 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.596 [2024-11-18 15:53:36.972549] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.596 [2024-11-18 15:53:37.062948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.969 15:53:38 -- accel/accel.sh@18 -- # out=' 00:07:14.969 SPDK Configuration: 00:07:14.969 Core mask: 0x1 00:07:14.969 00:07:14.969 Accel Perf Configuration: 00:07:14.969 Workload Type: copy_crc32c 00:07:14.969 CRC-32C seed: 0 00:07:14.969 Vector size: 4096 bytes 00:07:14.969 Transfer size: 8192 bytes 00:07:14.969 Vector count 2 00:07:14.969 Module: software 00:07:14.969 Queue depth: 32 00:07:14.969 Allocate depth: 32 00:07:14.969 # threads/core: 1 00:07:14.969 Run time: 1 seconds 00:07:14.969 Verify: Yes 00:07:14.969 00:07:14.969 Running for 1 seconds... 00:07:14.969 00:07:14.969 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.969 ------------------------------------------------------------------------------------ 00:07:14.969 0,0 158144/s 1235 MiB/s 0 0 00:07:14.969 ==================================================================================== 00:07:14.969 Total 158144/s 617 MiB/s 0 0' 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:14.969 15:53:38 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.969 15:53:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.969 15:53:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.969 15:53:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.969 15:53:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.969 15:53:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.969 15:53:38 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.969 15:53:38 -- accel/accel.sh@42 -- # jq -r . 00:07:14.969 [2024-11-18 15:53:38.308438] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:14.969 [2024-11-18 15:53:38.308522] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471556 ] 00:07:14.969 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.969 [2024-11-18 15:53:38.368461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.969 [2024-11-18 15:53:38.459144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val= 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val= 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val=0x1 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val= 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val= 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val=0 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val= 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val=software 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@23 -- # accel_module=software 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val=32 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val=32 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val=1 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val=Yes 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val= 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.969 15:53:38 -- accel/accel.sh@21 -- # val= 00:07:14.969 15:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.969 15:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:16.341 15:53:39 -- accel/accel.sh@21 -- # val= 00:07:16.342 15:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:16.342 15:53:39 -- accel/accel.sh@21 -- # val= 00:07:16.342 15:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:16.342 15:53:39 -- accel/accel.sh@21 -- # val= 00:07:16.342 15:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:16.342 15:53:39 -- accel/accel.sh@21 -- # val= 00:07:16.342 15:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:16.342 15:53:39 -- accel/accel.sh@21 -- # val= 00:07:16.342 15:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:16.342 15:53:39 -- accel/accel.sh@21 -- # val= 00:07:16.342 15:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:16.342 15:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:16.342 15:53:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:16.342 15:53:39 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:16.342 15:53:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:16.342 00:07:16.342 real 0m2.786s 00:07:16.342 user 0m2.489s 00:07:16.342 sys 0m0.289s 00:07:16.342 15:53:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.342 15:53:39 -- common/autotest_common.sh@10 -- # set +x 00:07:16.342 ************************************ 00:07:16.342 END TEST accel_copy_crc32c_C2 00:07:16.342 ************************************ 00:07:16.342 15:53:39 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:16.342 15:53:39 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:16.342 15:53:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.342 15:53:39 -- common/autotest_common.sh@10 -- # set +x 00:07:16.342 ************************************ 00:07:16.342 START TEST accel_dualcast 00:07:16.342 ************************************ 00:07:16.342 15:53:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:07:16.342 15:53:39 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.342 15:53:39 -- accel/accel.sh@17 -- # local accel_module 00:07:16.342 15:53:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:16.342 15:53:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:16.342 15:53:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.342 15:53:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.342 15:53:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.342 15:53:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.342 15:53:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.342 15:53:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.342 15:53:39 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.342 15:53:39 -- accel/accel.sh@42 -- # jq -r . 00:07:16.342 [2024-11-18 15:53:39.722066] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:16.342 [2024-11-18 15:53:39.722158] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471830 ] 00:07:16.342 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.342 [2024-11-18 15:53:39.783830] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.342 [2024-11-18 15:53:39.874077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.716 15:53:41 -- accel/accel.sh@18 -- # out=' 00:07:17.716 SPDK Configuration: 00:07:17.716 Core mask: 0x1 00:07:17.716 00:07:17.716 Accel Perf Configuration: 00:07:17.716 Workload Type: dualcast 00:07:17.716 Transfer size: 4096 bytes 00:07:17.716 Vector count 1 00:07:17.716 Module: software 00:07:17.716 Queue depth: 32 00:07:17.716 Allocate depth: 32 00:07:17.716 # threads/core: 1 00:07:17.716 Run time: 1 seconds 00:07:17.716 Verify: Yes 00:07:17.716 00:07:17.716 Running for 1 seconds... 00:07:17.716 00:07:17.716 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:17.716 ------------------------------------------------------------------------------------ 00:07:17.716 0,0 299712/s 1170 MiB/s 0 0 00:07:17.716 ==================================================================================== 00:07:17.716 Total 299712/s 1170 MiB/s 0 0' 00:07:17.716 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.716 15:53:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:17.716 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.716 15:53:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:17.716 15:53:41 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.716 15:53:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.716 15:53:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.716 15:53:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.716 15:53:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.716 15:53:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.716 15:53:41 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.716 15:53:41 -- accel/accel.sh@42 -- # jq -r . 00:07:17.716 [2024-11-18 15:53:41.122788] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:17.716 [2024-11-18 15:53:41.122877] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471968 ] 00:07:17.716 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.716 [2024-11-18 15:53:41.184185] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.716 [2024-11-18 15:53:41.272645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val= 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val= 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val=0x1 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val= 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val= 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val=dualcast 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val= 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val=software 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@23 -- # accel_module=software 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val=32 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val=32 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val=1 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val=Yes 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val= 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.974 15:53:41 -- accel/accel.sh@21 -- # val= 00:07:17.974 15:53:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.974 15:53:41 -- accel/accel.sh@20 -- # read -r var val 00:07:18.909 15:53:42 -- accel/accel.sh@21 -- # val= 00:07:18.909 15:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:18.909 15:53:42 -- accel/accel.sh@21 -- # val= 00:07:18.909 15:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:18.909 15:53:42 -- accel/accel.sh@21 -- # val= 00:07:18.909 15:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:18.909 15:53:42 -- accel/accel.sh@21 -- # val= 00:07:18.909 15:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:18.909 15:53:42 -- accel/accel.sh@21 -- # val= 00:07:18.909 15:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:18.909 15:53:42 -- accel/accel.sh@21 -- # val= 00:07:18.909 15:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:18.909 15:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:18.909 15:53:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:18.909 15:53:42 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:18.909 15:53:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:18.909 00:07:18.909 real 0m2.792s 00:07:18.909 user 0m2.496s 00:07:18.909 sys 0m0.288s 00:07:18.909 15:53:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:18.909 15:53:42 -- common/autotest_common.sh@10 -- # set +x 00:07:18.909 ************************************ 00:07:18.909 END TEST accel_dualcast 00:07:18.909 ************************************ 00:07:19.167 15:53:42 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:19.167 15:53:42 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:19.167 15:53:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.167 15:53:42 -- common/autotest_common.sh@10 -- # set +x 00:07:19.167 ************************************ 00:07:19.167 START TEST accel_compare 00:07:19.167 ************************************ 00:07:19.167 15:53:42 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:07:19.167 15:53:42 -- accel/accel.sh@16 -- # local accel_opc 00:07:19.167 15:53:42 -- accel/accel.sh@17 -- # local accel_module 00:07:19.167 15:53:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:19.167 15:53:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:19.167 15:53:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.167 15:53:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.167 15:53:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.167 15:53:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.167 15:53:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.167 15:53:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.167 15:53:42 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.167 15:53:42 -- accel/accel.sh@42 -- # jq -r . 00:07:19.167 [2024-11-18 15:53:42.543291] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:19.167 [2024-11-18 15:53:42.543373] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1472139 ] 00:07:19.167 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.167 [2024-11-18 15:53:42.605576] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.167 [2024-11-18 15:53:42.693221] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.540 15:53:43 -- accel/accel.sh@18 -- # out=' 00:07:20.540 SPDK Configuration: 00:07:20.540 Core mask: 0x1 00:07:20.540 00:07:20.540 Accel Perf Configuration: 00:07:20.540 Workload Type: compare 00:07:20.540 Transfer size: 4096 bytes 00:07:20.540 Vector count 1 00:07:20.540 Module: software 00:07:20.540 Queue depth: 32 00:07:20.540 Allocate depth: 32 00:07:20.540 # threads/core: 1 00:07:20.540 Run time: 1 seconds 00:07:20.540 Verify: Yes 00:07:20.540 00:07:20.540 Running for 1 seconds... 00:07:20.540 00:07:20.540 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:20.540 ------------------------------------------------------------------------------------ 00:07:20.540 0,0 395488/s 1544 MiB/s 0 0 00:07:20.540 ==================================================================================== 00:07:20.540 Total 395488/s 1544 MiB/s 0 0' 00:07:20.540 15:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:20.541 15:53:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:20.541 15:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:20.541 15:53:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:20.541 15:53:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.541 15:53:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.541 15:53:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.541 15:53:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.541 15:53:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.541 15:53:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.541 15:53:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.541 15:53:43 -- accel/accel.sh@42 -- # jq -r . 00:07:20.541 [2024-11-18 15:53:43.946212] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:20.541 [2024-11-18 15:53:43.946306] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1472277 ] 00:07:20.541 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.541 [2024-11-18 15:53:44.006620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.541 [2024-11-18 15:53:44.096529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val= 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val= 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val=0x1 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val= 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val= 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val=compare 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val= 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val=software 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@23 -- # accel_module=software 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val=32 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val=32 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val=1 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val=Yes 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val= 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.799 15:53:44 -- accel/accel.sh@21 -- # val= 00:07:20.799 15:53:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.799 15:53:44 -- accel/accel.sh@20 -- # read -r var val 00:07:22.172 15:53:45 -- accel/accel.sh@21 -- # val= 00:07:22.172 15:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.172 15:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:22.172 15:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:22.172 15:53:45 -- accel/accel.sh@21 -- # val= 00:07:22.172 15:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.172 15:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:22.172 15:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:22.172 15:53:45 -- accel/accel.sh@21 -- # val= 00:07:22.173 15:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.173 15:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:22.173 15:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:22.173 15:53:45 -- accel/accel.sh@21 -- # val= 00:07:22.173 15:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.173 15:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:22.173 15:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:22.173 15:53:45 -- accel/accel.sh@21 -- # val= 00:07:22.173 15:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.173 15:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:22.173 15:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:22.173 15:53:45 -- accel/accel.sh@21 -- # val= 00:07:22.173 15:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.173 15:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:22.173 15:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:22.173 15:53:45 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:22.173 15:53:45 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:22.173 15:53:45 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:22.173 00:07:22.173 real 0m2.805s 00:07:22.173 user 0m2.506s 00:07:22.173 sys 0m0.291s 00:07:22.173 15:53:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.173 15:53:45 -- common/autotest_common.sh@10 -- # set +x 00:07:22.173 ************************************ 00:07:22.173 END TEST accel_compare 00:07:22.173 ************************************ 00:07:22.173 15:53:45 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:22.173 15:53:45 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:22.173 15:53:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.173 15:53:45 -- common/autotest_common.sh@10 -- # set +x 00:07:22.173 ************************************ 00:07:22.173 START TEST accel_xor 00:07:22.173 ************************************ 00:07:22.173 15:53:45 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:07:22.173 15:53:45 -- accel/accel.sh@16 -- # local accel_opc 00:07:22.173 15:53:45 -- accel/accel.sh@17 -- # local accel_module 00:07:22.173 15:53:45 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:22.173 15:53:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:22.173 15:53:45 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.173 15:53:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.173 15:53:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.173 15:53:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.173 15:53:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.173 15:53:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.173 15:53:45 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.173 15:53:45 -- accel/accel.sh@42 -- # jq -r . 00:07:22.173 [2024-11-18 15:53:45.374130] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:22.173 [2024-11-18 15:53:45.374213] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1472518 ] 00:07:22.173 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.173 [2024-11-18 15:53:45.437567] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.173 [2024-11-18 15:53:45.527854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.545 15:53:46 -- accel/accel.sh@18 -- # out=' 00:07:23.545 SPDK Configuration: 00:07:23.545 Core mask: 0x1 00:07:23.545 00:07:23.545 Accel Perf Configuration: 00:07:23.545 Workload Type: xor 00:07:23.545 Source buffers: 2 00:07:23.545 Transfer size: 4096 bytes 00:07:23.545 Vector count 1 00:07:23.545 Module: software 00:07:23.545 Queue depth: 32 00:07:23.545 Allocate depth: 32 00:07:23.545 # threads/core: 1 00:07:23.545 Run time: 1 seconds 00:07:23.545 Verify: Yes 00:07:23.545 00:07:23.545 Running for 1 seconds... 00:07:23.545 00:07:23.545 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:23.545 ------------------------------------------------------------------------------------ 00:07:23.545 0,0 192320/s 751 MiB/s 0 0 00:07:23.545 ==================================================================================== 00:07:23.545 Total 192320/s 751 MiB/s 0 0' 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:23.545 15:53:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.545 15:53:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.545 15:53:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.545 15:53:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.545 15:53:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.545 15:53:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.545 15:53:46 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.545 15:53:46 -- accel/accel.sh@42 -- # jq -r . 00:07:23.545 [2024-11-18 15:53:46.782270] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:23.545 [2024-11-18 15:53:46.782354] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1472695 ] 00:07:23.545 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.545 [2024-11-18 15:53:46.844765] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.545 [2024-11-18 15:53:46.932437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val= 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val= 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val=0x1 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val= 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val= 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val=xor 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val=2 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val= 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val=software 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@23 -- # accel_module=software 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val=32 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val=32 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val=1 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.545 15:53:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:23.545 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.545 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.546 15:53:46 -- accel/accel.sh@21 -- # val=Yes 00:07:23.546 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.546 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.546 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.546 15:53:46 -- accel/accel.sh@21 -- # val= 00:07:23.546 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.546 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.546 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:23.546 15:53:46 -- accel/accel.sh@21 -- # val= 00:07:23.546 15:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.546 15:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:23.546 15:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:24.919 15:53:48 -- accel/accel.sh@21 -- # val= 00:07:24.920 15:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.920 15:53:48 -- accel/accel.sh@21 -- # val= 00:07:24.920 15:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.920 15:53:48 -- accel/accel.sh@21 -- # val= 00:07:24.920 15:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.920 15:53:48 -- accel/accel.sh@21 -- # val= 00:07:24.920 15:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.920 15:53:48 -- accel/accel.sh@21 -- # val= 00:07:24.920 15:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.920 15:53:48 -- accel/accel.sh@21 -- # val= 00:07:24.920 15:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.920 15:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.920 15:53:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:24.920 15:53:48 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:24.920 15:53:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.920 00:07:24.920 real 0m2.796s 00:07:24.920 user 0m2.515s 00:07:24.920 sys 0m0.273s 00:07:24.920 15:53:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.920 15:53:48 -- common/autotest_common.sh@10 -- # set +x 00:07:24.920 ************************************ 00:07:24.920 END TEST accel_xor 00:07:24.920 ************************************ 00:07:24.920 15:53:48 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:24.920 15:53:48 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:24.920 15:53:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.920 15:53:48 -- common/autotest_common.sh@10 -- # set +x 00:07:24.920 ************************************ 00:07:24.920 START TEST accel_xor 00:07:24.920 ************************************ 00:07:24.920 15:53:48 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:24.920 15:53:48 -- accel/accel.sh@16 -- # local accel_opc 00:07:24.920 15:53:48 -- accel/accel.sh@17 -- # local accel_module 00:07:24.920 15:53:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:24.920 15:53:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:24.920 15:53:48 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.920 15:53:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.920 15:53:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.920 15:53:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.920 15:53:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.920 15:53:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.920 15:53:48 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.920 15:53:48 -- accel/accel.sh@42 -- # jq -r . 00:07:24.920 [2024-11-18 15:53:48.197221] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:24.920 [2024-11-18 15:53:48.197302] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1472859 ] 00:07:24.920 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.920 [2024-11-18 15:53:48.260652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.920 [2024-11-18 15:53:48.349929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.293 15:53:49 -- accel/accel.sh@18 -- # out=' 00:07:26.293 SPDK Configuration: 00:07:26.293 Core mask: 0x1 00:07:26.293 00:07:26.293 Accel Perf Configuration: 00:07:26.293 Workload Type: xor 00:07:26.293 Source buffers: 3 00:07:26.293 Transfer size: 4096 bytes 00:07:26.293 Vector count 1 00:07:26.293 Module: software 00:07:26.293 Queue depth: 32 00:07:26.293 Allocate depth: 32 00:07:26.293 # threads/core: 1 00:07:26.293 Run time: 1 seconds 00:07:26.293 Verify: Yes 00:07:26.293 00:07:26.293 Running for 1 seconds... 00:07:26.293 00:07:26.293 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:26.293 ------------------------------------------------------------------------------------ 00:07:26.293 0,0 184608/s 721 MiB/s 0 0 00:07:26.293 ==================================================================================== 00:07:26.293 Total 184608/s 721 MiB/s 0 0' 00:07:26.293 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.293 15:53:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:26.293 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.293 15:53:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:26.293 15:53:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:26.293 15:53:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.293 15:53:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.293 15:53:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.293 15:53:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.293 15:53:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.293 15:53:49 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.293 15:53:49 -- accel/accel.sh@42 -- # jq -r . 00:07:26.293 [2024-11-18 15:53:49.597197] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:26.293 [2024-11-18 15:53:49.597291] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1473004 ] 00:07:26.293 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.293 [2024-11-18 15:53:49.656556] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.293 [2024-11-18 15:53:49.746597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.293 15:53:49 -- accel/accel.sh@21 -- # val= 00:07:26.293 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.293 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.293 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.293 15:53:49 -- accel/accel.sh@21 -- # val= 00:07:26.293 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.293 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.293 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.293 15:53:49 -- accel/accel.sh@21 -- # val=0x1 00:07:26.293 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.293 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.293 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.293 15:53:49 -- accel/accel.sh@21 -- # val= 00:07:26.293 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.293 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.293 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.293 15:53:49 -- accel/accel.sh@21 -- # val= 00:07:26.293 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.293 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val=xor 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val=3 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val= 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val=software 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@23 -- # accel_module=software 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val=32 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val=32 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val=1 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val=Yes 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val= 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:26.294 15:53:49 -- accel/accel.sh@21 -- # val= 00:07:26.294 15:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:26.294 15:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:27.666 15:53:50 -- accel/accel.sh@21 -- # val= 00:07:27.666 15:53:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # IFS=: 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # read -r var val 00:07:27.666 15:53:50 -- accel/accel.sh@21 -- # val= 00:07:27.666 15:53:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # IFS=: 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # read -r var val 00:07:27.666 15:53:50 -- accel/accel.sh@21 -- # val= 00:07:27.666 15:53:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # IFS=: 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # read -r var val 00:07:27.666 15:53:50 -- accel/accel.sh@21 -- # val= 00:07:27.666 15:53:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # IFS=: 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # read -r var val 00:07:27.666 15:53:50 -- accel/accel.sh@21 -- # val= 00:07:27.666 15:53:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # IFS=: 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # read -r var val 00:07:27.666 15:53:50 -- accel/accel.sh@21 -- # val= 00:07:27.666 15:53:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # IFS=: 00:07:27.666 15:53:50 -- accel/accel.sh@20 -- # read -r var val 00:07:27.666 15:53:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:27.666 15:53:50 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:27.666 15:53:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:27.666 00:07:27.666 real 0m2.801s 00:07:27.666 user 0m2.492s 00:07:27.666 sys 0m0.302s 00:07:27.666 15:53:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.666 15:53:50 -- common/autotest_common.sh@10 -- # set +x 00:07:27.666 ************************************ 00:07:27.666 END TEST accel_xor 00:07:27.666 ************************************ 00:07:27.666 15:53:50 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:27.666 15:53:50 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:27.666 15:53:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.666 15:53:50 -- common/autotest_common.sh@10 -- # set +x 00:07:27.666 ************************************ 00:07:27.666 START TEST accel_dif_verify 00:07:27.666 ************************************ 00:07:27.666 15:53:51 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:27.666 15:53:51 -- accel/accel.sh@16 -- # local accel_opc 00:07:27.666 15:53:51 -- accel/accel.sh@17 -- # local accel_module 00:07:27.666 15:53:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:27.666 15:53:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:27.666 15:53:51 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.666 15:53:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:27.666 15:53:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.666 15:53:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.666 15:53:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:27.666 15:53:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:27.666 15:53:51 -- accel/accel.sh@41 -- # local IFS=, 00:07:27.667 15:53:51 -- accel/accel.sh@42 -- # jq -r . 00:07:27.667 [2024-11-18 15:53:51.019505] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:27.667 [2024-11-18 15:53:51.019589] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1473208 ] 00:07:27.667 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.667 [2024-11-18 15:53:51.082744] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.667 [2024-11-18 15:53:51.173235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.040 15:53:52 -- accel/accel.sh@18 -- # out=' 00:07:29.040 SPDK Configuration: 00:07:29.040 Core mask: 0x1 00:07:29.040 00:07:29.040 Accel Perf Configuration: 00:07:29.040 Workload Type: dif_verify 00:07:29.040 Vector size: 4096 bytes 00:07:29.040 Transfer size: 4096 bytes 00:07:29.040 Block size: 512 bytes 00:07:29.040 Metadata size: 8 bytes 00:07:29.040 Vector count 1 00:07:29.040 Module: software 00:07:29.040 Queue depth: 32 00:07:29.040 Allocate depth: 32 00:07:29.040 # threads/core: 1 00:07:29.040 Run time: 1 seconds 00:07:29.040 Verify: No 00:07:29.040 00:07:29.040 Running for 1 seconds... 00:07:29.040 00:07:29.040 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:29.040 ------------------------------------------------------------------------------------ 00:07:29.040 0,0 82016/s 325 MiB/s 0 0 00:07:29.040 ==================================================================================== 00:07:29.040 Total 82016/s 320 MiB/s 0 0' 00:07:29.040 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.040 15:53:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:29.040 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.040 15:53:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:29.040 15:53:52 -- accel/accel.sh@12 -- # build_accel_config 00:07:29.040 15:53:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:29.040 15:53:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:29.040 15:53:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:29.040 15:53:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:29.040 15:53:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:29.040 15:53:52 -- accel/accel.sh@41 -- # local IFS=, 00:07:29.040 15:53:52 -- accel/accel.sh@42 -- # jq -r . 00:07:29.040 [2024-11-18 15:53:52.424704] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:29.040 [2024-11-18 15:53:52.424786] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1473416 ] 00:07:29.040 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.040 [2024-11-18 15:53:52.487802] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:29.040 [2024-11-18 15:53:52.578026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val= 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val= 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val=0x1 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val= 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val= 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val=dif_verify 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val= 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val=software 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@23 -- # accel_module=software 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val=32 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val=32 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val=1 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val=No 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val= 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.299 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:29.299 15:53:52 -- accel/accel.sh@21 -- # val= 00:07:29.299 15:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.300 15:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:29.300 15:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:30.233 15:53:53 -- accel/accel.sh@21 -- # val= 00:07:30.233 15:53:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # IFS=: 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # read -r var val 00:07:30.233 15:53:53 -- accel/accel.sh@21 -- # val= 00:07:30.233 15:53:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # IFS=: 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # read -r var val 00:07:30.233 15:53:53 -- accel/accel.sh@21 -- # val= 00:07:30.233 15:53:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # IFS=: 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # read -r var val 00:07:30.233 15:53:53 -- accel/accel.sh@21 -- # val= 00:07:30.233 15:53:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # IFS=: 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # read -r var val 00:07:30.233 15:53:53 -- accel/accel.sh@21 -- # val= 00:07:30.233 15:53:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # IFS=: 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # read -r var val 00:07:30.233 15:53:53 -- accel/accel.sh@21 -- # val= 00:07:30.233 15:53:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # IFS=: 00:07:30.233 15:53:53 -- accel/accel.sh@20 -- # read -r var val 00:07:30.233 15:53:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:30.233 15:53:53 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:30.233 15:53:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:30.233 00:07:30.233 real 0m2.802s 00:07:30.233 user 0m2.507s 00:07:30.233 sys 0m0.289s 00:07:30.233 15:53:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.233 15:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:30.233 ************************************ 00:07:30.233 END TEST accel_dif_verify 00:07:30.233 ************************************ 00:07:30.233 15:53:53 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:30.491 15:53:53 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:30.491 15:53:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.491 15:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:30.491 ************************************ 00:07:30.491 START TEST accel_dif_generate 00:07:30.491 ************************************ 00:07:30.491 15:53:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:30.491 15:53:53 -- accel/accel.sh@16 -- # local accel_opc 00:07:30.491 15:53:53 -- accel/accel.sh@17 -- # local accel_module 00:07:30.491 15:53:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:30.492 15:53:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:30.492 15:53:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:30.492 15:53:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:30.492 15:53:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:30.492 15:53:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:30.492 15:53:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:30.492 15:53:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:30.492 15:53:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:30.492 15:53:53 -- accel/accel.sh@42 -- # jq -r . 00:07:30.492 [2024-11-18 15:53:53.844433] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:30.492 [2024-11-18 15:53:53.844512] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1473585 ] 00:07:30.492 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.492 [2024-11-18 15:53:53.905018] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:30.492 [2024-11-18 15:53:53.993414] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.865 15:53:55 -- accel/accel.sh@18 -- # out=' 00:07:31.865 SPDK Configuration: 00:07:31.865 Core mask: 0x1 00:07:31.865 00:07:31.865 Accel Perf Configuration: 00:07:31.865 Workload Type: dif_generate 00:07:31.865 Vector size: 4096 bytes 00:07:31.865 Transfer size: 4096 bytes 00:07:31.865 Block size: 512 bytes 00:07:31.865 Metadata size: 8 bytes 00:07:31.865 Vector count 1 00:07:31.865 Module: software 00:07:31.865 Queue depth: 32 00:07:31.865 Allocate depth: 32 00:07:31.865 # threads/core: 1 00:07:31.865 Run time: 1 seconds 00:07:31.865 Verify: No 00:07:31.865 00:07:31.865 Running for 1 seconds... 00:07:31.865 00:07:31.865 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:31.865 ------------------------------------------------------------------------------------ 00:07:31.865 0,0 97888/s 388 MiB/s 0 0 00:07:31.865 ==================================================================================== 00:07:31.865 Total 97888/s 382 MiB/s 0 0' 00:07:31.865 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:31.865 15:53:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:31.865 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:31.865 15:53:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:31.865 15:53:55 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.865 15:53:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.865 15:53:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.865 15:53:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.865 15:53:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.865 15:53:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.865 15:53:55 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.865 15:53:55 -- accel/accel.sh@42 -- # jq -r . 00:07:31.865 [2024-11-18 15:53:55.244007] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:31.865 [2024-11-18 15:53:55.244100] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1473725 ] 00:07:31.865 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.865 [2024-11-18 15:53:55.307232] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.865 [2024-11-18 15:53:55.397732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val= 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val= 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val=0x1 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val= 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val= 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val=dif_generate 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val= 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val=software 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@23 -- # accel_module=software 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val=32 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val=32 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.122 15:53:55 -- accel/accel.sh@21 -- # val=1 00:07:32.122 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.122 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.123 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.123 15:53:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:32.123 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.123 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.123 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.123 15:53:55 -- accel/accel.sh@21 -- # val=No 00:07:32.123 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.123 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.123 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.123 15:53:55 -- accel/accel.sh@21 -- # val= 00:07:32.123 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.123 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.123 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:32.123 15:53:55 -- accel/accel.sh@21 -- # val= 00:07:32.123 15:53:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.123 15:53:55 -- accel/accel.sh@20 -- # IFS=: 00:07:32.123 15:53:55 -- accel/accel.sh@20 -- # read -r var val 00:07:33.056 15:53:56 -- accel/accel.sh@21 -- # val= 00:07:33.056 15:53:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # IFS=: 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # read -r var val 00:07:33.056 15:53:56 -- accel/accel.sh@21 -- # val= 00:07:33.056 15:53:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # IFS=: 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # read -r var val 00:07:33.056 15:53:56 -- accel/accel.sh@21 -- # val= 00:07:33.056 15:53:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # IFS=: 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # read -r var val 00:07:33.056 15:53:56 -- accel/accel.sh@21 -- # val= 00:07:33.056 15:53:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # IFS=: 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # read -r var val 00:07:33.056 15:53:56 -- accel/accel.sh@21 -- # val= 00:07:33.056 15:53:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # IFS=: 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # read -r var val 00:07:33.056 15:53:56 -- accel/accel.sh@21 -- # val= 00:07:33.056 15:53:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # IFS=: 00:07:33.056 15:53:56 -- accel/accel.sh@20 -- # read -r var val 00:07:33.056 15:53:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:33.056 15:53:56 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:33.056 15:53:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:33.056 00:07:33.056 real 0m2.809s 00:07:33.056 user 0m2.520s 00:07:33.056 sys 0m0.285s 00:07:33.056 15:53:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:33.056 15:53:56 -- common/autotest_common.sh@10 -- # set +x 00:07:33.056 ************************************ 00:07:33.056 END TEST accel_dif_generate 00:07:33.056 ************************************ 00:07:33.314 15:53:56 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:33.314 15:53:56 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:33.314 15:53:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.314 15:53:56 -- common/autotest_common.sh@10 -- # set +x 00:07:33.314 ************************************ 00:07:33.314 START TEST accel_dif_generate_copy 00:07:33.314 ************************************ 00:07:33.314 15:53:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:33.314 15:53:56 -- accel/accel.sh@16 -- # local accel_opc 00:07:33.314 15:53:56 -- accel/accel.sh@17 -- # local accel_module 00:07:33.314 15:53:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:33.314 15:53:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:33.314 15:53:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:33.314 15:53:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:33.314 15:53:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.314 15:53:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.314 15:53:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:33.314 15:53:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:33.314 15:53:56 -- accel/accel.sh@41 -- # local IFS=, 00:07:33.314 15:53:56 -- accel/accel.sh@42 -- # jq -r . 00:07:33.314 [2024-11-18 15:53:56.676743] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:33.314 [2024-11-18 15:53:56.676821] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1473906 ] 00:07:33.314 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.314 [2024-11-18 15:53:56.738475] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.314 [2024-11-18 15:53:56.828011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.687 15:53:58 -- accel/accel.sh@18 -- # out=' 00:07:34.687 SPDK Configuration: 00:07:34.687 Core mask: 0x1 00:07:34.687 00:07:34.687 Accel Perf Configuration: 00:07:34.687 Workload Type: dif_generate_copy 00:07:34.687 Vector size: 4096 bytes 00:07:34.687 Transfer size: 4096 bytes 00:07:34.687 Vector count 1 00:07:34.687 Module: software 00:07:34.687 Queue depth: 32 00:07:34.687 Allocate depth: 32 00:07:34.687 # threads/core: 1 00:07:34.687 Run time: 1 seconds 00:07:34.687 Verify: No 00:07:34.687 00:07:34.687 Running for 1 seconds... 00:07:34.687 00:07:34.687 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:34.687 ------------------------------------------------------------------------------------ 00:07:34.687 0,0 78304/s 310 MiB/s 0 0 00:07:34.687 ==================================================================================== 00:07:34.687 Total 78304/s 305 MiB/s 0 0' 00:07:34.687 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.687 15:53:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:34.687 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.687 15:53:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:34.687 15:53:58 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.687 15:53:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:34.687 15:53:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.687 15:53:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.687 15:53:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:34.687 15:53:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:34.688 15:53:58 -- accel/accel.sh@41 -- # local IFS=, 00:07:34.688 15:53:58 -- accel/accel.sh@42 -- # jq -r . 00:07:34.688 [2024-11-18 15:53:58.081111] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:34.688 [2024-11-18 15:53:58.081205] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1474143 ] 00:07:34.688 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.688 [2024-11-18 15:53:58.143338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.688 [2024-11-18 15:53:58.233206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.945 15:53:58 -- accel/accel.sh@21 -- # val= 00:07:34.945 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.945 15:53:58 -- accel/accel.sh@21 -- # val= 00:07:34.945 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.945 15:53:58 -- accel/accel.sh@21 -- # val=0x1 00:07:34.945 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.945 15:53:58 -- accel/accel.sh@21 -- # val= 00:07:34.945 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.945 15:53:58 -- accel/accel.sh@21 -- # val= 00:07:34.945 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.945 15:53:58 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:34.945 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.945 15:53:58 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.945 15:53:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:34.945 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.945 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.945 15:53:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:34.945 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.946 15:53:58 -- accel/accel.sh@21 -- # val= 00:07:34.946 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.946 15:53:58 -- accel/accel.sh@21 -- # val=software 00:07:34.946 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.946 15:53:58 -- accel/accel.sh@23 -- # accel_module=software 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.946 15:53:58 -- accel/accel.sh@21 -- # val=32 00:07:34.946 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.946 15:53:58 -- accel/accel.sh@21 -- # val=32 00:07:34.946 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.946 15:53:58 -- accel/accel.sh@21 -- # val=1 00:07:34.946 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.946 15:53:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:34.946 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.946 15:53:58 -- accel/accel.sh@21 -- # val=No 00:07:34.946 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.946 15:53:58 -- accel/accel.sh@21 -- # val= 00:07:34.946 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.946 15:53:58 -- accel/accel.sh@21 -- # val= 00:07:34.946 15:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.946 15:53:58 -- accel/accel.sh@20 -- # read -r var val 00:07:35.877 15:53:59 -- accel/accel.sh@21 -- # val= 00:07:35.877 15:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.877 15:53:59 -- accel/accel.sh@20 -- # IFS=: 00:07:35.877 15:53:59 -- accel/accel.sh@20 -- # read -r var val 00:07:35.877 15:53:59 -- accel/accel.sh@21 -- # val= 00:07:35.877 15:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.877 15:53:59 -- accel/accel.sh@20 -- # IFS=: 00:07:36.135 15:53:59 -- accel/accel.sh@20 -- # read -r var val 00:07:36.135 15:53:59 -- accel/accel.sh@21 -- # val= 00:07:36.135 15:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.135 15:53:59 -- accel/accel.sh@20 -- # IFS=: 00:07:36.135 15:53:59 -- accel/accel.sh@20 -- # read -r var val 00:07:36.135 15:53:59 -- accel/accel.sh@21 -- # val= 00:07:36.135 15:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.135 15:53:59 -- accel/accel.sh@20 -- # IFS=: 00:07:36.135 15:53:59 -- accel/accel.sh@20 -- # read -r var val 00:07:36.135 15:53:59 -- accel/accel.sh@21 -- # val= 00:07:36.135 15:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.135 15:53:59 -- accel/accel.sh@20 -- # IFS=: 00:07:36.135 15:53:59 -- accel/accel.sh@20 -- # read -r var val 00:07:36.135 15:53:59 -- accel/accel.sh@21 -- # val= 00:07:36.135 15:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.135 15:53:59 -- accel/accel.sh@20 -- # IFS=: 00:07:36.135 15:53:59 -- accel/accel.sh@20 -- # read -r var val 00:07:36.135 15:53:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:36.135 15:53:59 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:36.135 15:53:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:36.135 00:07:36.135 real 0m2.812s 00:07:36.135 user 0m2.512s 00:07:36.135 sys 0m0.291s 00:07:36.135 15:53:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:36.135 15:53:59 -- common/autotest_common.sh@10 -- # set +x 00:07:36.135 ************************************ 00:07:36.135 END TEST accel_dif_generate_copy 00:07:36.135 ************************************ 00:07:36.135 15:53:59 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:36.135 15:53:59 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:36.135 15:53:59 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:36.135 15:53:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.135 15:53:59 -- common/autotest_common.sh@10 -- # set +x 00:07:36.135 ************************************ 00:07:36.135 START TEST accel_comp 00:07:36.135 ************************************ 00:07:36.135 15:53:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:36.135 15:53:59 -- accel/accel.sh@16 -- # local accel_opc 00:07:36.135 15:53:59 -- accel/accel.sh@17 -- # local accel_module 00:07:36.135 15:53:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:36.135 15:53:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:36.135 15:53:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.135 15:53:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:36.135 15:53:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.135 15:53:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.135 15:53:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:36.135 15:53:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:36.135 15:53:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:36.135 15:53:59 -- accel/accel.sh@42 -- # jq -r . 00:07:36.135 [2024-11-18 15:53:59.511365] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:36.135 [2024-11-18 15:53:59.511451] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1474300 ] 00:07:36.135 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.135 [2024-11-18 15:53:59.574517] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:36.135 [2024-11-18 15:53:59.669835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.510 15:54:00 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:37.510 00:07:37.510 SPDK Configuration: 00:07:37.510 Core mask: 0x1 00:07:37.510 00:07:37.510 Accel Perf Configuration: 00:07:37.510 Workload Type: compress 00:07:37.510 Transfer size: 4096 bytes 00:07:37.510 Vector count 1 00:07:37.510 Module: software 00:07:37.510 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.510 Queue depth: 32 00:07:37.510 Allocate depth: 32 00:07:37.510 # threads/core: 1 00:07:37.510 Run time: 1 seconds 00:07:37.510 Verify: No 00:07:37.510 00:07:37.510 Running for 1 seconds... 00:07:37.510 00:07:37.510 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:37.510 ------------------------------------------------------------------------------------ 00:07:37.510 0,0 31488/s 131 MiB/s 0 0 00:07:37.510 ==================================================================================== 00:07:37.510 Total 31488/s 123 MiB/s 0 0' 00:07:37.510 15:54:00 -- accel/accel.sh@20 -- # IFS=: 00:07:37.510 15:54:00 -- accel/accel.sh@20 -- # read -r var val 00:07:37.510 15:54:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.510 15:54:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.510 15:54:00 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.510 15:54:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:37.510 15:54:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.510 15:54:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.510 15:54:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:37.510 15:54:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:37.510 15:54:00 -- accel/accel.sh@41 -- # local IFS=, 00:07:37.510 15:54:00 -- accel/accel.sh@42 -- # jq -r . 00:07:37.510 [2024-11-18 15:54:00.910976] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:37.510 [2024-11-18 15:54:00.911064] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1474507 ] 00:07:37.510 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.510 [2024-11-18 15:54:00.972078] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:37.510 [2024-11-18 15:54:01.060098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val= 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val= 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val= 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val=0x1 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val= 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val= 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val=compress 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val= 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val=software 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@23 -- # accel_module=software 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val=32 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val=32 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val=1 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val=No 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val= 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.769 15:54:01 -- accel/accel.sh@21 -- # val= 00:07:37.769 15:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.769 15:54:01 -- accel/accel.sh@20 -- # read -r var val 00:07:38.703 15:54:02 -- accel/accel.sh@21 -- # val= 00:07:38.962 15:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # IFS=: 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # read -r var val 00:07:38.962 15:54:02 -- accel/accel.sh@21 -- # val= 00:07:38.962 15:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # IFS=: 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # read -r var val 00:07:38.962 15:54:02 -- accel/accel.sh@21 -- # val= 00:07:38.962 15:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # IFS=: 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # read -r var val 00:07:38.962 15:54:02 -- accel/accel.sh@21 -- # val= 00:07:38.962 15:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # IFS=: 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # read -r var val 00:07:38.962 15:54:02 -- accel/accel.sh@21 -- # val= 00:07:38.962 15:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # IFS=: 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # read -r var val 00:07:38.962 15:54:02 -- accel/accel.sh@21 -- # val= 00:07:38.962 15:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # IFS=: 00:07:38.962 15:54:02 -- accel/accel.sh@20 -- # read -r var val 00:07:38.962 15:54:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:38.962 15:54:02 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:38.962 15:54:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:38.962 00:07:38.962 real 0m2.803s 00:07:38.962 user 0m2.510s 00:07:38.962 sys 0m0.284s 00:07:38.962 15:54:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:38.962 15:54:02 -- common/autotest_common.sh@10 -- # set +x 00:07:38.962 ************************************ 00:07:38.962 END TEST accel_comp 00:07:38.962 ************************************ 00:07:38.962 15:54:02 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:38.962 15:54:02 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:38.962 15:54:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:38.962 15:54:02 -- common/autotest_common.sh@10 -- # set +x 00:07:38.962 ************************************ 00:07:38.962 START TEST accel_decomp 00:07:38.962 ************************************ 00:07:38.962 15:54:02 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:38.962 15:54:02 -- accel/accel.sh@16 -- # local accel_opc 00:07:38.962 15:54:02 -- accel/accel.sh@17 -- # local accel_module 00:07:38.962 15:54:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:38.962 15:54:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:38.962 15:54:02 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.962 15:54:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.962 15:54:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.962 15:54:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.962 15:54:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.962 15:54:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.962 15:54:02 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.962 15:54:02 -- accel/accel.sh@42 -- # jq -r . 00:07:38.962 [2024-11-18 15:54:02.340051] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:38.962 [2024-11-18 15:54:02.340145] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1474746 ] 00:07:38.962 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.962 [2024-11-18 15:54:02.403683] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:38.962 [2024-11-18 15:54:02.494632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.337 15:54:03 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:40.337 00:07:40.337 SPDK Configuration: 00:07:40.337 Core mask: 0x1 00:07:40.337 00:07:40.337 Accel Perf Configuration: 00:07:40.337 Workload Type: decompress 00:07:40.337 Transfer size: 4096 bytes 00:07:40.337 Vector count 1 00:07:40.337 Module: software 00:07:40.337 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.337 Queue depth: 32 00:07:40.337 Allocate depth: 32 00:07:40.337 # threads/core: 1 00:07:40.337 Run time: 1 seconds 00:07:40.337 Verify: Yes 00:07:40.337 00:07:40.337 Running for 1 seconds... 00:07:40.337 00:07:40.337 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:40.337 ------------------------------------------------------------------------------------ 00:07:40.337 0,0 55456/s 102 MiB/s 0 0 00:07:40.337 ==================================================================================== 00:07:40.337 Total 55456/s 216 MiB/s 0 0' 00:07:40.337 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.337 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.337 15:54:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:40.337 15:54:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:40.337 15:54:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.337 15:54:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:40.337 15:54:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.337 15:54:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.337 15:54:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:40.337 15:54:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:40.337 15:54:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:40.337 15:54:03 -- accel/accel.sh@42 -- # jq -r . 00:07:40.337 [2024-11-18 15:54:03.758759] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:40.337 [2024-11-18 15:54:03.758847] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1474983 ] 00:07:40.337 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.337 [2024-11-18 15:54:03.821402] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:40.337 [2024-11-18 15:54:03.913201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val= 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val= 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val= 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val=0x1 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val= 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val= 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val=decompress 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val= 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val=software 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@23 -- # accel_module=software 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val=32 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val=32 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val=1 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val=Yes 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val= 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.596 15:54:03 -- accel/accel.sh@21 -- # val= 00:07:40.596 15:54:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # IFS=: 00:07:40.596 15:54:03 -- accel/accel.sh@20 -- # read -r var val 00:07:41.971 15:54:05 -- accel/accel.sh@21 -- # val= 00:07:41.971 15:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # IFS=: 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # read -r var val 00:07:41.971 15:54:05 -- accel/accel.sh@21 -- # val= 00:07:41.971 15:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # IFS=: 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # read -r var val 00:07:41.971 15:54:05 -- accel/accel.sh@21 -- # val= 00:07:41.971 15:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # IFS=: 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # read -r var val 00:07:41.971 15:54:05 -- accel/accel.sh@21 -- # val= 00:07:41.971 15:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # IFS=: 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # read -r var val 00:07:41.971 15:54:05 -- accel/accel.sh@21 -- # val= 00:07:41.971 15:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # IFS=: 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # read -r var val 00:07:41.971 15:54:05 -- accel/accel.sh@21 -- # val= 00:07:41.971 15:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # IFS=: 00:07:41.971 15:54:05 -- accel/accel.sh@20 -- # read -r var val 00:07:41.971 15:54:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:41.971 15:54:05 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:41.971 15:54:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:41.971 00:07:41.971 real 0m2.832s 00:07:41.971 user 0m2.513s 00:07:41.971 sys 0m0.309s 00:07:41.971 15:54:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.971 15:54:05 -- common/autotest_common.sh@10 -- # set +x 00:07:41.971 ************************************ 00:07:41.971 END TEST accel_decomp 00:07:41.971 ************************************ 00:07:41.971 15:54:05 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:41.971 15:54:05 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:41.971 15:54:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.971 15:54:05 -- common/autotest_common.sh@10 -- # set +x 00:07:41.971 ************************************ 00:07:41.971 START TEST accel_decmop_full 00:07:41.971 ************************************ 00:07:41.971 15:54:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:41.971 15:54:05 -- accel/accel.sh@16 -- # local accel_opc 00:07:41.971 15:54:05 -- accel/accel.sh@17 -- # local accel_module 00:07:41.971 15:54:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:41.971 15:54:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:41.971 15:54:05 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.971 15:54:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.971 15:54:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.971 15:54:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.971 15:54:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.971 15:54:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.971 15:54:05 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.971 15:54:05 -- accel/accel.sh@42 -- # jq -r . 00:07:41.971 [2024-11-18 15:54:05.198180] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:41.971 [2024-11-18 15:54:05.198263] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475136 ] 00:07:41.971 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.971 [2024-11-18 15:54:05.261934] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.971 [2024-11-18 15:54:05.349742] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.410 15:54:06 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:43.410 00:07:43.410 SPDK Configuration: 00:07:43.410 Core mask: 0x1 00:07:43.410 00:07:43.410 Accel Perf Configuration: 00:07:43.410 Workload Type: decompress 00:07:43.410 Transfer size: 111250 bytes 00:07:43.410 Vector count 1 00:07:43.410 Module: software 00:07:43.410 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.410 Queue depth: 32 00:07:43.410 Allocate depth: 32 00:07:43.410 # threads/core: 1 00:07:43.410 Run time: 1 seconds 00:07:43.410 Verify: Yes 00:07:43.410 00:07:43.410 Running for 1 seconds... 00:07:43.410 00:07:43.410 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:43.410 ------------------------------------------------------------------------------------ 00:07:43.410 0,0 3808/s 157 MiB/s 0 0 00:07:43.410 ==================================================================================== 00:07:43.410 Total 3808/s 404 MiB/s 0 0' 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:43.410 15:54:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.410 15:54:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:43.410 15:54:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.410 15:54:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.410 15:54:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:43.410 15:54:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:43.410 15:54:06 -- accel/accel.sh@41 -- # local IFS=, 00:07:43.410 15:54:06 -- accel/accel.sh@42 -- # jq -r . 00:07:43.410 [2024-11-18 15:54:06.608346] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:43.410 [2024-11-18 15:54:06.608444] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475285 ] 00:07:43.410 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.410 [2024-11-18 15:54:06.667074] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:43.410 [2024-11-18 15:54:06.759294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val= 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val= 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val= 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val=0x1 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val= 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val= 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val=decompress 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val= 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val=software 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@23 -- # accel_module=software 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val=32 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val=32 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val=1 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val=Yes 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val= 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:43.410 15:54:06 -- accel/accel.sh@21 -- # val= 00:07:43.410 15:54:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # IFS=: 00:07:43.410 15:54:06 -- accel/accel.sh@20 -- # read -r var val 00:07:44.796 15:54:07 -- accel/accel.sh@21 -- # val= 00:07:44.796 15:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # IFS=: 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # read -r var val 00:07:44.796 15:54:07 -- accel/accel.sh@21 -- # val= 00:07:44.796 15:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # IFS=: 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # read -r var val 00:07:44.796 15:54:07 -- accel/accel.sh@21 -- # val= 00:07:44.796 15:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # IFS=: 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # read -r var val 00:07:44.796 15:54:07 -- accel/accel.sh@21 -- # val= 00:07:44.796 15:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # IFS=: 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # read -r var val 00:07:44.796 15:54:07 -- accel/accel.sh@21 -- # val= 00:07:44.796 15:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # IFS=: 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # read -r var val 00:07:44.796 15:54:07 -- accel/accel.sh@21 -- # val= 00:07:44.796 15:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # IFS=: 00:07:44.796 15:54:07 -- accel/accel.sh@20 -- # read -r var val 00:07:44.796 15:54:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:44.796 15:54:07 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:44.796 15:54:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:44.796 00:07:44.796 real 0m2.821s 00:07:44.796 user 0m2.533s 00:07:44.796 sys 0m0.279s 00:07:44.796 15:54:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:44.796 15:54:08 -- common/autotest_common.sh@10 -- # set +x 00:07:44.796 ************************************ 00:07:44.796 END TEST accel_decmop_full 00:07:44.796 ************************************ 00:07:44.796 15:54:08 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:44.796 15:54:08 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:44.796 15:54:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:44.796 15:54:08 -- common/autotest_common.sh@10 -- # set +x 00:07:44.796 ************************************ 00:07:44.796 START TEST accel_decomp_mcore 00:07:44.796 ************************************ 00:07:44.796 15:54:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:44.796 15:54:08 -- accel/accel.sh@16 -- # local accel_opc 00:07:44.796 15:54:08 -- accel/accel.sh@17 -- # local accel_module 00:07:44.796 15:54:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:44.796 15:54:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:44.796 15:54:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:44.796 15:54:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:44.796 15:54:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:44.796 15:54:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:44.796 15:54:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:44.796 15:54:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:44.796 15:54:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:44.797 15:54:08 -- accel/accel.sh@42 -- # jq -r . 00:07:44.797 [2024-11-18 15:54:08.044356] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:44.797 [2024-11-18 15:54:08.044442] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475812 ] 00:07:44.797 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.797 [2024-11-18 15:54:08.109615] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:44.797 [2024-11-18 15:54:08.203193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:44.797 [2024-11-18 15:54:08.203249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:44.797 [2024-11-18 15:54:08.203369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:44.797 [2024-11-18 15:54:08.203371] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.172 15:54:09 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:46.172 00:07:46.172 SPDK Configuration: 00:07:46.172 Core mask: 0xf 00:07:46.172 00:07:46.172 Accel Perf Configuration: 00:07:46.172 Workload Type: decompress 00:07:46.172 Transfer size: 4096 bytes 00:07:46.172 Vector count 1 00:07:46.172 Module: software 00:07:46.172 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.172 Queue depth: 32 00:07:46.172 Allocate depth: 32 00:07:46.172 # threads/core: 1 00:07:46.172 Run time: 1 seconds 00:07:46.172 Verify: Yes 00:07:46.172 00:07:46.172 Running for 1 seconds... 00:07:46.172 00:07:46.172 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:46.172 ------------------------------------------------------------------------------------ 00:07:46.172 0,0 56608/s 104 MiB/s 0 0 00:07:46.172 3,0 57152/s 105 MiB/s 0 0 00:07:46.172 2,0 57024/s 105 MiB/s 0 0 00:07:46.172 1,0 56864/s 104 MiB/s 0 0 00:07:46.172 ==================================================================================== 00:07:46.172 Total 227648/s 889 MiB/s 0 0' 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 15:54:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.172 15:54:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:46.172 15:54:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:46.172 15:54:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:46.172 15:54:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.172 15:54:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.172 15:54:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:46.172 15:54:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:46.172 15:54:09 -- accel/accel.sh@41 -- # local IFS=, 00:07:46.172 15:54:09 -- accel/accel.sh@42 -- # jq -r . 00:07:46.172 [2024-11-18 15:54:09.439371] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:46.172 [2024-11-18 15:54:09.439455] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1476213 ] 00:07:46.172 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.172 [2024-11-18 15:54:09.500521] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:46.172 [2024-11-18 15:54:09.590862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:46.172 [2024-11-18 15:54:09.590933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:46.172 [2024-11-18 15:54:09.591030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:46.172 [2024-11-18 15:54:09.591033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.172 15:54:09 -- accel/accel.sh@21 -- # val= 00:07:46.172 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.172 15:54:09 -- accel/accel.sh@21 -- # val= 00:07:46.172 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.172 15:54:09 -- accel/accel.sh@21 -- # val= 00:07:46.172 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.172 15:54:09 -- accel/accel.sh@21 -- # val=0xf 00:07:46.172 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.172 15:54:09 -- accel/accel.sh@21 -- # val= 00:07:46.172 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.172 15:54:09 -- accel/accel.sh@21 -- # val= 00:07:46.172 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.172 15:54:09 -- accel/accel.sh@21 -- # val=decompress 00:07:46.172 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.172 15:54:09 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.172 15:54:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:46.172 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.173 15:54:09 -- accel/accel.sh@21 -- # val= 00:07:46.173 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.173 15:54:09 -- accel/accel.sh@21 -- # val=software 00:07:46.173 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.173 15:54:09 -- accel/accel.sh@23 -- # accel_module=software 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.173 15:54:09 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.173 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.173 15:54:09 -- accel/accel.sh@21 -- # val=32 00:07:46.173 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.173 15:54:09 -- accel/accel.sh@21 -- # val=32 00:07:46.173 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.173 15:54:09 -- accel/accel.sh@21 -- # val=1 00:07:46.173 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.173 15:54:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:46.173 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.173 15:54:09 -- accel/accel.sh@21 -- # val=Yes 00:07:46.173 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.173 15:54:09 -- accel/accel.sh@21 -- # val= 00:07:46.173 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.173 15:54:09 -- accel/accel.sh@21 -- # val= 00:07:46.173 15:54:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # IFS=: 00:07:46.173 15:54:09 -- accel/accel.sh@20 -- # read -r var val 00:07:47.546 15:54:10 -- accel/accel.sh@21 -- # val= 00:07:47.546 15:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # IFS=: 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # read -r var val 00:07:47.546 15:54:10 -- accel/accel.sh@21 -- # val= 00:07:47.546 15:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # IFS=: 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # read -r var val 00:07:47.546 15:54:10 -- accel/accel.sh@21 -- # val= 00:07:47.546 15:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # IFS=: 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # read -r var val 00:07:47.546 15:54:10 -- accel/accel.sh@21 -- # val= 00:07:47.546 15:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # IFS=: 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # read -r var val 00:07:47.546 15:54:10 -- accel/accel.sh@21 -- # val= 00:07:47.546 15:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # IFS=: 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # read -r var val 00:07:47.546 15:54:10 -- accel/accel.sh@21 -- # val= 00:07:47.546 15:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # IFS=: 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # read -r var val 00:07:47.546 15:54:10 -- accel/accel.sh@21 -- # val= 00:07:47.546 15:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # IFS=: 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # read -r var val 00:07:47.546 15:54:10 -- accel/accel.sh@21 -- # val= 00:07:47.546 15:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # IFS=: 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # read -r var val 00:07:47.546 15:54:10 -- accel/accel.sh@21 -- # val= 00:07:47.546 15:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # IFS=: 00:07:47.546 15:54:10 -- accel/accel.sh@20 -- # read -r var val 00:07:47.546 15:54:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:47.546 15:54:10 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:47.546 15:54:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:47.546 00:07:47.546 real 0m2.805s 00:07:47.546 user 0m9.355s 00:07:47.546 sys 0m0.293s 00:07:47.546 15:54:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:47.546 15:54:10 -- common/autotest_common.sh@10 -- # set +x 00:07:47.546 ************************************ 00:07:47.546 END TEST accel_decomp_mcore 00:07:47.546 ************************************ 00:07:47.546 15:54:10 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:47.546 15:54:10 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:47.546 15:54:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.546 15:54:10 -- common/autotest_common.sh@10 -- # set +x 00:07:47.546 ************************************ 00:07:47.546 START TEST accel_decomp_full_mcore 00:07:47.546 ************************************ 00:07:47.546 15:54:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:47.546 15:54:10 -- accel/accel.sh@16 -- # local accel_opc 00:07:47.546 15:54:10 -- accel/accel.sh@17 -- # local accel_module 00:07:47.546 15:54:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:47.546 15:54:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:47.546 15:54:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:47.546 15:54:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:47.546 15:54:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:47.546 15:54:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:47.546 15:54:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:47.546 15:54:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:47.546 15:54:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:47.546 15:54:10 -- accel/accel.sh@42 -- # jq -r . 00:07:47.546 [2024-11-18 15:54:10.875419] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:47.546 [2024-11-18 15:54:10.875508] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1476379 ] 00:07:47.546 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.546 [2024-11-18 15:54:10.937546] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:47.546 [2024-11-18 15:54:11.031211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:47.546 [2024-11-18 15:54:11.031278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:47.546 [2024-11-18 15:54:11.031378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:47.546 [2024-11-18 15:54:11.031381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.920 15:54:12 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:48.920 00:07:48.920 SPDK Configuration: 00:07:48.920 Core mask: 0xf 00:07:48.920 00:07:48.920 Accel Perf Configuration: 00:07:48.920 Workload Type: decompress 00:07:48.920 Transfer size: 111250 bytes 00:07:48.920 Vector count 1 00:07:48.920 Module: software 00:07:48.920 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:48.920 Queue depth: 32 00:07:48.920 Allocate depth: 32 00:07:48.920 # threads/core: 1 00:07:48.920 Run time: 1 seconds 00:07:48.920 Verify: Yes 00:07:48.920 00:07:48.920 Running for 1 seconds... 00:07:48.920 00:07:48.920 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:48.920 ------------------------------------------------------------------------------------ 00:07:48.920 0,0 4256/s 175 MiB/s 0 0 00:07:48.920 3,0 4256/s 175 MiB/s 0 0 00:07:48.920 2,0 4256/s 175 MiB/s 0 0 00:07:48.920 1,0 4256/s 175 MiB/s 0 0 00:07:48.920 ==================================================================================== 00:07:48.920 Total 17024/s 1806 MiB/s 0 0' 00:07:48.920 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:48.920 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:48.920 15:54:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:48.920 15:54:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:48.920 15:54:12 -- accel/accel.sh@12 -- # build_accel_config 00:07:48.920 15:54:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:48.920 15:54:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:48.920 15:54:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:48.920 15:54:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:48.920 15:54:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:48.920 15:54:12 -- accel/accel.sh@41 -- # local IFS=, 00:07:48.920 15:54:12 -- accel/accel.sh@42 -- # jq -r . 00:07:48.920 [2024-11-18 15:54:12.304271] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:48.920 [2024-11-18 15:54:12.304354] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1476522 ] 00:07:48.920 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.920 [2024-11-18 15:54:12.368236] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:48.920 [2024-11-18 15:54:12.460042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:48.920 [2024-11-18 15:54:12.460111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:48.920 [2024-11-18 15:54:12.460160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:48.920 [2024-11-18 15:54:12.460162] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val= 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val= 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val= 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val=0xf 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val= 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val= 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val=decompress 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val= 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val=software 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@23 -- # accel_module=software 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val=32 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val=32 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val=1 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val=Yes 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val= 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:49.178 15:54:12 -- accel/accel.sh@21 -- # val= 00:07:49.178 15:54:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # IFS=: 00:07:49.178 15:54:12 -- accel/accel.sh@20 -- # read -r var val 00:07:50.112 15:54:13 -- accel/accel.sh@21 -- # val= 00:07:50.112 15:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # IFS=: 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # read -r var val 00:07:50.112 15:54:13 -- accel/accel.sh@21 -- # val= 00:07:50.112 15:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # IFS=: 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # read -r var val 00:07:50.112 15:54:13 -- accel/accel.sh@21 -- # val= 00:07:50.112 15:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # IFS=: 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # read -r var val 00:07:50.112 15:54:13 -- accel/accel.sh@21 -- # val= 00:07:50.112 15:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # IFS=: 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # read -r var val 00:07:50.112 15:54:13 -- accel/accel.sh@21 -- # val= 00:07:50.112 15:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # IFS=: 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # read -r var val 00:07:50.112 15:54:13 -- accel/accel.sh@21 -- # val= 00:07:50.112 15:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # IFS=: 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # read -r var val 00:07:50.112 15:54:13 -- accel/accel.sh@21 -- # val= 00:07:50.112 15:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # IFS=: 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # read -r var val 00:07:50.112 15:54:13 -- accel/accel.sh@21 -- # val= 00:07:50.112 15:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # IFS=: 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # read -r var val 00:07:50.112 15:54:13 -- accel/accel.sh@21 -- # val= 00:07:50.112 15:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # IFS=: 00:07:50.112 15:54:13 -- accel/accel.sh@20 -- # read -r var val 00:07:50.112 15:54:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:50.112 15:54:13 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:50.112 15:54:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:50.112 00:07:50.112 real 0m2.845s 00:07:50.112 user 0m9.489s 00:07:50.112 sys 0m0.302s 00:07:50.370 15:54:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:50.370 15:54:13 -- common/autotest_common.sh@10 -- # set +x 00:07:50.370 ************************************ 00:07:50.370 END TEST accel_decomp_full_mcore 00:07:50.370 ************************************ 00:07:50.370 15:54:13 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:50.370 15:54:13 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:50.370 15:54:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:50.370 15:54:13 -- common/autotest_common.sh@10 -- # set +x 00:07:50.370 ************************************ 00:07:50.370 START TEST accel_decomp_mthread 00:07:50.370 ************************************ 00:07:50.370 15:54:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:50.370 15:54:13 -- accel/accel.sh@16 -- # local accel_opc 00:07:50.370 15:54:13 -- accel/accel.sh@17 -- # local accel_module 00:07:50.370 15:54:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:50.370 15:54:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:50.370 15:54:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:50.370 15:54:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:50.370 15:54:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:50.370 15:54:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:50.370 15:54:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:50.370 15:54:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:50.370 15:54:13 -- accel/accel.sh@41 -- # local IFS=, 00:07:50.370 15:54:13 -- accel/accel.sh@42 -- # jq -r . 00:07:50.370 [2024-11-18 15:54:13.748707] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:50.370 [2024-11-18 15:54:13.748779] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1476813 ] 00:07:50.370 EAL: No free 2048 kB hugepages reported on node 1 00:07:50.370 [2024-11-18 15:54:13.811434] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:50.370 [2024-11-18 15:54:13.900545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:51.744 15:54:15 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:51.744 00:07:51.744 SPDK Configuration: 00:07:51.744 Core mask: 0x1 00:07:51.744 00:07:51.744 Accel Perf Configuration: 00:07:51.744 Workload Type: decompress 00:07:51.744 Transfer size: 4096 bytes 00:07:51.744 Vector count 1 00:07:51.744 Module: software 00:07:51.744 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:51.744 Queue depth: 32 00:07:51.744 Allocate depth: 32 00:07:51.744 # threads/core: 2 00:07:51.744 Run time: 1 seconds 00:07:51.744 Verify: Yes 00:07:51.744 00:07:51.744 Running for 1 seconds... 00:07:51.744 00:07:51.744 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:51.744 ------------------------------------------------------------------------------------ 00:07:51.744 0,1 28576/s 52 MiB/s 0 0 00:07:51.744 0,0 28448/s 52 MiB/s 0 0 00:07:51.744 ==================================================================================== 00:07:51.744 Total 57024/s 222 MiB/s 0 0' 00:07:51.744 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:51.744 15:54:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:51.744 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:51.744 15:54:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:51.744 15:54:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:51.744 15:54:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:51.744 15:54:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:51.744 15:54:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:51.744 15:54:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:51.744 15:54:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:51.744 15:54:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:51.744 15:54:15 -- accel/accel.sh@42 -- # jq -r . 00:07:51.744 [2024-11-18 15:54:15.160553] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:51.744 [2024-11-18 15:54:15.160671] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1476953 ] 00:07:51.744 EAL: No free 2048 kB hugepages reported on node 1 00:07:51.744 [2024-11-18 15:54:15.223213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:51.745 [2024-11-18 15:54:15.313823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val= 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val= 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val= 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val=0x1 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val= 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val= 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val=decompress 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val= 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val=software 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@23 -- # accel_module=software 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val=32 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val=32 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val=2 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val=Yes 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val= 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:52.003 15:54:15 -- accel/accel.sh@21 -- # val= 00:07:52.003 15:54:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # IFS=: 00:07:52.003 15:54:15 -- accel/accel.sh@20 -- # read -r var val 00:07:53.376 15:54:16 -- accel/accel.sh@21 -- # val= 00:07:53.376 15:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # IFS=: 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # read -r var val 00:07:53.376 15:54:16 -- accel/accel.sh@21 -- # val= 00:07:53.376 15:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # IFS=: 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # read -r var val 00:07:53.376 15:54:16 -- accel/accel.sh@21 -- # val= 00:07:53.376 15:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # IFS=: 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # read -r var val 00:07:53.376 15:54:16 -- accel/accel.sh@21 -- # val= 00:07:53.376 15:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # IFS=: 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # read -r var val 00:07:53.376 15:54:16 -- accel/accel.sh@21 -- # val= 00:07:53.376 15:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # IFS=: 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # read -r var val 00:07:53.376 15:54:16 -- accel/accel.sh@21 -- # val= 00:07:53.376 15:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # IFS=: 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # read -r var val 00:07:53.376 15:54:16 -- accel/accel.sh@21 -- # val= 00:07:53.376 15:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # IFS=: 00:07:53.376 15:54:16 -- accel/accel.sh@20 -- # read -r var val 00:07:53.377 15:54:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:53.377 15:54:16 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:53.377 15:54:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:53.377 00:07:53.377 real 0m2.827s 00:07:53.377 user 0m2.523s 00:07:53.377 sys 0m0.297s 00:07:53.377 15:54:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:53.377 15:54:16 -- common/autotest_common.sh@10 -- # set +x 00:07:53.377 ************************************ 00:07:53.377 END TEST accel_decomp_mthread 00:07:53.377 ************************************ 00:07:53.377 15:54:16 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:53.377 15:54:16 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:53.377 15:54:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:53.377 15:54:16 -- common/autotest_common.sh@10 -- # set +x 00:07:53.377 ************************************ 00:07:53.377 START TEST accel_deomp_full_mthread 00:07:53.377 ************************************ 00:07:53.377 15:54:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:53.377 15:54:16 -- accel/accel.sh@16 -- # local accel_opc 00:07:53.377 15:54:16 -- accel/accel.sh@17 -- # local accel_module 00:07:53.377 15:54:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:53.377 15:54:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:53.377 15:54:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:53.377 15:54:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:53.377 15:54:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:53.377 15:54:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:53.377 15:54:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:53.377 15:54:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:53.377 15:54:16 -- accel/accel.sh@41 -- # local IFS=, 00:07:53.377 15:54:16 -- accel/accel.sh@42 -- # jq -r . 00:07:53.377 [2024-11-18 15:54:16.606758] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:53.377 [2024-11-18 15:54:16.606837] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1477106 ] 00:07:53.377 EAL: No free 2048 kB hugepages reported on node 1 00:07:53.377 [2024-11-18 15:54:16.669969] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:53.377 [2024-11-18 15:54:16.757933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:54.750 15:54:18 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:54.750 00:07:54.750 SPDK Configuration: 00:07:54.750 Core mask: 0x1 00:07:54.750 00:07:54.750 Accel Perf Configuration: 00:07:54.750 Workload Type: decompress 00:07:54.750 Transfer size: 111250 bytes 00:07:54.750 Vector count 1 00:07:54.750 Module: software 00:07:54.750 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:54.750 Queue depth: 32 00:07:54.750 Allocate depth: 32 00:07:54.750 # threads/core: 2 00:07:54.750 Run time: 1 seconds 00:07:54.750 Verify: Yes 00:07:54.750 00:07:54.750 Running for 1 seconds... 00:07:54.750 00:07:54.750 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:54.750 ------------------------------------------------------------------------------------ 00:07:54.750 0,1 1984/s 81 MiB/s 0 0 00:07:54.750 0,0 1952/s 80 MiB/s 0 0 00:07:54.750 ==================================================================================== 00:07:54.750 Total 3936/s 417 MiB/s 0 0' 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:54.750 15:54:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:54.750 15:54:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:54.750 15:54:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:54.750 15:54:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:54.750 15:54:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:54.750 15:54:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:54.750 15:54:18 -- accel/accel.sh@41 -- # local IFS=, 00:07:54.750 15:54:18 -- accel/accel.sh@42 -- # jq -r . 00:07:54.750 [2024-11-18 15:54:18.050173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:54.750 [2024-11-18 15:54:18.050268] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1477258 ] 00:07:54.750 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.750 [2024-11-18 15:54:18.115884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:54.750 [2024-11-18 15:54:18.210878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val= 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val= 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val= 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val=0x1 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val= 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val= 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val=decompress 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val= 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val=software 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@23 -- # accel_module=software 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val=32 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val=32 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val=2 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val=Yes 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val= 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:54.750 15:54:18 -- accel/accel.sh@21 -- # val= 00:07:54.750 15:54:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # IFS=: 00:07:54.750 15:54:18 -- accel/accel.sh@20 -- # read -r var val 00:07:56.123 15:54:19 -- accel/accel.sh@21 -- # val= 00:07:56.123 15:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.123 15:54:19 -- accel/accel.sh@20 -- # IFS=: 00:07:56.123 15:54:19 -- accel/accel.sh@20 -- # read -r var val 00:07:56.123 15:54:19 -- accel/accel.sh@21 -- # val= 00:07:56.123 15:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.123 15:54:19 -- accel/accel.sh@20 -- # IFS=: 00:07:56.123 15:54:19 -- accel/accel.sh@20 -- # read -r var val 00:07:56.123 15:54:19 -- accel/accel.sh@21 -- # val= 00:07:56.123 15:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.123 15:54:19 -- accel/accel.sh@20 -- # IFS=: 00:07:56.123 15:54:19 -- accel/accel.sh@20 -- # read -r var val 00:07:56.123 15:54:19 -- accel/accel.sh@21 -- # val= 00:07:56.124 15:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.124 15:54:19 -- accel/accel.sh@20 -- # IFS=: 00:07:56.124 15:54:19 -- accel/accel.sh@20 -- # read -r var val 00:07:56.124 15:54:19 -- accel/accel.sh@21 -- # val= 00:07:56.124 15:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.124 15:54:19 -- accel/accel.sh@20 -- # IFS=: 00:07:56.124 15:54:19 -- accel/accel.sh@20 -- # read -r var val 00:07:56.124 15:54:19 -- accel/accel.sh@21 -- # val= 00:07:56.124 15:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.124 15:54:19 -- accel/accel.sh@20 -- # IFS=: 00:07:56.124 15:54:19 -- accel/accel.sh@20 -- # read -r var val 00:07:56.124 15:54:19 -- accel/accel.sh@21 -- # val= 00:07:56.124 15:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:56.124 15:54:19 -- accel/accel.sh@20 -- # IFS=: 00:07:56.124 15:54:19 -- accel/accel.sh@20 -- # read -r var val 00:07:56.124 15:54:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:56.124 15:54:19 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:56.124 15:54:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:56.124 00:07:56.124 real 0m2.891s 00:07:56.124 user 0m2.592s 00:07:56.124 sys 0m0.293s 00:07:56.124 15:54:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:56.124 15:54:19 -- common/autotest_common.sh@10 -- # set +x 00:07:56.124 ************************************ 00:07:56.124 END TEST accel_deomp_full_mthread 00:07:56.124 ************************************ 00:07:56.124 15:54:19 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:56.124 15:54:19 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:56.124 15:54:19 -- accel/accel.sh@129 -- # build_accel_config 00:07:56.124 15:54:19 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:56.124 15:54:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:56.124 15:54:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:56.124 15:54:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:56.124 15:54:19 -- common/autotest_common.sh@10 -- # set +x 00:07:56.124 15:54:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:56.124 15:54:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:56.124 15:54:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:56.124 15:54:19 -- accel/accel.sh@41 -- # local IFS=, 00:07:56.124 15:54:19 -- accel/accel.sh@42 -- # jq -r . 00:07:56.124 ************************************ 00:07:56.124 START TEST accel_dif_functional_tests 00:07:56.124 ************************************ 00:07:56.124 15:54:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:56.124 [2024-11-18 15:54:19.543296] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:56.124 [2024-11-18 15:54:19.543368] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1477534 ] 00:07:56.124 EAL: No free 2048 kB hugepages reported on node 1 00:07:56.124 [2024-11-18 15:54:19.606448] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:56.124 [2024-11-18 15:54:19.701353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:56.124 [2024-11-18 15:54:19.701407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:56.124 [2024-11-18 15:54:19.701410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:56.382 00:07:56.382 00:07:56.382 CUnit - A unit testing framework for C - Version 2.1-3 00:07:56.382 http://cunit.sourceforge.net/ 00:07:56.382 00:07:56.382 00:07:56.382 Suite: accel_dif 00:07:56.382 Test: verify: DIF generated, GUARD check ...passed 00:07:56.382 Test: verify: DIF generated, APPTAG check ...passed 00:07:56.382 Test: verify: DIF generated, REFTAG check ...passed 00:07:56.382 Test: verify: DIF not generated, GUARD check ...[2024-11-18 15:54:19.800425] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:56.382 [2024-11-18 15:54:19.800492] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:56.382 passed 00:07:56.382 Test: verify: DIF not generated, APPTAG check ...[2024-11-18 15:54:19.800537] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:56.382 [2024-11-18 15:54:19.800566] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:56.382 passed 00:07:56.382 Test: verify: DIF not generated, REFTAG check ...[2024-11-18 15:54:19.800602] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:56.382 [2024-11-18 15:54:19.800639] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:56.382 passed 00:07:56.382 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:56.382 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-18 15:54:19.800718] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:56.382 passed 00:07:56.382 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:56.382 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:56.382 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:56.382 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-18 15:54:19.800872] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:56.382 passed 00:07:56.382 Test: generate copy: DIF generated, GUARD check ...passed 00:07:56.382 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:56.382 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:56.382 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:56.382 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:56.382 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:56.382 Test: generate copy: iovecs-len validate ...[2024-11-18 15:54:19.801118] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:56.382 passed 00:07:56.382 Test: generate copy: buffer alignment validate ...passed 00:07:56.382 00:07:56.382 Run Summary: Type Total Ran Passed Failed Inactive 00:07:56.382 suites 1 1 n/a 0 0 00:07:56.382 tests 20 20 20 0 0 00:07:56.382 asserts 204 204 204 0 n/a 00:07:56.382 00:07:56.382 Elapsed time = 0.003 seconds 00:07:56.640 00:07:56.640 real 0m0.522s 00:07:56.640 user 0m0.818s 00:07:56.640 sys 0m0.191s 00:07:56.640 15:54:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:56.640 15:54:20 -- common/autotest_common.sh@10 -- # set +x 00:07:56.640 ************************************ 00:07:56.640 END TEST accel_dif_functional_tests 00:07:56.640 ************************************ 00:07:56.640 00:07:56.640 real 0m59.874s 00:07:56.640 user 1m7.556s 00:07:56.640 sys 0m7.286s 00:07:56.640 15:54:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:56.640 15:54:20 -- common/autotest_common.sh@10 -- # set +x 00:07:56.640 ************************************ 00:07:56.640 END TEST accel 00:07:56.640 ************************************ 00:07:56.640 15:54:20 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:56.640 15:54:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:56.640 15:54:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:56.640 15:54:20 -- common/autotest_common.sh@10 -- # set +x 00:07:56.640 ************************************ 00:07:56.641 START TEST accel_rpc 00:07:56.641 ************************************ 00:07:56.641 15:54:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:56.641 * Looking for test storage... 00:07:56.641 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:56.641 15:54:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:56.641 15:54:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:56.641 15:54:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:56.641 15:54:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:56.641 15:54:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:56.641 15:54:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:56.641 15:54:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:56.641 15:54:20 -- scripts/common.sh@335 -- # IFS=.-: 00:07:56.641 15:54:20 -- scripts/common.sh@335 -- # read -ra ver1 00:07:56.641 15:54:20 -- scripts/common.sh@336 -- # IFS=.-: 00:07:56.641 15:54:20 -- scripts/common.sh@336 -- # read -ra ver2 00:07:56.641 15:54:20 -- scripts/common.sh@337 -- # local 'op=<' 00:07:56.641 15:54:20 -- scripts/common.sh@339 -- # ver1_l=2 00:07:56.641 15:54:20 -- scripts/common.sh@340 -- # ver2_l=1 00:07:56.641 15:54:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:56.641 15:54:20 -- scripts/common.sh@343 -- # case "$op" in 00:07:56.641 15:54:20 -- scripts/common.sh@344 -- # : 1 00:07:56.641 15:54:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:56.641 15:54:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:56.641 15:54:20 -- scripts/common.sh@364 -- # decimal 1 00:07:56.641 15:54:20 -- scripts/common.sh@352 -- # local d=1 00:07:56.641 15:54:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:56.641 15:54:20 -- scripts/common.sh@354 -- # echo 1 00:07:56.641 15:54:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:56.641 15:54:20 -- scripts/common.sh@365 -- # decimal 2 00:07:56.641 15:54:20 -- scripts/common.sh@352 -- # local d=2 00:07:56.641 15:54:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:56.641 15:54:20 -- scripts/common.sh@354 -- # echo 2 00:07:56.641 15:54:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:56.641 15:54:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:56.641 15:54:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:56.641 15:54:20 -- scripts/common.sh@367 -- # return 0 00:07:56.641 15:54:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:56.641 15:54:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:56.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:56.641 --rc genhtml_branch_coverage=1 00:07:56.641 --rc genhtml_function_coverage=1 00:07:56.641 --rc genhtml_legend=1 00:07:56.641 --rc geninfo_all_blocks=1 00:07:56.641 --rc geninfo_unexecuted_blocks=1 00:07:56.641 00:07:56.641 ' 00:07:56.641 15:54:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:56.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:56.641 --rc genhtml_branch_coverage=1 00:07:56.641 --rc genhtml_function_coverage=1 00:07:56.641 --rc genhtml_legend=1 00:07:56.641 --rc geninfo_all_blocks=1 00:07:56.641 --rc geninfo_unexecuted_blocks=1 00:07:56.641 00:07:56.641 ' 00:07:56.641 15:54:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:56.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:56.641 --rc genhtml_branch_coverage=1 00:07:56.641 --rc genhtml_function_coverage=1 00:07:56.641 --rc genhtml_legend=1 00:07:56.641 --rc geninfo_all_blocks=1 00:07:56.641 --rc geninfo_unexecuted_blocks=1 00:07:56.641 00:07:56.641 ' 00:07:56.641 15:54:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:56.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:56.641 --rc genhtml_branch_coverage=1 00:07:56.641 --rc genhtml_function_coverage=1 00:07:56.641 --rc genhtml_legend=1 00:07:56.641 --rc geninfo_all_blocks=1 00:07:56.641 --rc geninfo_unexecuted_blocks=1 00:07:56.641 00:07:56.641 ' 00:07:56.641 15:54:20 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:56.641 15:54:20 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1477608 00:07:56.641 15:54:20 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:56.641 15:54:20 -- accel/accel_rpc.sh@15 -- # waitforlisten 1477608 00:07:56.641 15:54:20 -- common/autotest_common.sh@829 -- # '[' -z 1477608 ']' 00:07:56.641 15:54:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:56.641 15:54:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:56.641 15:54:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:56.641 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:56.641 15:54:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:56.641 15:54:20 -- common/autotest_common.sh@10 -- # set +x 00:07:56.898 [2024-11-18 15:54:20.263280] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:56.898 [2024-11-18 15:54:20.263371] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1477608 ] 00:07:56.898 EAL: No free 2048 kB hugepages reported on node 1 00:07:56.898 [2024-11-18 15:54:20.325570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:56.898 [2024-11-18 15:54:20.415444] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:56.898 [2024-11-18 15:54:20.415662] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:56.898 15:54:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:56.898 15:54:20 -- common/autotest_common.sh@862 -- # return 0 00:07:56.898 15:54:20 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:56.898 15:54:20 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:56.898 15:54:20 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:56.898 15:54:20 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:56.898 15:54:20 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:56.898 15:54:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:56.898 15:54:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:56.898 15:54:20 -- common/autotest_common.sh@10 -- # set +x 00:07:56.898 ************************************ 00:07:56.898 START TEST accel_assign_opcode 00:07:57.156 ************************************ 00:07:57.157 15:54:20 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:57.157 15:54:20 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:57.157 15:54:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:57.157 15:54:20 -- common/autotest_common.sh@10 -- # set +x 00:07:57.157 [2024-11-18 15:54:20.492262] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:57.157 15:54:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:57.157 15:54:20 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:57.157 15:54:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:57.157 15:54:20 -- common/autotest_common.sh@10 -- # set +x 00:07:57.157 [2024-11-18 15:54:20.500276] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:57.157 15:54:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:57.157 15:54:20 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:57.157 15:54:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:57.157 15:54:20 -- common/autotest_common.sh@10 -- # set +x 00:07:57.157 15:54:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:57.157 15:54:20 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:57.157 15:54:20 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:57.157 15:54:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:57.157 15:54:20 -- accel/accel_rpc.sh@42 -- # grep software 00:07:57.157 15:54:20 -- common/autotest_common.sh@10 -- # set +x 00:07:57.415 15:54:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:57.415 software 00:07:57.415 00:07:57.415 real 0m0.284s 00:07:57.415 user 0m0.034s 00:07:57.415 sys 0m0.006s 00:07:57.415 15:54:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:57.415 15:54:20 -- common/autotest_common.sh@10 -- # set +x 00:07:57.415 ************************************ 00:07:57.415 END TEST accel_assign_opcode 00:07:57.415 ************************************ 00:07:57.415 15:54:20 -- accel/accel_rpc.sh@55 -- # killprocess 1477608 00:07:57.415 15:54:20 -- common/autotest_common.sh@936 -- # '[' -z 1477608 ']' 00:07:57.415 15:54:20 -- common/autotest_common.sh@940 -- # kill -0 1477608 00:07:57.415 15:54:20 -- common/autotest_common.sh@941 -- # uname 00:07:57.415 15:54:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:57.415 15:54:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1477608 00:07:57.415 15:54:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:57.415 15:54:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:57.415 15:54:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1477608' 00:07:57.415 killing process with pid 1477608 00:07:57.415 15:54:20 -- common/autotest_common.sh@955 -- # kill 1477608 00:07:57.415 15:54:20 -- common/autotest_common.sh@960 -- # wait 1477608 00:07:57.674 00:07:57.674 real 0m1.182s 00:07:57.674 user 0m1.114s 00:07:57.674 sys 0m0.422s 00:07:57.674 15:54:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:57.674 15:54:21 -- common/autotest_common.sh@10 -- # set +x 00:07:57.674 ************************************ 00:07:57.674 END TEST accel_rpc 00:07:57.674 ************************************ 00:07:57.932 15:54:21 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:57.932 15:54:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:57.932 15:54:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:57.932 15:54:21 -- common/autotest_common.sh@10 -- # set +x 00:07:57.932 ************************************ 00:07:57.932 START TEST app_cmdline 00:07:57.932 ************************************ 00:07:57.932 15:54:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:57.932 * Looking for test storage... 00:07:57.932 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:57.932 15:54:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:57.932 15:54:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:57.932 15:54:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:57.932 15:54:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:57.932 15:54:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:57.932 15:54:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:57.932 15:54:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:57.932 15:54:21 -- scripts/common.sh@335 -- # IFS=.-: 00:07:57.932 15:54:21 -- scripts/common.sh@335 -- # read -ra ver1 00:07:57.932 15:54:21 -- scripts/common.sh@336 -- # IFS=.-: 00:07:57.932 15:54:21 -- scripts/common.sh@336 -- # read -ra ver2 00:07:57.932 15:54:21 -- scripts/common.sh@337 -- # local 'op=<' 00:07:57.932 15:54:21 -- scripts/common.sh@339 -- # ver1_l=2 00:07:57.932 15:54:21 -- scripts/common.sh@340 -- # ver2_l=1 00:07:57.932 15:54:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:57.932 15:54:21 -- scripts/common.sh@343 -- # case "$op" in 00:07:57.932 15:54:21 -- scripts/common.sh@344 -- # : 1 00:07:57.932 15:54:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:57.932 15:54:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:57.932 15:54:21 -- scripts/common.sh@364 -- # decimal 1 00:07:57.932 15:54:21 -- scripts/common.sh@352 -- # local d=1 00:07:57.932 15:54:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:57.932 15:54:21 -- scripts/common.sh@354 -- # echo 1 00:07:57.932 15:54:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:57.932 15:54:21 -- scripts/common.sh@365 -- # decimal 2 00:07:57.932 15:54:21 -- scripts/common.sh@352 -- # local d=2 00:07:57.932 15:54:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:57.932 15:54:21 -- scripts/common.sh@354 -- # echo 2 00:07:57.932 15:54:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:57.932 15:54:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:57.932 15:54:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:57.932 15:54:21 -- scripts/common.sh@367 -- # return 0 00:07:57.932 15:54:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:57.932 15:54:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:57.932 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.932 --rc genhtml_branch_coverage=1 00:07:57.932 --rc genhtml_function_coverage=1 00:07:57.932 --rc genhtml_legend=1 00:07:57.932 --rc geninfo_all_blocks=1 00:07:57.932 --rc geninfo_unexecuted_blocks=1 00:07:57.932 00:07:57.932 ' 00:07:57.932 15:54:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:57.932 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.932 --rc genhtml_branch_coverage=1 00:07:57.932 --rc genhtml_function_coverage=1 00:07:57.932 --rc genhtml_legend=1 00:07:57.932 --rc geninfo_all_blocks=1 00:07:57.932 --rc geninfo_unexecuted_blocks=1 00:07:57.932 00:07:57.932 ' 00:07:57.932 15:54:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:57.932 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.932 --rc genhtml_branch_coverage=1 00:07:57.932 --rc genhtml_function_coverage=1 00:07:57.932 --rc genhtml_legend=1 00:07:57.932 --rc geninfo_all_blocks=1 00:07:57.932 --rc geninfo_unexecuted_blocks=1 00:07:57.932 00:07:57.932 ' 00:07:57.932 15:54:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:57.932 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.932 --rc genhtml_branch_coverage=1 00:07:57.932 --rc genhtml_function_coverage=1 00:07:57.932 --rc genhtml_legend=1 00:07:57.932 --rc geninfo_all_blocks=1 00:07:57.932 --rc geninfo_unexecuted_blocks=1 00:07:57.932 00:07:57.932 ' 00:07:57.932 15:54:21 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:57.932 15:54:21 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1477840 00:07:57.932 15:54:21 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:57.932 15:54:21 -- app/cmdline.sh@18 -- # waitforlisten 1477840 00:07:57.932 15:54:21 -- common/autotest_common.sh@829 -- # '[' -z 1477840 ']' 00:07:57.932 15:54:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:57.932 15:54:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:57.932 15:54:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:57.932 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:57.932 15:54:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:57.933 15:54:21 -- common/autotest_common.sh@10 -- # set +x 00:07:57.933 [2024-11-18 15:54:21.483491] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:57.933 [2024-11-18 15:54:21.483574] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1477840 ] 00:07:57.933 EAL: No free 2048 kB hugepages reported on node 1 00:07:58.191 [2024-11-18 15:54:21.543334] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:58.191 [2024-11-18 15:54:21.628287] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:58.191 [2024-11-18 15:54:21.628478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:59.124 15:54:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:59.124 15:54:22 -- common/autotest_common.sh@862 -- # return 0 00:07:59.124 15:54:22 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:59.124 { 00:07:59.124 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:59.124 "fields": { 00:07:59.124 "major": 24, 00:07:59.124 "minor": 1, 00:07:59.124 "patch": 1, 00:07:59.124 "suffix": "-pre", 00:07:59.124 "commit": "c13c99a5e" 00:07:59.124 } 00:07:59.124 } 00:07:59.124 15:54:22 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:59.124 15:54:22 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:59.124 15:54:22 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:59.124 15:54:22 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:59.124 15:54:22 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:59.124 15:54:22 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:59.124 15:54:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.124 15:54:22 -- common/autotest_common.sh@10 -- # set +x 00:07:59.124 15:54:22 -- app/cmdline.sh@26 -- # sort 00:07:59.124 15:54:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.382 15:54:22 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:59.382 15:54:22 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:59.382 15:54:22 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:59.382 15:54:22 -- common/autotest_common.sh@650 -- # local es=0 00:07:59.382 15:54:22 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:59.382 15:54:22 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:59.382 15:54:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:59.382 15:54:22 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:59.382 15:54:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:59.382 15:54:22 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:59.382 15:54:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:59.382 15:54:22 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:59.382 15:54:22 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:59.382 15:54:22 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:59.382 request: 00:07:59.382 { 00:07:59.382 "method": "env_dpdk_get_mem_stats", 00:07:59.382 "req_id": 1 00:07:59.382 } 00:07:59.382 Got JSON-RPC error response 00:07:59.382 response: 00:07:59.382 { 00:07:59.382 "code": -32601, 00:07:59.382 "message": "Method not found" 00:07:59.382 } 00:07:59.641 15:54:22 -- common/autotest_common.sh@653 -- # es=1 00:07:59.641 15:54:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:59.641 15:54:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:59.641 15:54:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:59.641 15:54:22 -- app/cmdline.sh@1 -- # killprocess 1477840 00:07:59.641 15:54:22 -- common/autotest_common.sh@936 -- # '[' -z 1477840 ']' 00:07:59.641 15:54:22 -- common/autotest_common.sh@940 -- # kill -0 1477840 00:07:59.641 15:54:22 -- common/autotest_common.sh@941 -- # uname 00:07:59.641 15:54:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:59.641 15:54:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1477840 00:07:59.641 15:54:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:59.641 15:54:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:59.641 15:54:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1477840' 00:07:59.641 killing process with pid 1477840 00:07:59.641 15:54:23 -- common/autotest_common.sh@955 -- # kill 1477840 00:07:59.641 15:54:23 -- common/autotest_common.sh@960 -- # wait 1477840 00:07:59.900 00:07:59.900 real 0m2.160s 00:07:59.900 user 0m2.686s 00:07:59.900 sys 0m0.532s 00:07:59.900 15:54:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:59.900 15:54:23 -- common/autotest_common.sh@10 -- # set +x 00:07:59.900 ************************************ 00:07:59.900 END TEST app_cmdline 00:07:59.900 ************************************ 00:07:59.900 15:54:23 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:59.900 15:54:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:59.900 15:54:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:59.900 15:54:23 -- common/autotest_common.sh@10 -- # set +x 00:07:59.900 ************************************ 00:07:59.900 START TEST version 00:07:59.900 ************************************ 00:07:59.900 15:54:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:08:00.159 * Looking for test storage... 00:08:00.159 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:00.159 15:54:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:00.159 15:54:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:00.159 15:54:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:00.159 15:54:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:00.159 15:54:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:00.159 15:54:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:00.159 15:54:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:00.159 15:54:23 -- scripts/common.sh@335 -- # IFS=.-: 00:08:00.159 15:54:23 -- scripts/common.sh@335 -- # read -ra ver1 00:08:00.159 15:54:23 -- scripts/common.sh@336 -- # IFS=.-: 00:08:00.159 15:54:23 -- scripts/common.sh@336 -- # read -ra ver2 00:08:00.159 15:54:23 -- scripts/common.sh@337 -- # local 'op=<' 00:08:00.159 15:54:23 -- scripts/common.sh@339 -- # ver1_l=2 00:08:00.159 15:54:23 -- scripts/common.sh@340 -- # ver2_l=1 00:08:00.159 15:54:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:00.159 15:54:23 -- scripts/common.sh@343 -- # case "$op" in 00:08:00.159 15:54:23 -- scripts/common.sh@344 -- # : 1 00:08:00.159 15:54:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:00.159 15:54:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:00.159 15:54:23 -- scripts/common.sh@364 -- # decimal 1 00:08:00.159 15:54:23 -- scripts/common.sh@352 -- # local d=1 00:08:00.159 15:54:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:00.159 15:54:23 -- scripts/common.sh@354 -- # echo 1 00:08:00.159 15:54:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:00.159 15:54:23 -- scripts/common.sh@365 -- # decimal 2 00:08:00.159 15:54:23 -- scripts/common.sh@352 -- # local d=2 00:08:00.159 15:54:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:00.159 15:54:23 -- scripts/common.sh@354 -- # echo 2 00:08:00.159 15:54:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:00.159 15:54:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:00.159 15:54:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:00.159 15:54:23 -- scripts/common.sh@367 -- # return 0 00:08:00.159 15:54:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:00.159 15:54:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:00.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.159 --rc genhtml_branch_coverage=1 00:08:00.159 --rc genhtml_function_coverage=1 00:08:00.159 --rc genhtml_legend=1 00:08:00.159 --rc geninfo_all_blocks=1 00:08:00.159 --rc geninfo_unexecuted_blocks=1 00:08:00.159 00:08:00.159 ' 00:08:00.159 15:54:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:00.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.159 --rc genhtml_branch_coverage=1 00:08:00.159 --rc genhtml_function_coverage=1 00:08:00.159 --rc genhtml_legend=1 00:08:00.159 --rc geninfo_all_blocks=1 00:08:00.159 --rc geninfo_unexecuted_blocks=1 00:08:00.159 00:08:00.159 ' 00:08:00.159 15:54:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:00.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.159 --rc genhtml_branch_coverage=1 00:08:00.159 --rc genhtml_function_coverage=1 00:08:00.159 --rc genhtml_legend=1 00:08:00.159 --rc geninfo_all_blocks=1 00:08:00.159 --rc geninfo_unexecuted_blocks=1 00:08:00.159 00:08:00.159 ' 00:08:00.159 15:54:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:00.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.159 --rc genhtml_branch_coverage=1 00:08:00.159 --rc genhtml_function_coverage=1 00:08:00.159 --rc genhtml_legend=1 00:08:00.159 --rc geninfo_all_blocks=1 00:08:00.159 --rc geninfo_unexecuted_blocks=1 00:08:00.159 00:08:00.159 ' 00:08:00.159 15:54:23 -- app/version.sh@17 -- # get_header_version major 00:08:00.159 15:54:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:00.159 15:54:23 -- app/version.sh@14 -- # cut -f2 00:08:00.159 15:54:23 -- app/version.sh@14 -- # tr -d '"' 00:08:00.159 15:54:23 -- app/version.sh@17 -- # major=24 00:08:00.159 15:54:23 -- app/version.sh@18 -- # get_header_version minor 00:08:00.159 15:54:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:00.159 15:54:23 -- app/version.sh@14 -- # cut -f2 00:08:00.159 15:54:23 -- app/version.sh@14 -- # tr -d '"' 00:08:00.159 15:54:23 -- app/version.sh@18 -- # minor=1 00:08:00.159 15:54:23 -- app/version.sh@19 -- # get_header_version patch 00:08:00.159 15:54:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:00.159 15:54:23 -- app/version.sh@14 -- # cut -f2 00:08:00.159 15:54:23 -- app/version.sh@14 -- # tr -d '"' 00:08:00.159 15:54:23 -- app/version.sh@19 -- # patch=1 00:08:00.159 15:54:23 -- app/version.sh@20 -- # get_header_version suffix 00:08:00.159 15:54:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:08:00.159 15:54:23 -- app/version.sh@14 -- # cut -f2 00:08:00.159 15:54:23 -- app/version.sh@14 -- # tr -d '"' 00:08:00.159 15:54:23 -- app/version.sh@20 -- # suffix=-pre 00:08:00.159 15:54:23 -- app/version.sh@22 -- # version=24.1 00:08:00.159 15:54:23 -- app/version.sh@25 -- # (( patch != 0 )) 00:08:00.159 15:54:23 -- app/version.sh@25 -- # version=24.1.1 00:08:00.159 15:54:23 -- app/version.sh@28 -- # version=24.1.1rc0 00:08:00.159 15:54:23 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:00.159 15:54:23 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:08:00.159 15:54:23 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:08:00.159 15:54:23 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:08:00.159 00:08:00.159 real 0m0.211s 00:08:00.159 user 0m0.143s 00:08:00.159 sys 0m0.093s 00:08:00.159 15:54:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:00.159 15:54:23 -- common/autotest_common.sh@10 -- # set +x 00:08:00.159 ************************************ 00:08:00.159 END TEST version 00:08:00.159 ************************************ 00:08:00.159 15:54:23 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:08:00.159 15:54:23 -- spdk/autotest.sh@191 -- # uname -s 00:08:00.159 15:54:23 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:08:00.159 15:54:23 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:08:00.159 15:54:23 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:08:00.159 15:54:23 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:08:00.159 15:54:23 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:08:00.159 15:54:23 -- spdk/autotest.sh@255 -- # timing_exit lib 00:08:00.159 15:54:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:00.159 15:54:23 -- common/autotest_common.sh@10 -- # set +x 00:08:00.159 15:54:23 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:08:00.159 15:54:23 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:08:00.159 15:54:23 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:08:00.159 15:54:23 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:08:00.159 15:54:23 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:08:00.159 15:54:23 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:08:00.159 15:54:23 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:08:00.160 15:54:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:00.160 15:54:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:00.160 15:54:23 -- common/autotest_common.sh@10 -- # set +x 00:08:00.160 ************************************ 00:08:00.160 START TEST nvmf_tcp 00:08:00.160 ************************************ 00:08:00.160 15:54:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:08:00.418 * Looking for test storage... 00:08:00.418 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:08:00.418 15:54:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:00.418 15:54:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:00.418 15:54:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:00.418 15:54:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:00.418 15:54:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:00.418 15:54:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:00.418 15:54:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:00.418 15:54:23 -- scripts/common.sh@335 -- # IFS=.-: 00:08:00.418 15:54:23 -- scripts/common.sh@335 -- # read -ra ver1 00:08:00.418 15:54:23 -- scripts/common.sh@336 -- # IFS=.-: 00:08:00.418 15:54:23 -- scripts/common.sh@336 -- # read -ra ver2 00:08:00.418 15:54:23 -- scripts/common.sh@337 -- # local 'op=<' 00:08:00.418 15:54:23 -- scripts/common.sh@339 -- # ver1_l=2 00:08:00.418 15:54:23 -- scripts/common.sh@340 -- # ver2_l=1 00:08:00.418 15:54:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:00.418 15:54:23 -- scripts/common.sh@343 -- # case "$op" in 00:08:00.418 15:54:23 -- scripts/common.sh@344 -- # : 1 00:08:00.418 15:54:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:00.418 15:54:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:00.418 15:54:23 -- scripts/common.sh@364 -- # decimal 1 00:08:00.418 15:54:23 -- scripts/common.sh@352 -- # local d=1 00:08:00.418 15:54:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:00.418 15:54:23 -- scripts/common.sh@354 -- # echo 1 00:08:00.418 15:54:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:00.418 15:54:23 -- scripts/common.sh@365 -- # decimal 2 00:08:00.418 15:54:23 -- scripts/common.sh@352 -- # local d=2 00:08:00.418 15:54:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:00.418 15:54:23 -- scripts/common.sh@354 -- # echo 2 00:08:00.418 15:54:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:00.418 15:54:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:00.418 15:54:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:00.418 15:54:23 -- scripts/common.sh@367 -- # return 0 00:08:00.419 15:54:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:00.419 15:54:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:00.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.419 --rc genhtml_branch_coverage=1 00:08:00.419 --rc genhtml_function_coverage=1 00:08:00.419 --rc genhtml_legend=1 00:08:00.419 --rc geninfo_all_blocks=1 00:08:00.419 --rc geninfo_unexecuted_blocks=1 00:08:00.419 00:08:00.419 ' 00:08:00.419 15:54:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:00.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.419 --rc genhtml_branch_coverage=1 00:08:00.419 --rc genhtml_function_coverage=1 00:08:00.419 --rc genhtml_legend=1 00:08:00.419 --rc geninfo_all_blocks=1 00:08:00.419 --rc geninfo_unexecuted_blocks=1 00:08:00.419 00:08:00.419 ' 00:08:00.419 15:54:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:00.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.419 --rc genhtml_branch_coverage=1 00:08:00.419 --rc genhtml_function_coverage=1 00:08:00.419 --rc genhtml_legend=1 00:08:00.419 --rc geninfo_all_blocks=1 00:08:00.419 --rc geninfo_unexecuted_blocks=1 00:08:00.419 00:08:00.419 ' 00:08:00.419 15:54:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:00.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.419 --rc genhtml_branch_coverage=1 00:08:00.419 --rc genhtml_function_coverage=1 00:08:00.419 --rc genhtml_legend=1 00:08:00.419 --rc geninfo_all_blocks=1 00:08:00.419 --rc geninfo_unexecuted_blocks=1 00:08:00.419 00:08:00.419 ' 00:08:00.419 15:54:23 -- nvmf/nvmf.sh@10 -- # uname -s 00:08:00.419 15:54:23 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:08:00.419 15:54:23 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:00.419 15:54:23 -- nvmf/common.sh@7 -- # uname -s 00:08:00.419 15:54:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:00.419 15:54:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:00.419 15:54:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:00.419 15:54:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:00.419 15:54:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:00.419 15:54:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:00.419 15:54:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:00.419 15:54:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:00.419 15:54:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:00.419 15:54:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:00.419 15:54:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:00.419 15:54:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:00.419 15:54:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:00.419 15:54:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:00.419 15:54:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:00.419 15:54:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:00.419 15:54:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:00.419 15:54:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:00.419 15:54:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:00.419 15:54:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.419 15:54:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.419 15:54:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.419 15:54:23 -- paths/export.sh@5 -- # export PATH 00:08:00.419 15:54:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.419 15:54:23 -- nvmf/common.sh@46 -- # : 0 00:08:00.419 15:54:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:00.419 15:54:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:00.419 15:54:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:00.419 15:54:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:00.419 15:54:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:00.419 15:54:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:00.419 15:54:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:00.419 15:54:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:00.419 15:54:23 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:08:00.419 15:54:23 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:08:00.419 15:54:23 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:08:00.419 15:54:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:00.419 15:54:23 -- common/autotest_common.sh@10 -- # set +x 00:08:00.419 15:54:23 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:08:00.419 15:54:23 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:08:00.419 15:54:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:00.419 15:54:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:00.419 15:54:23 -- common/autotest_common.sh@10 -- # set +x 00:08:00.419 ************************************ 00:08:00.419 START TEST nvmf_example 00:08:00.419 ************************************ 00:08:00.419 15:54:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:08:00.419 * Looking for test storage... 00:08:00.419 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:00.419 15:54:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:00.419 15:54:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:00.419 15:54:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:00.678 15:54:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:00.678 15:54:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:00.678 15:54:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:00.678 15:54:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:00.678 15:54:24 -- scripts/common.sh@335 -- # IFS=.-: 00:08:00.678 15:54:24 -- scripts/common.sh@335 -- # read -ra ver1 00:08:00.678 15:54:24 -- scripts/common.sh@336 -- # IFS=.-: 00:08:00.678 15:54:24 -- scripts/common.sh@336 -- # read -ra ver2 00:08:00.678 15:54:24 -- scripts/common.sh@337 -- # local 'op=<' 00:08:00.678 15:54:24 -- scripts/common.sh@339 -- # ver1_l=2 00:08:00.678 15:54:24 -- scripts/common.sh@340 -- # ver2_l=1 00:08:00.678 15:54:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:00.678 15:54:24 -- scripts/common.sh@343 -- # case "$op" in 00:08:00.678 15:54:24 -- scripts/common.sh@344 -- # : 1 00:08:00.678 15:54:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:00.678 15:54:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:00.678 15:54:24 -- scripts/common.sh@364 -- # decimal 1 00:08:00.678 15:54:24 -- scripts/common.sh@352 -- # local d=1 00:08:00.678 15:54:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:00.678 15:54:24 -- scripts/common.sh@354 -- # echo 1 00:08:00.678 15:54:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:00.678 15:54:24 -- scripts/common.sh@365 -- # decimal 2 00:08:00.678 15:54:24 -- scripts/common.sh@352 -- # local d=2 00:08:00.678 15:54:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:00.678 15:54:24 -- scripts/common.sh@354 -- # echo 2 00:08:00.678 15:54:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:00.678 15:54:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:00.678 15:54:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:00.678 15:54:24 -- scripts/common.sh@367 -- # return 0 00:08:00.678 15:54:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:00.678 15:54:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:00.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.678 --rc genhtml_branch_coverage=1 00:08:00.678 --rc genhtml_function_coverage=1 00:08:00.678 --rc genhtml_legend=1 00:08:00.678 --rc geninfo_all_blocks=1 00:08:00.678 --rc geninfo_unexecuted_blocks=1 00:08:00.678 00:08:00.678 ' 00:08:00.678 15:54:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:00.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.678 --rc genhtml_branch_coverage=1 00:08:00.678 --rc genhtml_function_coverage=1 00:08:00.678 --rc genhtml_legend=1 00:08:00.678 --rc geninfo_all_blocks=1 00:08:00.678 --rc geninfo_unexecuted_blocks=1 00:08:00.678 00:08:00.678 ' 00:08:00.678 15:54:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:00.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.678 --rc genhtml_branch_coverage=1 00:08:00.678 --rc genhtml_function_coverage=1 00:08:00.678 --rc genhtml_legend=1 00:08:00.678 --rc geninfo_all_blocks=1 00:08:00.678 --rc geninfo_unexecuted_blocks=1 00:08:00.678 00:08:00.678 ' 00:08:00.678 15:54:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:00.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:00.678 --rc genhtml_branch_coverage=1 00:08:00.678 --rc genhtml_function_coverage=1 00:08:00.678 --rc genhtml_legend=1 00:08:00.678 --rc geninfo_all_blocks=1 00:08:00.678 --rc geninfo_unexecuted_blocks=1 00:08:00.678 00:08:00.678 ' 00:08:00.678 15:54:24 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:00.678 15:54:24 -- nvmf/common.sh@7 -- # uname -s 00:08:00.678 15:54:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:00.678 15:54:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:00.679 15:54:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:00.679 15:54:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:00.679 15:54:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:00.679 15:54:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:00.679 15:54:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:00.679 15:54:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:00.679 15:54:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:00.679 15:54:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:00.679 15:54:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:00.679 15:54:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:00.679 15:54:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:00.679 15:54:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:00.679 15:54:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:00.679 15:54:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:00.679 15:54:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:00.679 15:54:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:00.679 15:54:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:00.679 15:54:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.679 15:54:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.679 15:54:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.679 15:54:24 -- paths/export.sh@5 -- # export PATH 00:08:00.679 15:54:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:00.679 15:54:24 -- nvmf/common.sh@46 -- # : 0 00:08:00.679 15:54:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:00.679 15:54:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:00.679 15:54:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:00.679 15:54:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:00.679 15:54:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:00.679 15:54:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:00.679 15:54:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:00.679 15:54:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:00.679 15:54:24 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:08:00.679 15:54:24 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:08:00.679 15:54:24 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:08:00.679 15:54:24 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:08:00.679 15:54:24 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:08:00.679 15:54:24 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:08:00.679 15:54:24 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:08:00.679 15:54:24 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:08:00.679 15:54:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:00.679 15:54:24 -- common/autotest_common.sh@10 -- # set +x 00:08:00.679 15:54:24 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:08:00.679 15:54:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:00.679 15:54:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:00.679 15:54:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:00.679 15:54:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:00.679 15:54:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:00.679 15:54:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:00.679 15:54:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:00.679 15:54:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:00.679 15:54:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:00.679 15:54:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:00.679 15:54:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:00.679 15:54:24 -- common/autotest_common.sh@10 -- # set +x 00:08:02.580 15:54:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:02.580 15:54:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:02.580 15:54:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:02.580 15:54:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:02.580 15:54:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:02.580 15:54:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:02.580 15:54:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:02.580 15:54:26 -- nvmf/common.sh@294 -- # net_devs=() 00:08:02.580 15:54:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:02.580 15:54:26 -- nvmf/common.sh@295 -- # e810=() 00:08:02.580 15:54:26 -- nvmf/common.sh@295 -- # local -ga e810 00:08:02.580 15:54:26 -- nvmf/common.sh@296 -- # x722=() 00:08:02.580 15:54:26 -- nvmf/common.sh@296 -- # local -ga x722 00:08:02.580 15:54:26 -- nvmf/common.sh@297 -- # mlx=() 00:08:02.580 15:54:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:02.580 15:54:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:02.580 15:54:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:02.580 15:54:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:02.580 15:54:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:02.580 15:54:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:02.580 15:54:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:02.580 15:54:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:02.580 15:54:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:02.580 15:54:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:02.580 15:54:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:02.580 15:54:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:02.580 15:54:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:02.580 15:54:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:02.838 15:54:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:02.838 15:54:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:02.838 15:54:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:02.838 15:54:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:02.838 15:54:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:02.839 15:54:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:02.839 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:02.839 15:54:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:02.839 15:54:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:02.839 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:02.839 15:54:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:02.839 15:54:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:02.839 15:54:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:02.839 15:54:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:02.839 15:54:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:02.839 15:54:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:02.839 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:02.839 15:54:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:02.839 15:54:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:02.839 15:54:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:02.839 15:54:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:02.839 15:54:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:02.839 15:54:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:02.839 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:02.839 15:54:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:02.839 15:54:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:02.839 15:54:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:02.839 15:54:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:02.839 15:54:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:02.839 15:54:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:02.839 15:54:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:02.839 15:54:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:02.839 15:54:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:02.839 15:54:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:02.839 15:54:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:02.839 15:54:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:02.839 15:54:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:02.839 15:54:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:02.839 15:54:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:02.839 15:54:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:02.839 15:54:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:02.839 15:54:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:02.839 15:54:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:02.839 15:54:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:02.839 15:54:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:02.839 15:54:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:02.839 15:54:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:02.839 15:54:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:02.839 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:02.839 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.330 ms 00:08:02.839 00:08:02.839 --- 10.0.0.2 ping statistics --- 00:08:02.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:02.839 rtt min/avg/max/mdev = 0.330/0.330/0.330/0.000 ms 00:08:02.839 15:54:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:02.839 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:02.839 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:08:02.839 00:08:02.839 --- 10.0.0.1 ping statistics --- 00:08:02.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:02.839 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:08:02.839 15:54:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:02.839 15:54:26 -- nvmf/common.sh@410 -- # return 0 00:08:02.839 15:54:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:02.839 15:54:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:02.839 15:54:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:02.839 15:54:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:02.839 15:54:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:02.839 15:54:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:03.098 15:54:26 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:08:03.098 15:54:26 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:08:03.098 15:54:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:03.098 15:54:26 -- common/autotest_common.sh@10 -- # set +x 00:08:03.098 15:54:26 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:08:03.098 15:54:26 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:08:03.098 15:54:26 -- target/nvmf_example.sh@34 -- # nvmfpid=1480011 00:08:03.098 15:54:26 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:08:03.098 15:54:26 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:08:03.098 15:54:26 -- target/nvmf_example.sh@36 -- # waitforlisten 1480011 00:08:03.098 15:54:26 -- common/autotest_common.sh@829 -- # '[' -z 1480011 ']' 00:08:03.098 15:54:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:03.098 15:54:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:03.098 15:54:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:03.098 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:03.098 15:54:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:03.098 15:54:26 -- common/autotest_common.sh@10 -- # set +x 00:08:03.098 EAL: No free 2048 kB hugepages reported on node 1 00:08:04.032 15:54:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:04.032 15:54:27 -- common/autotest_common.sh@862 -- # return 0 00:08:04.032 15:54:27 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:08:04.032 15:54:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:04.032 15:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:04.032 15:54:27 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:04.032 15:54:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:04.032 15:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:04.032 15:54:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:04.032 15:54:27 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:08:04.032 15:54:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:04.032 15:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:04.032 15:54:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:04.032 15:54:27 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:08:04.032 15:54:27 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:04.032 15:54:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:04.032 15:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:04.032 15:54:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:04.032 15:54:27 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:08:04.032 15:54:27 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:04.032 15:54:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:04.032 15:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:04.032 15:54:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:04.032 15:54:27 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:04.032 15:54:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:04.032 15:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:04.032 15:54:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:04.032 15:54:27 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:08:04.032 15:54:27 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:08:04.032 EAL: No free 2048 kB hugepages reported on node 1 00:08:16.227 Initializing NVMe Controllers 00:08:16.227 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:16.227 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:16.227 Initialization complete. Launching workers. 00:08:16.227 ======================================================== 00:08:16.227 Latency(us) 00:08:16.227 Device Information : IOPS MiB/s Average min max 00:08:16.227 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15121.10 59.07 4233.64 868.03 16395.14 00:08:16.227 ======================================================== 00:08:16.227 Total : 15121.10 59.07 4233.64 868.03 16395.14 00:08:16.227 00:08:16.227 15:54:37 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:16.227 15:54:37 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:16.228 15:54:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:16.228 15:54:37 -- nvmf/common.sh@116 -- # sync 00:08:16.228 15:54:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:16.228 15:54:37 -- nvmf/common.sh@119 -- # set +e 00:08:16.228 15:54:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:16.228 15:54:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:16.228 rmmod nvme_tcp 00:08:16.228 rmmod nvme_fabrics 00:08:16.228 rmmod nvme_keyring 00:08:16.228 15:54:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:16.228 15:54:37 -- nvmf/common.sh@123 -- # set -e 00:08:16.228 15:54:37 -- nvmf/common.sh@124 -- # return 0 00:08:16.228 15:54:37 -- nvmf/common.sh@477 -- # '[' -n 1480011 ']' 00:08:16.228 15:54:37 -- nvmf/common.sh@478 -- # killprocess 1480011 00:08:16.228 15:54:37 -- common/autotest_common.sh@936 -- # '[' -z 1480011 ']' 00:08:16.228 15:54:37 -- common/autotest_common.sh@940 -- # kill -0 1480011 00:08:16.228 15:54:37 -- common/autotest_common.sh@941 -- # uname 00:08:16.228 15:54:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:16.228 15:54:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1480011 00:08:16.228 15:54:37 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:16.228 15:54:37 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:16.228 15:54:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1480011' 00:08:16.228 killing process with pid 1480011 00:08:16.228 15:54:37 -- common/autotest_common.sh@955 -- # kill 1480011 00:08:16.228 15:54:37 -- common/autotest_common.sh@960 -- # wait 1480011 00:08:16.228 nvmf threads initialize successfully 00:08:16.228 bdev subsystem init successfully 00:08:16.228 created a nvmf target service 00:08:16.228 create targets's poll groups done 00:08:16.228 all subsystems of target started 00:08:16.228 nvmf target is running 00:08:16.228 all subsystems of target stopped 00:08:16.228 destroy targets's poll groups done 00:08:16.228 destroyed the nvmf target service 00:08:16.228 bdev subsystem finish successfully 00:08:16.228 nvmf threads destroy successfully 00:08:16.228 15:54:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:16.228 15:54:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:16.228 15:54:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:16.228 15:54:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:16.228 15:54:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:16.228 15:54:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:16.228 15:54:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:16.228 15:54:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:16.796 15:54:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:16.796 15:54:40 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:16.796 15:54:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:16.796 15:54:40 -- common/autotest_common.sh@10 -- # set +x 00:08:16.796 00:08:16.796 real 0m16.292s 00:08:16.796 user 0m45.707s 00:08:16.796 sys 0m3.313s 00:08:16.796 15:54:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:16.796 15:54:40 -- common/autotest_common.sh@10 -- # set +x 00:08:16.796 ************************************ 00:08:16.796 END TEST nvmf_example 00:08:16.796 ************************************ 00:08:16.796 15:54:40 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:16.796 15:54:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:16.796 15:54:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:16.796 15:54:40 -- common/autotest_common.sh@10 -- # set +x 00:08:16.796 ************************************ 00:08:16.796 START TEST nvmf_filesystem 00:08:16.796 ************************************ 00:08:16.796 15:54:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:16.796 * Looking for test storage... 00:08:16.796 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:16.796 15:54:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:16.796 15:54:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:16.796 15:54:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:16.796 15:54:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:16.796 15:54:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:16.796 15:54:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:16.796 15:54:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:16.796 15:54:40 -- scripts/common.sh@335 -- # IFS=.-: 00:08:16.796 15:54:40 -- scripts/common.sh@335 -- # read -ra ver1 00:08:16.796 15:54:40 -- scripts/common.sh@336 -- # IFS=.-: 00:08:16.796 15:54:40 -- scripts/common.sh@336 -- # read -ra ver2 00:08:16.796 15:54:40 -- scripts/common.sh@337 -- # local 'op=<' 00:08:16.796 15:54:40 -- scripts/common.sh@339 -- # ver1_l=2 00:08:16.796 15:54:40 -- scripts/common.sh@340 -- # ver2_l=1 00:08:16.796 15:54:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:16.796 15:54:40 -- scripts/common.sh@343 -- # case "$op" in 00:08:16.796 15:54:40 -- scripts/common.sh@344 -- # : 1 00:08:16.796 15:54:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:16.796 15:54:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:16.796 15:54:40 -- scripts/common.sh@364 -- # decimal 1 00:08:16.796 15:54:40 -- scripts/common.sh@352 -- # local d=1 00:08:16.796 15:54:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:16.796 15:54:40 -- scripts/common.sh@354 -- # echo 1 00:08:16.796 15:54:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:16.796 15:54:40 -- scripts/common.sh@365 -- # decimal 2 00:08:16.796 15:54:40 -- scripts/common.sh@352 -- # local d=2 00:08:16.796 15:54:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:16.796 15:54:40 -- scripts/common.sh@354 -- # echo 2 00:08:16.796 15:54:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:16.796 15:54:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:16.796 15:54:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:16.796 15:54:40 -- scripts/common.sh@367 -- # return 0 00:08:16.796 15:54:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:16.796 15:54:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:16.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.796 --rc genhtml_branch_coverage=1 00:08:16.796 --rc genhtml_function_coverage=1 00:08:16.796 --rc genhtml_legend=1 00:08:16.796 --rc geninfo_all_blocks=1 00:08:16.796 --rc geninfo_unexecuted_blocks=1 00:08:16.796 00:08:16.796 ' 00:08:16.796 15:54:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:16.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.796 --rc genhtml_branch_coverage=1 00:08:16.796 --rc genhtml_function_coverage=1 00:08:16.796 --rc genhtml_legend=1 00:08:16.796 --rc geninfo_all_blocks=1 00:08:16.796 --rc geninfo_unexecuted_blocks=1 00:08:16.796 00:08:16.796 ' 00:08:16.796 15:54:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:16.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.796 --rc genhtml_branch_coverage=1 00:08:16.797 --rc genhtml_function_coverage=1 00:08:16.797 --rc genhtml_legend=1 00:08:16.797 --rc geninfo_all_blocks=1 00:08:16.797 --rc geninfo_unexecuted_blocks=1 00:08:16.797 00:08:16.797 ' 00:08:16.797 15:54:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:16.797 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:16.797 --rc genhtml_branch_coverage=1 00:08:16.797 --rc genhtml_function_coverage=1 00:08:16.797 --rc genhtml_legend=1 00:08:16.797 --rc geninfo_all_blocks=1 00:08:16.797 --rc geninfo_unexecuted_blocks=1 00:08:16.797 00:08:16.797 ' 00:08:16.797 15:54:40 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:16.797 15:54:40 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:16.797 15:54:40 -- common/autotest_common.sh@34 -- # set -e 00:08:16.797 15:54:40 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:16.797 15:54:40 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:16.797 15:54:40 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:16.797 15:54:40 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:16.797 15:54:40 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:16.797 15:54:40 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:16.797 15:54:40 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:16.797 15:54:40 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:16.797 15:54:40 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:16.797 15:54:40 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:16.797 15:54:40 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:16.797 15:54:40 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:16.797 15:54:40 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:16.797 15:54:40 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:16.797 15:54:40 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:16.797 15:54:40 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:16.797 15:54:40 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:16.797 15:54:40 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:16.797 15:54:40 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:16.797 15:54:40 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:16.797 15:54:40 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:16.797 15:54:40 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:16.797 15:54:40 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:16.797 15:54:40 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:16.797 15:54:40 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:16.797 15:54:40 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:16.797 15:54:40 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:16.797 15:54:40 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:16.797 15:54:40 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:16.797 15:54:40 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:16.797 15:54:40 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:16.797 15:54:40 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:16.797 15:54:40 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:16.797 15:54:40 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:16.797 15:54:40 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:16.797 15:54:40 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:16.797 15:54:40 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:16.797 15:54:40 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:16.797 15:54:40 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:16.797 15:54:40 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:16.797 15:54:40 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:16.797 15:54:40 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:17.058 15:54:40 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:17.058 15:54:40 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:17.058 15:54:40 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:17.058 15:54:40 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:17.058 15:54:40 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:17.058 15:54:40 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:17.058 15:54:40 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:17.058 15:54:40 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:17.058 15:54:40 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:17.058 15:54:40 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:17.058 15:54:40 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:17.058 15:54:40 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:17.058 15:54:40 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:17.058 15:54:40 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:17.058 15:54:40 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:17.058 15:54:40 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:17.058 15:54:40 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:17.058 15:54:40 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:17.058 15:54:40 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:17.058 15:54:40 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:17.058 15:54:40 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:17.058 15:54:40 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:17.058 15:54:40 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:17.058 15:54:40 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:17.058 15:54:40 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:17.058 15:54:40 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:17.058 15:54:40 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:17.058 15:54:40 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:17.058 15:54:40 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:17.058 15:54:40 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:17.058 15:54:40 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:17.058 15:54:40 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:17.058 15:54:40 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:17.058 15:54:40 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:17.058 15:54:40 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:17.058 15:54:40 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:17.058 15:54:40 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:17.058 15:54:40 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:17.058 15:54:40 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:17.058 15:54:40 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:17.058 15:54:40 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:17.058 15:54:40 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:17.058 15:54:40 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:17.058 15:54:40 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:17.058 15:54:40 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:17.058 15:54:40 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:17.058 15:54:40 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:17.058 15:54:40 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:17.058 15:54:40 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:17.058 15:54:40 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:17.058 15:54:40 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:17.058 15:54:40 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:17.058 15:54:40 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:17.058 15:54:40 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:17.058 15:54:40 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:17.058 15:54:40 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:17.058 15:54:40 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:17.058 #define SPDK_CONFIG_H 00:08:17.058 #define SPDK_CONFIG_APPS 1 00:08:17.058 #define SPDK_CONFIG_ARCH native 00:08:17.058 #undef SPDK_CONFIG_ASAN 00:08:17.058 #undef SPDK_CONFIG_AVAHI 00:08:17.058 #undef SPDK_CONFIG_CET 00:08:17.058 #define SPDK_CONFIG_COVERAGE 1 00:08:17.058 #define SPDK_CONFIG_CROSS_PREFIX 00:08:17.058 #undef SPDK_CONFIG_CRYPTO 00:08:17.058 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:17.058 #undef SPDK_CONFIG_CUSTOMOCF 00:08:17.058 #undef SPDK_CONFIG_DAOS 00:08:17.058 #define SPDK_CONFIG_DAOS_DIR 00:08:17.058 #define SPDK_CONFIG_DEBUG 1 00:08:17.058 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:17.058 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:17.058 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:17.058 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:17.058 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:17.058 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:17.058 #define SPDK_CONFIG_EXAMPLES 1 00:08:17.058 #undef SPDK_CONFIG_FC 00:08:17.058 #define SPDK_CONFIG_FC_PATH 00:08:17.058 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:17.058 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:17.058 #undef SPDK_CONFIG_FUSE 00:08:17.058 #undef SPDK_CONFIG_FUZZER 00:08:17.058 #define SPDK_CONFIG_FUZZER_LIB 00:08:17.058 #undef SPDK_CONFIG_GOLANG 00:08:17.058 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:17.058 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:17.058 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:17.058 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:17.059 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:17.059 #define SPDK_CONFIG_IDXD 1 00:08:17.059 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:17.059 #undef SPDK_CONFIG_IPSEC_MB 00:08:17.059 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:17.059 #define SPDK_CONFIG_ISAL 1 00:08:17.059 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:17.059 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:17.059 #define SPDK_CONFIG_LIBDIR 00:08:17.059 #undef SPDK_CONFIG_LTO 00:08:17.059 #define SPDK_CONFIG_MAX_LCORES 00:08:17.059 #define SPDK_CONFIG_NVME_CUSE 1 00:08:17.059 #undef SPDK_CONFIG_OCF 00:08:17.059 #define SPDK_CONFIG_OCF_PATH 00:08:17.059 #define SPDK_CONFIG_OPENSSL_PATH 00:08:17.059 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:17.059 #undef SPDK_CONFIG_PGO_USE 00:08:17.059 #define SPDK_CONFIG_PREFIX /usr/local 00:08:17.059 #undef SPDK_CONFIG_RAID5F 00:08:17.059 #undef SPDK_CONFIG_RBD 00:08:17.059 #define SPDK_CONFIG_RDMA 1 00:08:17.059 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:17.059 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:17.059 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:17.059 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:17.059 #define SPDK_CONFIG_SHARED 1 00:08:17.059 #undef SPDK_CONFIG_SMA 00:08:17.059 #define SPDK_CONFIG_TESTS 1 00:08:17.059 #undef SPDK_CONFIG_TSAN 00:08:17.059 #define SPDK_CONFIG_UBLK 1 00:08:17.059 #define SPDK_CONFIG_UBSAN 1 00:08:17.059 #undef SPDK_CONFIG_UNIT_TESTS 00:08:17.059 #undef SPDK_CONFIG_URING 00:08:17.059 #define SPDK_CONFIG_URING_PATH 00:08:17.059 #undef SPDK_CONFIG_URING_ZNS 00:08:17.059 #undef SPDK_CONFIG_USDT 00:08:17.059 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:17.059 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:17.059 #define SPDK_CONFIG_VFIO_USER 1 00:08:17.059 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:17.059 #define SPDK_CONFIG_VHOST 1 00:08:17.059 #define SPDK_CONFIG_VIRTIO 1 00:08:17.059 #undef SPDK_CONFIG_VTUNE 00:08:17.059 #define SPDK_CONFIG_VTUNE_DIR 00:08:17.059 #define SPDK_CONFIG_WERROR 1 00:08:17.059 #define SPDK_CONFIG_WPDK_DIR 00:08:17.059 #undef SPDK_CONFIG_XNVME 00:08:17.059 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:17.059 15:54:40 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:17.059 15:54:40 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:17.059 15:54:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:17.059 15:54:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:17.059 15:54:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:17.059 15:54:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:17.059 15:54:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:17.059 15:54:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:17.059 15:54:40 -- paths/export.sh@5 -- # export PATH 00:08:17.059 15:54:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:17.059 15:54:40 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:17.059 15:54:40 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:17.059 15:54:40 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:17.059 15:54:40 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:17.059 15:54:40 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:17.059 15:54:40 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:17.059 15:54:40 -- pm/common@16 -- # TEST_TAG=N/A 00:08:17.059 15:54:40 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:17.059 15:54:40 -- common/autotest_common.sh@52 -- # : 1 00:08:17.059 15:54:40 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:17.059 15:54:40 -- common/autotest_common.sh@56 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:17.059 15:54:40 -- common/autotest_common.sh@58 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:17.059 15:54:40 -- common/autotest_common.sh@60 -- # : 1 00:08:17.059 15:54:40 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:17.059 15:54:40 -- common/autotest_common.sh@62 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:17.059 15:54:40 -- common/autotest_common.sh@64 -- # : 00:08:17.059 15:54:40 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:17.059 15:54:40 -- common/autotest_common.sh@66 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:17.059 15:54:40 -- common/autotest_common.sh@68 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:17.059 15:54:40 -- common/autotest_common.sh@70 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:17.059 15:54:40 -- common/autotest_common.sh@72 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:17.059 15:54:40 -- common/autotest_common.sh@74 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:17.059 15:54:40 -- common/autotest_common.sh@76 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:17.059 15:54:40 -- common/autotest_common.sh@78 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:17.059 15:54:40 -- common/autotest_common.sh@80 -- # : 1 00:08:17.059 15:54:40 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:17.059 15:54:40 -- common/autotest_common.sh@82 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:17.059 15:54:40 -- common/autotest_common.sh@84 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:17.059 15:54:40 -- common/autotest_common.sh@86 -- # : 1 00:08:17.059 15:54:40 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:17.059 15:54:40 -- common/autotest_common.sh@88 -- # : 1 00:08:17.059 15:54:40 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:17.059 15:54:40 -- common/autotest_common.sh@90 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:17.059 15:54:40 -- common/autotest_common.sh@92 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:17.059 15:54:40 -- common/autotest_common.sh@94 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:17.059 15:54:40 -- common/autotest_common.sh@96 -- # : tcp 00:08:17.059 15:54:40 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:17.059 15:54:40 -- common/autotest_common.sh@98 -- # : 0 00:08:17.059 15:54:40 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:17.059 15:54:40 -- common/autotest_common.sh@100 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:17.060 15:54:40 -- common/autotest_common.sh@102 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:17.060 15:54:40 -- common/autotest_common.sh@104 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:17.060 15:54:40 -- common/autotest_common.sh@106 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:17.060 15:54:40 -- common/autotest_common.sh@108 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:17.060 15:54:40 -- common/autotest_common.sh@110 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:17.060 15:54:40 -- common/autotest_common.sh@112 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:17.060 15:54:40 -- common/autotest_common.sh@114 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:17.060 15:54:40 -- common/autotest_common.sh@116 -- # : 1 00:08:17.060 15:54:40 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:17.060 15:54:40 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:17.060 15:54:40 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:17.060 15:54:40 -- common/autotest_common.sh@120 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:17.060 15:54:40 -- common/autotest_common.sh@122 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:17.060 15:54:40 -- common/autotest_common.sh@124 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:17.060 15:54:40 -- common/autotest_common.sh@126 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:17.060 15:54:40 -- common/autotest_common.sh@128 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:17.060 15:54:40 -- common/autotest_common.sh@130 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:17.060 15:54:40 -- common/autotest_common.sh@132 -- # : v23.11 00:08:17.060 15:54:40 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:17.060 15:54:40 -- common/autotest_common.sh@134 -- # : true 00:08:17.060 15:54:40 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:17.060 15:54:40 -- common/autotest_common.sh@136 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:17.060 15:54:40 -- common/autotest_common.sh@138 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:17.060 15:54:40 -- common/autotest_common.sh@140 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:17.060 15:54:40 -- common/autotest_common.sh@142 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:17.060 15:54:40 -- common/autotest_common.sh@144 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:17.060 15:54:40 -- common/autotest_common.sh@146 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:17.060 15:54:40 -- common/autotest_common.sh@148 -- # : e810 00:08:17.060 15:54:40 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:17.060 15:54:40 -- common/autotest_common.sh@150 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:17.060 15:54:40 -- common/autotest_common.sh@152 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:17.060 15:54:40 -- common/autotest_common.sh@154 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:17.060 15:54:40 -- common/autotest_common.sh@156 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:17.060 15:54:40 -- common/autotest_common.sh@158 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:17.060 15:54:40 -- common/autotest_common.sh@160 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:17.060 15:54:40 -- common/autotest_common.sh@163 -- # : 00:08:17.060 15:54:40 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:17.060 15:54:40 -- common/autotest_common.sh@165 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:17.060 15:54:40 -- common/autotest_common.sh@167 -- # : 0 00:08:17.060 15:54:40 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:17.060 15:54:40 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:17.060 15:54:40 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:17.060 15:54:40 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:17.060 15:54:40 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:17.060 15:54:40 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:17.060 15:54:40 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:17.060 15:54:40 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:17.060 15:54:40 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:17.060 15:54:40 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:17.060 15:54:40 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:17.060 15:54:40 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:17.060 15:54:40 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:17.060 15:54:40 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:17.060 15:54:40 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:17.060 15:54:40 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:17.060 15:54:40 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:17.060 15:54:40 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:17.060 15:54:40 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:17.060 15:54:40 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:17.060 15:54:40 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:17.060 15:54:40 -- common/autotest_common.sh@196 -- # cat 00:08:17.060 15:54:40 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:17.060 15:54:40 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:17.060 15:54:40 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:17.060 15:54:40 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:17.060 15:54:40 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:17.060 15:54:40 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:17.060 15:54:40 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:17.061 15:54:40 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:17.061 15:54:40 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:17.061 15:54:40 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:17.061 15:54:40 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:17.061 15:54:40 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:17.061 15:54:40 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:17.061 15:54:40 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:17.061 15:54:40 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:17.061 15:54:40 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:17.061 15:54:40 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:17.061 15:54:40 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:17.061 15:54:40 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:17.061 15:54:40 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:08:17.061 15:54:40 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:08:17.061 15:54:40 -- common/autotest_common.sh@249 -- # _LCOV= 00:08:17.061 15:54:40 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:08:17.061 15:54:40 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:08:17.061 15:54:40 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:08:17.061 15:54:40 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:08:17.061 15:54:40 -- common/autotest_common.sh@255 -- # lcov_opt= 00:08:17.061 15:54:40 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:08:17.061 15:54:40 -- common/autotest_common.sh@259 -- # export valgrind= 00:08:17.061 15:54:40 -- common/autotest_common.sh@259 -- # valgrind= 00:08:17.061 15:54:40 -- common/autotest_common.sh@265 -- # uname -s 00:08:17.061 15:54:40 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:08:17.061 15:54:40 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:08:17.061 15:54:40 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:08:17.061 15:54:40 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:08:17.061 15:54:40 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:17.061 15:54:40 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:17.061 15:54:40 -- common/autotest_common.sh@275 -- # MAKE=make 00:08:17.061 15:54:40 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:08:17.061 15:54:40 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:08:17.061 15:54:40 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:08:17.061 15:54:40 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:17.061 15:54:40 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:08:17.061 15:54:40 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:08:17.061 15:54:40 -- common/autotest_common.sh@301 -- # for i in "$@" 00:08:17.061 15:54:40 -- common/autotest_common.sh@302 -- # case "$i" in 00:08:17.061 15:54:40 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:08:17.061 15:54:40 -- common/autotest_common.sh@319 -- # [[ -z 1481763 ]] 00:08:17.061 15:54:40 -- common/autotest_common.sh@319 -- # kill -0 1481763 00:08:17.061 15:54:40 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:08:17.061 15:54:40 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:08:17.061 15:54:40 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:08:17.061 15:54:40 -- common/autotest_common.sh@332 -- # local mount target_dir 00:08:17.061 15:54:40 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:08:17.061 15:54:40 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:08:17.061 15:54:40 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:08:17.061 15:54:40 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:08:17.061 15:54:40 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.mwE9AD 00:08:17.061 15:54:40 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:17.061 15:54:40 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:08:17.061 15:54:40 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:08:17.061 15:54:40 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.mwE9AD/tests/target /tmp/spdk.mwE9AD 00:08:17.061 15:54:40 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:08:17.061 15:54:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:17.061 15:54:40 -- common/autotest_common.sh@328 -- # df -T 00:08:17.061 15:54:40 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:08:17.061 15:54:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:08:17.061 15:54:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:08:17.061 15:54:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:08:17.061 15:54:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=53261746176 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988519936 00:08:17.061 15:54:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=8726773760 00:08:17.061 15:54:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993002496 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:08:17.061 15:54:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:08:17.061 15:54:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:08:17.061 15:54:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:08:17.061 15:54:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993895424 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:08:17.061 15:54:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=364544 00:08:17.061 15:54:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:17.061 15:54:40 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:08:17.061 15:54:40 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:08:17.061 15:54:40 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:08:17.061 15:54:40 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:17.061 15:54:40 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:08:17.061 * Looking for test storage... 00:08:17.061 15:54:40 -- common/autotest_common.sh@369 -- # local target_space new_size 00:08:17.061 15:54:40 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:08:17.061 15:54:40 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:17.061 15:54:40 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:17.061 15:54:40 -- common/autotest_common.sh@373 -- # mount=/ 00:08:17.062 15:54:40 -- common/autotest_common.sh@375 -- # target_space=53261746176 00:08:17.062 15:54:40 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:08:17.062 15:54:40 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:08:17.062 15:54:40 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:08:17.062 15:54:40 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:08:17.062 15:54:40 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:08:17.062 15:54:40 -- common/autotest_common.sh@382 -- # new_size=10941366272 00:08:17.062 15:54:40 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:17.062 15:54:40 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:17.062 15:54:40 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:17.062 15:54:40 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:17.062 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:17.062 15:54:40 -- common/autotest_common.sh@390 -- # return 0 00:08:17.062 15:54:40 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:08:17.062 15:54:40 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:08:17.062 15:54:40 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:17.062 15:54:40 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:17.062 15:54:40 -- common/autotest_common.sh@1682 -- # true 00:08:17.062 15:54:40 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:08:17.062 15:54:40 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:17.062 15:54:40 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:17.062 15:54:40 -- common/autotest_common.sh@27 -- # exec 00:08:17.062 15:54:40 -- common/autotest_common.sh@29 -- # exec 00:08:17.062 15:54:40 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:17.062 15:54:40 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:17.062 15:54:40 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:17.062 15:54:40 -- common/autotest_common.sh@18 -- # set -x 00:08:17.062 15:54:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:17.062 15:54:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:17.062 15:54:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:17.062 15:54:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:17.062 15:54:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:17.062 15:54:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:17.062 15:54:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:17.062 15:54:40 -- scripts/common.sh@335 -- # IFS=.-: 00:08:17.062 15:54:40 -- scripts/common.sh@335 -- # read -ra ver1 00:08:17.062 15:54:40 -- scripts/common.sh@336 -- # IFS=.-: 00:08:17.062 15:54:40 -- scripts/common.sh@336 -- # read -ra ver2 00:08:17.062 15:54:40 -- scripts/common.sh@337 -- # local 'op=<' 00:08:17.062 15:54:40 -- scripts/common.sh@339 -- # ver1_l=2 00:08:17.062 15:54:40 -- scripts/common.sh@340 -- # ver2_l=1 00:08:17.062 15:54:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:17.062 15:54:40 -- scripts/common.sh@343 -- # case "$op" in 00:08:17.062 15:54:40 -- scripts/common.sh@344 -- # : 1 00:08:17.062 15:54:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:17.062 15:54:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:17.062 15:54:40 -- scripts/common.sh@364 -- # decimal 1 00:08:17.062 15:54:40 -- scripts/common.sh@352 -- # local d=1 00:08:17.062 15:54:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:17.062 15:54:40 -- scripts/common.sh@354 -- # echo 1 00:08:17.062 15:54:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:17.062 15:54:40 -- scripts/common.sh@365 -- # decimal 2 00:08:17.062 15:54:40 -- scripts/common.sh@352 -- # local d=2 00:08:17.062 15:54:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:17.062 15:54:40 -- scripts/common.sh@354 -- # echo 2 00:08:17.062 15:54:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:17.062 15:54:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:17.062 15:54:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:17.062 15:54:40 -- scripts/common.sh@367 -- # return 0 00:08:17.062 15:54:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:17.062 15:54:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:17.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:17.062 --rc genhtml_branch_coverage=1 00:08:17.062 --rc genhtml_function_coverage=1 00:08:17.062 --rc genhtml_legend=1 00:08:17.062 --rc geninfo_all_blocks=1 00:08:17.062 --rc geninfo_unexecuted_blocks=1 00:08:17.062 00:08:17.062 ' 00:08:17.062 15:54:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:17.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:17.062 --rc genhtml_branch_coverage=1 00:08:17.062 --rc genhtml_function_coverage=1 00:08:17.062 --rc genhtml_legend=1 00:08:17.062 --rc geninfo_all_blocks=1 00:08:17.062 --rc geninfo_unexecuted_blocks=1 00:08:17.062 00:08:17.062 ' 00:08:17.062 15:54:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:17.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:17.062 --rc genhtml_branch_coverage=1 00:08:17.062 --rc genhtml_function_coverage=1 00:08:17.062 --rc genhtml_legend=1 00:08:17.062 --rc geninfo_all_blocks=1 00:08:17.062 --rc geninfo_unexecuted_blocks=1 00:08:17.062 00:08:17.062 ' 00:08:17.062 15:54:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:17.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:17.062 --rc genhtml_branch_coverage=1 00:08:17.062 --rc genhtml_function_coverage=1 00:08:17.062 --rc genhtml_legend=1 00:08:17.062 --rc geninfo_all_blocks=1 00:08:17.062 --rc geninfo_unexecuted_blocks=1 00:08:17.062 00:08:17.062 ' 00:08:17.062 15:54:40 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:17.062 15:54:40 -- nvmf/common.sh@7 -- # uname -s 00:08:17.062 15:54:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:17.062 15:54:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:17.062 15:54:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:17.062 15:54:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:17.062 15:54:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:17.062 15:54:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:17.062 15:54:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:17.062 15:54:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:17.062 15:54:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:17.062 15:54:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:17.062 15:54:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:17.062 15:54:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:17.062 15:54:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:17.062 15:54:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:17.062 15:54:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:17.062 15:54:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:17.062 15:54:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:17.062 15:54:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:17.062 15:54:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:17.062 15:54:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:17.062 15:54:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:17.063 15:54:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:17.063 15:54:40 -- paths/export.sh@5 -- # export PATH 00:08:17.063 15:54:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:17.063 15:54:40 -- nvmf/common.sh@46 -- # : 0 00:08:17.063 15:54:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:17.063 15:54:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:17.063 15:54:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:17.063 15:54:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:17.063 15:54:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:17.063 15:54:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:17.063 15:54:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:17.063 15:54:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:17.063 15:54:40 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:17.063 15:54:40 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:17.063 15:54:40 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:17.063 15:54:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:17.063 15:54:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:17.063 15:54:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:17.063 15:54:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:17.063 15:54:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:17.063 15:54:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:17.063 15:54:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:17.063 15:54:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:17.063 15:54:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:17.063 15:54:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:17.063 15:54:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:17.063 15:54:40 -- common/autotest_common.sh@10 -- # set +x 00:08:19.619 15:54:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:19.619 15:54:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:19.619 15:54:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:19.619 15:54:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:19.619 15:54:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:19.619 15:54:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:19.619 15:54:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:19.619 15:54:42 -- nvmf/common.sh@294 -- # net_devs=() 00:08:19.619 15:54:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:19.619 15:54:42 -- nvmf/common.sh@295 -- # e810=() 00:08:19.619 15:54:42 -- nvmf/common.sh@295 -- # local -ga e810 00:08:19.619 15:54:42 -- nvmf/common.sh@296 -- # x722=() 00:08:19.619 15:54:42 -- nvmf/common.sh@296 -- # local -ga x722 00:08:19.619 15:54:42 -- nvmf/common.sh@297 -- # mlx=() 00:08:19.619 15:54:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:19.619 15:54:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:19.619 15:54:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:19.619 15:54:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:19.619 15:54:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:19.619 15:54:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:19.619 15:54:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:19.619 15:54:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:19.619 15:54:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:19.619 15:54:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:19.619 15:54:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:19.619 15:54:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:19.619 15:54:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:19.619 15:54:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:19.619 15:54:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:19.619 15:54:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:19.619 15:54:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:19.619 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:19.619 15:54:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:19.619 15:54:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:19.619 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:19.619 15:54:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:19.619 15:54:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:19.619 15:54:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:19.619 15:54:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:19.620 15:54:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:19.620 15:54:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:19.620 15:54:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:19.620 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:19.620 15:54:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:19.620 15:54:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:19.620 15:54:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:19.620 15:54:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:19.620 15:54:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:19.620 15:54:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:19.620 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:19.620 15:54:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:19.620 15:54:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:19.620 15:54:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:19.620 15:54:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:19.620 15:54:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:19.620 15:54:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:19.620 15:54:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:19.620 15:54:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:19.620 15:54:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:19.620 15:54:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:19.620 15:54:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:19.620 15:54:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:19.620 15:54:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:19.620 15:54:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:19.620 15:54:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:19.620 15:54:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:19.620 15:54:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:19.620 15:54:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:19.620 15:54:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:19.620 15:54:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:19.620 15:54:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:19.620 15:54:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:19.620 15:54:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:19.620 15:54:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:19.620 15:54:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:19.620 15:54:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:19.620 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:19.620 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.193 ms 00:08:19.620 00:08:19.620 --- 10.0.0.2 ping statistics --- 00:08:19.620 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:19.620 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:08:19.620 15:54:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:19.620 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:19.620 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:08:19.620 00:08:19.620 --- 10.0.0.1 ping statistics --- 00:08:19.620 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:19.620 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:08:19.620 15:54:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:19.620 15:54:42 -- nvmf/common.sh@410 -- # return 0 00:08:19.620 15:54:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:19.620 15:54:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:19.620 15:54:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:19.620 15:54:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:19.620 15:54:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:19.620 15:54:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:19.620 15:54:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:19.620 15:54:42 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:19.620 15:54:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:19.620 15:54:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:19.620 15:54:42 -- common/autotest_common.sh@10 -- # set +x 00:08:19.620 ************************************ 00:08:19.620 START TEST nvmf_filesystem_no_in_capsule 00:08:19.620 ************************************ 00:08:19.620 15:54:42 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:08:19.620 15:54:42 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:19.620 15:54:42 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:19.620 15:54:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:19.620 15:54:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:19.620 15:54:42 -- common/autotest_common.sh@10 -- # set +x 00:08:19.620 15:54:42 -- nvmf/common.sh@469 -- # nvmfpid=1483411 00:08:19.620 15:54:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:19.620 15:54:42 -- nvmf/common.sh@470 -- # waitforlisten 1483411 00:08:19.620 15:54:42 -- common/autotest_common.sh@829 -- # '[' -z 1483411 ']' 00:08:19.620 15:54:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:19.620 15:54:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:19.620 15:54:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:19.620 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:19.620 15:54:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:19.620 15:54:42 -- common/autotest_common.sh@10 -- # set +x 00:08:19.620 [2024-11-18 15:54:42.929493] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:19.620 [2024-11-18 15:54:42.929562] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:19.620 EAL: No free 2048 kB hugepages reported on node 1 00:08:19.620 [2024-11-18 15:54:42.993731] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:19.620 [2024-11-18 15:54:43.083869] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:19.620 [2024-11-18 15:54:43.084036] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:19.620 [2024-11-18 15:54:43.084068] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:19.620 [2024-11-18 15:54:43.084081] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:19.620 [2024-11-18 15:54:43.084140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:19.620 [2024-11-18 15:54:43.084204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:19.620 [2024-11-18 15:54:43.084236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:19.620 [2024-11-18 15:54:43.084238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:20.554 15:54:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:20.554 15:54:43 -- common/autotest_common.sh@862 -- # return 0 00:08:20.554 15:54:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:20.554 15:54:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:20.554 15:54:43 -- common/autotest_common.sh@10 -- # set +x 00:08:20.554 15:54:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:20.554 15:54:44 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:20.554 15:54:44 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:20.554 15:54:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:20.554 15:54:44 -- common/autotest_common.sh@10 -- # set +x 00:08:20.554 [2024-11-18 15:54:44.006513] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:20.554 15:54:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:20.554 15:54:44 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:20.554 15:54:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:20.554 15:54:44 -- common/autotest_common.sh@10 -- # set +x 00:08:20.812 Malloc1 00:08:20.812 15:54:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:20.812 15:54:44 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:20.812 15:54:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:20.812 15:54:44 -- common/autotest_common.sh@10 -- # set +x 00:08:20.812 15:54:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:20.812 15:54:44 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:20.812 15:54:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:20.812 15:54:44 -- common/autotest_common.sh@10 -- # set +x 00:08:20.812 15:54:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:20.812 15:54:44 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:20.812 15:54:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:20.812 15:54:44 -- common/autotest_common.sh@10 -- # set +x 00:08:20.812 [2024-11-18 15:54:44.189638] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:20.812 15:54:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:20.812 15:54:44 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:20.812 15:54:44 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:20.812 15:54:44 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:20.812 15:54:44 -- common/autotest_common.sh@1369 -- # local bs 00:08:20.812 15:54:44 -- common/autotest_common.sh@1370 -- # local nb 00:08:20.812 15:54:44 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:20.812 15:54:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:20.812 15:54:44 -- common/autotest_common.sh@10 -- # set +x 00:08:20.812 15:54:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:20.812 15:54:44 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:20.812 { 00:08:20.812 "name": "Malloc1", 00:08:20.812 "aliases": [ 00:08:20.812 "2538c18d-1397-4436-9c9b-866ddd03c182" 00:08:20.812 ], 00:08:20.812 "product_name": "Malloc disk", 00:08:20.812 "block_size": 512, 00:08:20.812 "num_blocks": 1048576, 00:08:20.812 "uuid": "2538c18d-1397-4436-9c9b-866ddd03c182", 00:08:20.812 "assigned_rate_limits": { 00:08:20.812 "rw_ios_per_sec": 0, 00:08:20.812 "rw_mbytes_per_sec": 0, 00:08:20.812 "r_mbytes_per_sec": 0, 00:08:20.812 "w_mbytes_per_sec": 0 00:08:20.812 }, 00:08:20.812 "claimed": true, 00:08:20.812 "claim_type": "exclusive_write", 00:08:20.812 "zoned": false, 00:08:20.812 "supported_io_types": { 00:08:20.812 "read": true, 00:08:20.812 "write": true, 00:08:20.812 "unmap": true, 00:08:20.812 "write_zeroes": true, 00:08:20.812 "flush": true, 00:08:20.812 "reset": true, 00:08:20.812 "compare": false, 00:08:20.812 "compare_and_write": false, 00:08:20.812 "abort": true, 00:08:20.812 "nvme_admin": false, 00:08:20.812 "nvme_io": false 00:08:20.812 }, 00:08:20.812 "memory_domains": [ 00:08:20.812 { 00:08:20.812 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:20.812 "dma_device_type": 2 00:08:20.812 } 00:08:20.812 ], 00:08:20.812 "driver_specific": {} 00:08:20.812 } 00:08:20.812 ]' 00:08:20.812 15:54:44 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:20.812 15:54:44 -- common/autotest_common.sh@1372 -- # bs=512 00:08:20.812 15:54:44 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:20.812 15:54:44 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:20.812 15:54:44 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:20.812 15:54:44 -- common/autotest_common.sh@1377 -- # echo 512 00:08:20.812 15:54:44 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:20.812 15:54:44 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:21.745 15:54:44 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:21.745 15:54:44 -- common/autotest_common.sh@1187 -- # local i=0 00:08:21.745 15:54:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:21.745 15:54:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:21.745 15:54:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:23.643 15:54:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:23.643 15:54:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:23.643 15:54:46 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:23.643 15:54:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:23.643 15:54:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:23.643 15:54:46 -- common/autotest_common.sh@1197 -- # return 0 00:08:23.643 15:54:46 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:23.643 15:54:46 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:23.643 15:54:47 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:23.643 15:54:47 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:23.643 15:54:47 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:23.643 15:54:47 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:23.643 15:54:47 -- setup/common.sh@80 -- # echo 536870912 00:08:23.643 15:54:47 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:23.643 15:54:47 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:23.643 15:54:47 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:23.643 15:54:47 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:23.643 15:54:47 -- target/filesystem.sh@69 -- # partprobe 00:08:24.208 15:54:47 -- target/filesystem.sh@70 -- # sleep 1 00:08:25.197 15:54:48 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:25.197 15:54:48 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:25.197 15:54:48 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:25.197 15:54:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:25.197 15:54:48 -- common/autotest_common.sh@10 -- # set +x 00:08:25.197 ************************************ 00:08:25.197 START TEST filesystem_ext4 00:08:25.197 ************************************ 00:08:25.197 15:54:48 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:25.197 15:54:48 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:25.197 15:54:48 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:25.197 15:54:48 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:25.197 15:54:48 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:25.197 15:54:48 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:25.197 15:54:48 -- common/autotest_common.sh@914 -- # local i=0 00:08:25.197 15:54:48 -- common/autotest_common.sh@915 -- # local force 00:08:25.197 15:54:48 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:25.197 15:54:48 -- common/autotest_common.sh@918 -- # force=-F 00:08:25.197 15:54:48 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:25.197 mke2fs 1.47.0 (5-Feb-2023) 00:08:25.459 Discarding device blocks: 0/522240 done 00:08:25.459 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:25.459 Filesystem UUID: 55f3b8f2-d0b5-477f-a493-42526b0f15e9 00:08:25.459 Superblock backups stored on blocks: 00:08:25.459 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:25.459 00:08:25.459 Allocating group tables: 0/64 done 00:08:25.459 Writing inode tables: 0/64 done 00:08:25.459 Creating journal (8192 blocks): done 00:08:27.763 Writing superblocks and filesystem accounting information: 0/6428/64 done 00:08:27.763 00:08:27.763 15:54:51 -- common/autotest_common.sh@931 -- # return 0 00:08:27.763 15:54:51 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:34.315 15:54:57 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:34.315 15:54:57 -- target/filesystem.sh@25 -- # sync 00:08:34.315 15:54:57 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:34.315 15:54:57 -- target/filesystem.sh@27 -- # sync 00:08:34.315 15:54:57 -- target/filesystem.sh@29 -- # i=0 00:08:34.315 15:54:57 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:34.315 15:54:57 -- target/filesystem.sh@37 -- # kill -0 1483411 00:08:34.315 15:54:57 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:34.315 15:54:57 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:34.316 15:54:57 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:34.316 15:54:57 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:34.316 00:08:34.316 real 0m8.620s 00:08:34.316 user 0m0.022s 00:08:34.316 sys 0m0.053s 00:08:34.316 15:54:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:34.316 15:54:57 -- common/autotest_common.sh@10 -- # set +x 00:08:34.316 ************************************ 00:08:34.316 END TEST filesystem_ext4 00:08:34.316 ************************************ 00:08:34.316 15:54:57 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:34.316 15:54:57 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:34.316 15:54:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:34.316 15:54:57 -- common/autotest_common.sh@10 -- # set +x 00:08:34.316 ************************************ 00:08:34.316 START TEST filesystem_btrfs 00:08:34.316 ************************************ 00:08:34.316 15:54:57 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:34.316 15:54:57 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:34.316 15:54:57 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:34.316 15:54:57 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:34.316 15:54:57 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:34.316 15:54:57 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:34.316 15:54:57 -- common/autotest_common.sh@914 -- # local i=0 00:08:34.316 15:54:57 -- common/autotest_common.sh@915 -- # local force 00:08:34.316 15:54:57 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:34.316 15:54:57 -- common/autotest_common.sh@920 -- # force=-f 00:08:34.316 15:54:57 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:34.316 btrfs-progs v6.8.1 00:08:34.316 See https://btrfs.readthedocs.io for more information. 00:08:34.316 00:08:34.316 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:34.316 NOTE: several default settings have changed in version 5.15, please make sure 00:08:34.316 this does not affect your deployments: 00:08:34.316 - DUP for metadata (-m dup) 00:08:34.316 - enabled no-holes (-O no-holes) 00:08:34.316 - enabled free-space-tree (-R free-space-tree) 00:08:34.316 00:08:34.316 Label: (null) 00:08:34.316 UUID: 465580c9-829c-4b91-ad08-06524eaa344d 00:08:34.316 Node size: 16384 00:08:34.316 Sector size: 4096 (CPU page size: 4096) 00:08:34.316 Filesystem size: 510.00MiB 00:08:34.316 Block group profiles: 00:08:34.316 Data: single 8.00MiB 00:08:34.316 Metadata: DUP 32.00MiB 00:08:34.316 System: DUP 8.00MiB 00:08:34.316 SSD detected: yes 00:08:34.316 Zoned device: no 00:08:34.316 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:34.316 Checksum: crc32c 00:08:34.316 Number of devices: 1 00:08:34.316 Devices: 00:08:34.316 ID SIZE PATH 00:08:34.316 1 510.00MiB /dev/nvme0n1p1 00:08:34.316 00:08:34.316 15:54:57 -- common/autotest_common.sh@931 -- # return 0 00:08:34.316 15:54:57 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:34.574 15:54:57 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:34.574 15:54:57 -- target/filesystem.sh@25 -- # sync 00:08:34.574 15:54:57 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:34.574 15:54:57 -- target/filesystem.sh@27 -- # sync 00:08:34.574 15:54:57 -- target/filesystem.sh@29 -- # i=0 00:08:34.574 15:54:57 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:34.574 15:54:57 -- target/filesystem.sh@37 -- # kill -0 1483411 00:08:34.574 15:54:57 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:34.574 15:54:57 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:34.574 15:54:58 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:34.574 15:54:58 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:34.574 00:08:34.574 real 0m0.700s 00:08:34.574 user 0m0.018s 00:08:34.574 sys 0m0.096s 00:08:34.574 15:54:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:34.574 15:54:58 -- common/autotest_common.sh@10 -- # set +x 00:08:34.574 ************************************ 00:08:34.574 END TEST filesystem_btrfs 00:08:34.574 ************************************ 00:08:34.574 15:54:58 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:34.574 15:54:58 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:34.574 15:54:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:34.574 15:54:58 -- common/autotest_common.sh@10 -- # set +x 00:08:34.574 ************************************ 00:08:34.574 START TEST filesystem_xfs 00:08:34.574 ************************************ 00:08:34.574 15:54:58 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:34.574 15:54:58 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:34.574 15:54:58 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:34.574 15:54:58 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:34.574 15:54:58 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:34.574 15:54:58 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:34.574 15:54:58 -- common/autotest_common.sh@914 -- # local i=0 00:08:34.574 15:54:58 -- common/autotest_common.sh@915 -- # local force 00:08:34.574 15:54:58 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:34.574 15:54:58 -- common/autotest_common.sh@920 -- # force=-f 00:08:34.574 15:54:58 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:34.574 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:34.574 = sectsz=512 attr=2, projid32bit=1 00:08:34.574 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:34.574 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:34.574 data = bsize=4096 blocks=130560, imaxpct=25 00:08:34.574 = sunit=0 swidth=0 blks 00:08:34.574 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:34.574 log =internal log bsize=4096 blocks=16384, version=2 00:08:34.574 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:34.574 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:35.506 Discarding blocks...Done. 00:08:35.506 15:54:58 -- common/autotest_common.sh@931 -- # return 0 00:08:35.506 15:54:58 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:37.403 15:55:00 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:37.403 15:55:00 -- target/filesystem.sh@25 -- # sync 00:08:37.403 15:55:00 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:37.403 15:55:00 -- target/filesystem.sh@27 -- # sync 00:08:37.403 15:55:00 -- target/filesystem.sh@29 -- # i=0 00:08:37.403 15:55:00 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:37.403 15:55:00 -- target/filesystem.sh@37 -- # kill -0 1483411 00:08:37.403 15:55:00 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:37.403 15:55:00 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:37.403 15:55:00 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:37.403 15:55:00 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:37.403 00:08:37.403 real 0m2.698s 00:08:37.403 user 0m0.025s 00:08:37.403 sys 0m0.047s 00:08:37.403 15:55:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:37.403 15:55:00 -- common/autotest_common.sh@10 -- # set +x 00:08:37.403 ************************************ 00:08:37.403 END TEST filesystem_xfs 00:08:37.403 ************************************ 00:08:37.403 15:55:00 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:37.403 15:55:00 -- target/filesystem.sh@93 -- # sync 00:08:37.403 15:55:00 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:37.660 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.660 15:55:01 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:37.660 15:55:01 -- common/autotest_common.sh@1208 -- # local i=0 00:08:37.660 15:55:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:37.660 15:55:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:37.660 15:55:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:37.660 15:55:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:37.660 15:55:01 -- common/autotest_common.sh@1220 -- # return 0 00:08:37.660 15:55:01 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:37.660 15:55:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:37.660 15:55:01 -- common/autotest_common.sh@10 -- # set +x 00:08:37.660 15:55:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:37.660 15:55:01 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:37.660 15:55:01 -- target/filesystem.sh@101 -- # killprocess 1483411 00:08:37.660 15:55:01 -- common/autotest_common.sh@936 -- # '[' -z 1483411 ']' 00:08:37.660 15:55:01 -- common/autotest_common.sh@940 -- # kill -0 1483411 00:08:37.660 15:55:01 -- common/autotest_common.sh@941 -- # uname 00:08:37.660 15:55:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:37.660 15:55:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1483411 00:08:37.660 15:55:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:37.660 15:55:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:37.660 15:55:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1483411' 00:08:37.660 killing process with pid 1483411 00:08:37.660 15:55:01 -- common/autotest_common.sh@955 -- # kill 1483411 00:08:37.660 15:55:01 -- common/autotest_common.sh@960 -- # wait 1483411 00:08:38.226 15:55:01 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:38.226 00:08:38.226 real 0m18.679s 00:08:38.226 user 1m12.515s 00:08:38.226 sys 0m2.243s 00:08:38.226 15:55:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:38.226 15:55:01 -- common/autotest_common.sh@10 -- # set +x 00:08:38.226 ************************************ 00:08:38.226 END TEST nvmf_filesystem_no_in_capsule 00:08:38.226 ************************************ 00:08:38.226 15:55:01 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:38.226 15:55:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:38.226 15:55:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:38.226 15:55:01 -- common/autotest_common.sh@10 -- # set +x 00:08:38.226 ************************************ 00:08:38.226 START TEST nvmf_filesystem_in_capsule 00:08:38.226 ************************************ 00:08:38.226 15:55:01 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:38.226 15:55:01 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:38.226 15:55:01 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:38.226 15:55:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:38.226 15:55:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:38.226 15:55:01 -- common/autotest_common.sh@10 -- # set +x 00:08:38.226 15:55:01 -- nvmf/common.sh@469 -- # nvmfpid=1485964 00:08:38.226 15:55:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:38.226 15:55:01 -- nvmf/common.sh@470 -- # waitforlisten 1485964 00:08:38.226 15:55:01 -- common/autotest_common.sh@829 -- # '[' -z 1485964 ']' 00:08:38.226 15:55:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:38.226 15:55:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:38.226 15:55:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:38.226 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:38.226 15:55:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:38.226 15:55:01 -- common/autotest_common.sh@10 -- # set +x 00:08:38.226 [2024-11-18 15:55:01.645869] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:38.226 [2024-11-18 15:55:01.645971] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:38.226 EAL: No free 2048 kB hugepages reported on node 1 00:08:38.226 [2024-11-18 15:55:01.714279] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:38.226 [2024-11-18 15:55:01.804172] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:38.226 [2024-11-18 15:55:01.804334] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:38.226 [2024-11-18 15:55:01.804352] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:38.226 [2024-11-18 15:55:01.804365] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:38.226 [2024-11-18 15:55:01.804595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:38.226 [2024-11-18 15:55:01.804667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:38.226 [2024-11-18 15:55:01.804707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:38.226 [2024-11-18 15:55:01.804711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:39.160 15:55:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:39.160 15:55:02 -- common/autotest_common.sh@862 -- # return 0 00:08:39.160 15:55:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:39.160 15:55:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:39.160 15:55:02 -- common/autotest_common.sh@10 -- # set +x 00:08:39.160 15:55:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:39.160 15:55:02 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:39.160 15:55:02 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:39.160 15:55:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.160 15:55:02 -- common/autotest_common.sh@10 -- # set +x 00:08:39.160 [2024-11-18 15:55:02.651386] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:39.160 15:55:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.160 15:55:02 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:39.160 15:55:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.160 15:55:02 -- common/autotest_common.sh@10 -- # set +x 00:08:39.418 Malloc1 00:08:39.418 15:55:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.418 15:55:02 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:39.418 15:55:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.418 15:55:02 -- common/autotest_common.sh@10 -- # set +x 00:08:39.418 15:55:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.418 15:55:02 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:39.418 15:55:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.418 15:55:02 -- common/autotest_common.sh@10 -- # set +x 00:08:39.418 15:55:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.418 15:55:02 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:39.418 15:55:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.418 15:55:02 -- common/autotest_common.sh@10 -- # set +x 00:08:39.418 [2024-11-18 15:55:02.835665] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:39.418 15:55:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.418 15:55:02 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:39.418 15:55:02 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:39.418 15:55:02 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:39.418 15:55:02 -- common/autotest_common.sh@1369 -- # local bs 00:08:39.418 15:55:02 -- common/autotest_common.sh@1370 -- # local nb 00:08:39.418 15:55:02 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:39.418 15:55:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.418 15:55:02 -- common/autotest_common.sh@10 -- # set +x 00:08:39.418 15:55:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.418 15:55:02 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:39.418 { 00:08:39.418 "name": "Malloc1", 00:08:39.418 "aliases": [ 00:08:39.418 "230ae2be-dc6e-40ff-8538-423573bcd7ea" 00:08:39.418 ], 00:08:39.418 "product_name": "Malloc disk", 00:08:39.418 "block_size": 512, 00:08:39.418 "num_blocks": 1048576, 00:08:39.418 "uuid": "230ae2be-dc6e-40ff-8538-423573bcd7ea", 00:08:39.418 "assigned_rate_limits": { 00:08:39.418 "rw_ios_per_sec": 0, 00:08:39.418 "rw_mbytes_per_sec": 0, 00:08:39.418 "r_mbytes_per_sec": 0, 00:08:39.418 "w_mbytes_per_sec": 0 00:08:39.418 }, 00:08:39.418 "claimed": true, 00:08:39.418 "claim_type": "exclusive_write", 00:08:39.418 "zoned": false, 00:08:39.418 "supported_io_types": { 00:08:39.418 "read": true, 00:08:39.418 "write": true, 00:08:39.418 "unmap": true, 00:08:39.418 "write_zeroes": true, 00:08:39.418 "flush": true, 00:08:39.418 "reset": true, 00:08:39.418 "compare": false, 00:08:39.418 "compare_and_write": false, 00:08:39.418 "abort": true, 00:08:39.418 "nvme_admin": false, 00:08:39.418 "nvme_io": false 00:08:39.418 }, 00:08:39.418 "memory_domains": [ 00:08:39.418 { 00:08:39.418 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:39.418 "dma_device_type": 2 00:08:39.418 } 00:08:39.418 ], 00:08:39.418 "driver_specific": {} 00:08:39.418 } 00:08:39.418 ]' 00:08:39.418 15:55:02 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:39.418 15:55:02 -- common/autotest_common.sh@1372 -- # bs=512 00:08:39.418 15:55:02 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:39.418 15:55:02 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:39.418 15:55:02 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:39.418 15:55:02 -- common/autotest_common.sh@1377 -- # echo 512 00:08:39.418 15:55:02 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:39.418 15:55:02 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:39.983 15:55:03 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:39.983 15:55:03 -- common/autotest_common.sh@1187 -- # local i=0 00:08:39.983 15:55:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:39.983 15:55:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:39.983 15:55:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:42.508 15:55:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:42.508 15:55:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:42.508 15:55:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:42.508 15:55:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:42.508 15:55:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:42.508 15:55:05 -- common/autotest_common.sh@1197 -- # return 0 00:08:42.508 15:55:05 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:42.508 15:55:05 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:42.508 15:55:05 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:42.508 15:55:05 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:42.508 15:55:05 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:42.508 15:55:05 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:42.508 15:55:05 -- setup/common.sh@80 -- # echo 536870912 00:08:42.508 15:55:05 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:42.508 15:55:05 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:42.508 15:55:05 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:42.508 15:55:05 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:42.508 15:55:05 -- target/filesystem.sh@69 -- # partprobe 00:08:42.765 15:55:06 -- target/filesystem.sh@70 -- # sleep 1 00:08:44.138 15:55:07 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:44.138 15:55:07 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:44.138 15:55:07 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:44.138 15:55:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:44.138 15:55:07 -- common/autotest_common.sh@10 -- # set +x 00:08:44.138 ************************************ 00:08:44.138 START TEST filesystem_in_capsule_ext4 00:08:44.138 ************************************ 00:08:44.138 15:55:07 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:44.138 15:55:07 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:44.138 15:55:07 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:44.138 15:55:07 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:44.138 15:55:07 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:44.138 15:55:07 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:44.138 15:55:07 -- common/autotest_common.sh@914 -- # local i=0 00:08:44.138 15:55:07 -- common/autotest_common.sh@915 -- # local force 00:08:44.138 15:55:07 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:44.138 15:55:07 -- common/autotest_common.sh@918 -- # force=-F 00:08:44.138 15:55:07 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:44.138 mke2fs 1.47.0 (5-Feb-2023) 00:08:44.138 Discarding device blocks: 0/522240 done 00:08:44.138 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:44.138 Filesystem UUID: 7d43795a-b7c2-4056-a409-0d0412fa76f6 00:08:44.138 Superblock backups stored on blocks: 00:08:44.138 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:44.138 00:08:44.138 Allocating group tables: 0/64 done 00:08:44.138 Writing inode tables: 0/64 done 00:08:44.138 Creating journal (8192 blocks): done 00:08:46.443 Writing superblocks and filesystem accounting information: 0/64 done 00:08:46.443 00:08:46.443 15:55:09 -- common/autotest_common.sh@931 -- # return 0 00:08:46.443 15:55:09 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:52.992 15:55:15 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:52.992 15:55:15 -- target/filesystem.sh@25 -- # sync 00:08:52.992 15:55:15 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:52.992 15:55:15 -- target/filesystem.sh@27 -- # sync 00:08:52.992 15:55:15 -- target/filesystem.sh@29 -- # i=0 00:08:52.992 15:55:15 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:52.992 15:55:15 -- target/filesystem.sh@37 -- # kill -0 1485964 00:08:52.992 15:55:15 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:52.992 15:55:15 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:52.992 15:55:15 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:52.992 15:55:15 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:52.992 00:08:52.992 real 0m8.469s 00:08:52.992 user 0m0.012s 00:08:52.992 sys 0m0.077s 00:08:52.992 15:55:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:52.992 15:55:15 -- common/autotest_common.sh@10 -- # set +x 00:08:52.992 ************************************ 00:08:52.992 END TEST filesystem_in_capsule_ext4 00:08:52.992 ************************************ 00:08:52.992 15:55:15 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:52.992 15:55:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:52.992 15:55:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:52.992 15:55:15 -- common/autotest_common.sh@10 -- # set +x 00:08:52.992 ************************************ 00:08:52.992 START TEST filesystem_in_capsule_btrfs 00:08:52.992 ************************************ 00:08:52.992 15:55:15 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:52.992 15:55:15 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:52.992 15:55:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:52.992 15:55:15 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:52.992 15:55:15 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:52.992 15:55:15 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:52.992 15:55:15 -- common/autotest_common.sh@914 -- # local i=0 00:08:52.992 15:55:15 -- common/autotest_common.sh@915 -- # local force 00:08:52.992 15:55:15 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:52.992 15:55:15 -- common/autotest_common.sh@920 -- # force=-f 00:08:52.992 15:55:15 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:52.992 btrfs-progs v6.8.1 00:08:52.992 See https://btrfs.readthedocs.io for more information. 00:08:52.992 00:08:52.992 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:52.992 NOTE: several default settings have changed in version 5.15, please make sure 00:08:52.992 this does not affect your deployments: 00:08:52.992 - DUP for metadata (-m dup) 00:08:52.992 - enabled no-holes (-O no-holes) 00:08:52.992 - enabled free-space-tree (-R free-space-tree) 00:08:52.992 00:08:52.992 Label: (null) 00:08:52.992 UUID: a0672e3a-cb06-40f3-bb0f-0d7cbda6b6a2 00:08:52.992 Node size: 16384 00:08:52.992 Sector size: 4096 (CPU page size: 4096) 00:08:52.992 Filesystem size: 510.00MiB 00:08:52.992 Block group profiles: 00:08:52.992 Data: single 8.00MiB 00:08:52.992 Metadata: DUP 32.00MiB 00:08:52.992 System: DUP 8.00MiB 00:08:52.992 SSD detected: yes 00:08:52.992 Zoned device: no 00:08:52.992 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:52.992 Checksum: crc32c 00:08:52.992 Number of devices: 1 00:08:52.992 Devices: 00:08:52.992 ID SIZE PATH 00:08:52.992 1 510.00MiB /dev/nvme0n1p1 00:08:52.992 00:08:52.992 15:55:16 -- common/autotest_common.sh@931 -- # return 0 00:08:52.992 15:55:16 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:52.992 15:55:16 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:52.992 15:55:16 -- target/filesystem.sh@25 -- # sync 00:08:52.992 15:55:16 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:52.992 15:55:16 -- target/filesystem.sh@27 -- # sync 00:08:52.992 15:55:16 -- target/filesystem.sh@29 -- # i=0 00:08:52.992 15:55:16 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:52.992 15:55:16 -- target/filesystem.sh@37 -- # kill -0 1485964 00:08:52.992 15:55:16 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:52.992 15:55:16 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:52.992 15:55:16 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:52.992 15:55:16 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:52.992 00:08:52.992 real 0m0.572s 00:08:52.992 user 0m0.013s 00:08:52.992 sys 0m0.098s 00:08:52.992 15:55:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:52.992 15:55:16 -- common/autotest_common.sh@10 -- # set +x 00:08:52.992 ************************************ 00:08:52.992 END TEST filesystem_in_capsule_btrfs 00:08:52.992 ************************************ 00:08:52.992 15:55:16 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:52.992 15:55:16 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:52.992 15:55:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:52.992 15:55:16 -- common/autotest_common.sh@10 -- # set +x 00:08:52.992 ************************************ 00:08:52.992 START TEST filesystem_in_capsule_xfs 00:08:52.992 ************************************ 00:08:52.992 15:55:16 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:52.992 15:55:16 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:52.992 15:55:16 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:52.992 15:55:16 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:52.992 15:55:16 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:52.992 15:55:16 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:52.992 15:55:16 -- common/autotest_common.sh@914 -- # local i=0 00:08:52.992 15:55:16 -- common/autotest_common.sh@915 -- # local force 00:08:52.992 15:55:16 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:52.992 15:55:16 -- common/autotest_common.sh@920 -- # force=-f 00:08:52.992 15:55:16 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:52.992 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:52.992 = sectsz=512 attr=2, projid32bit=1 00:08:52.992 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:52.993 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:52.993 data = bsize=4096 blocks=130560, imaxpct=25 00:08:52.993 = sunit=0 swidth=0 blks 00:08:52.993 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:52.993 log =internal log bsize=4096 blocks=16384, version=2 00:08:52.993 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:52.993 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:54.360 Discarding blocks...Done. 00:08:54.360 15:55:17 -- common/autotest_common.sh@931 -- # return 0 00:08:54.360 15:55:17 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:55.732 15:55:19 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:55.732 15:55:19 -- target/filesystem.sh@25 -- # sync 00:08:55.732 15:55:19 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:55.732 15:55:19 -- target/filesystem.sh@27 -- # sync 00:08:55.732 15:55:19 -- target/filesystem.sh@29 -- # i=0 00:08:55.732 15:55:19 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:55.732 15:55:19 -- target/filesystem.sh@37 -- # kill -0 1485964 00:08:55.732 15:55:19 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:55.732 15:55:19 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:55.732 15:55:19 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:55.732 15:55:19 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:55.732 00:08:55.732 real 0m2.852s 00:08:55.732 user 0m0.013s 00:08:55.732 sys 0m0.062s 00:08:55.732 15:55:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:55.732 15:55:19 -- common/autotest_common.sh@10 -- # set +x 00:08:55.732 ************************************ 00:08:55.732 END TEST filesystem_in_capsule_xfs 00:08:55.732 ************************************ 00:08:55.732 15:55:19 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:55.989 15:55:19 -- target/filesystem.sh@93 -- # sync 00:08:55.989 15:55:19 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:55.989 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.989 15:55:19 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:55.989 15:55:19 -- common/autotest_common.sh@1208 -- # local i=0 00:08:55.989 15:55:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:55.989 15:55:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:55.989 15:55:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:55.989 15:55:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:55.989 15:55:19 -- common/autotest_common.sh@1220 -- # return 0 00:08:55.989 15:55:19 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:55.989 15:55:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.989 15:55:19 -- common/autotest_common.sh@10 -- # set +x 00:08:55.989 15:55:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.989 15:55:19 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:55.989 15:55:19 -- target/filesystem.sh@101 -- # killprocess 1485964 00:08:55.989 15:55:19 -- common/autotest_common.sh@936 -- # '[' -z 1485964 ']' 00:08:55.989 15:55:19 -- common/autotest_common.sh@940 -- # kill -0 1485964 00:08:55.989 15:55:19 -- common/autotest_common.sh@941 -- # uname 00:08:55.989 15:55:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:55.989 15:55:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1485964 00:08:55.989 15:55:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:55.989 15:55:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:55.989 15:55:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1485964' 00:08:55.989 killing process with pid 1485964 00:08:55.989 15:55:19 -- common/autotest_common.sh@955 -- # kill 1485964 00:08:55.989 15:55:19 -- common/autotest_common.sh@960 -- # wait 1485964 00:08:56.554 15:55:19 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:56.554 00:08:56.554 real 0m18.357s 00:08:56.554 user 1m11.100s 00:08:56.554 sys 0m2.339s 00:08:56.554 15:55:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:56.554 15:55:19 -- common/autotest_common.sh@10 -- # set +x 00:08:56.554 ************************************ 00:08:56.554 END TEST nvmf_filesystem_in_capsule 00:08:56.554 ************************************ 00:08:56.554 15:55:19 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:56.554 15:55:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:56.554 15:55:19 -- nvmf/common.sh@116 -- # sync 00:08:56.554 15:55:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:56.554 15:55:19 -- nvmf/common.sh@119 -- # set +e 00:08:56.554 15:55:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:56.554 15:55:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:56.554 rmmod nvme_tcp 00:08:56.555 rmmod nvme_fabrics 00:08:56.555 rmmod nvme_keyring 00:08:56.555 15:55:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:56.555 15:55:20 -- nvmf/common.sh@123 -- # set -e 00:08:56.555 15:55:20 -- nvmf/common.sh@124 -- # return 0 00:08:56.555 15:55:20 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:56.555 15:55:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:56.555 15:55:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:56.555 15:55:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:56.555 15:55:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:56.555 15:55:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:56.555 15:55:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:56.555 15:55:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:56.555 15:55:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:59.086 15:55:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:59.086 00:08:59.086 real 0m41.863s 00:08:59.086 user 2m24.721s 00:08:59.086 sys 0m6.274s 00:08:59.086 15:55:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:59.086 15:55:22 -- common/autotest_common.sh@10 -- # set +x 00:08:59.086 ************************************ 00:08:59.086 END TEST nvmf_filesystem 00:08:59.086 ************************************ 00:08:59.086 15:55:22 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:59.086 15:55:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:59.086 15:55:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:59.086 15:55:22 -- common/autotest_common.sh@10 -- # set +x 00:08:59.086 ************************************ 00:08:59.086 START TEST nvmf_discovery 00:08:59.086 ************************************ 00:08:59.086 15:55:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:59.086 * Looking for test storage... 00:08:59.086 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:59.086 15:55:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:59.086 15:55:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:59.086 15:55:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:59.086 15:55:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:59.086 15:55:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:59.086 15:55:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:59.086 15:55:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:59.086 15:55:22 -- scripts/common.sh@335 -- # IFS=.-: 00:08:59.086 15:55:22 -- scripts/common.sh@335 -- # read -ra ver1 00:08:59.086 15:55:22 -- scripts/common.sh@336 -- # IFS=.-: 00:08:59.086 15:55:22 -- scripts/common.sh@336 -- # read -ra ver2 00:08:59.086 15:55:22 -- scripts/common.sh@337 -- # local 'op=<' 00:08:59.086 15:55:22 -- scripts/common.sh@339 -- # ver1_l=2 00:08:59.086 15:55:22 -- scripts/common.sh@340 -- # ver2_l=1 00:08:59.086 15:55:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:59.086 15:55:22 -- scripts/common.sh@343 -- # case "$op" in 00:08:59.086 15:55:22 -- scripts/common.sh@344 -- # : 1 00:08:59.086 15:55:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:59.086 15:55:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:59.086 15:55:22 -- scripts/common.sh@364 -- # decimal 1 00:08:59.086 15:55:22 -- scripts/common.sh@352 -- # local d=1 00:08:59.086 15:55:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:59.086 15:55:22 -- scripts/common.sh@354 -- # echo 1 00:08:59.086 15:55:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:59.086 15:55:22 -- scripts/common.sh@365 -- # decimal 2 00:08:59.086 15:55:22 -- scripts/common.sh@352 -- # local d=2 00:08:59.086 15:55:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:59.086 15:55:22 -- scripts/common.sh@354 -- # echo 2 00:08:59.086 15:55:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:59.086 15:55:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:59.086 15:55:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:59.086 15:55:22 -- scripts/common.sh@367 -- # return 0 00:08:59.086 15:55:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:59.086 15:55:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:59.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.086 --rc genhtml_branch_coverage=1 00:08:59.086 --rc genhtml_function_coverage=1 00:08:59.086 --rc genhtml_legend=1 00:08:59.086 --rc geninfo_all_blocks=1 00:08:59.086 --rc geninfo_unexecuted_blocks=1 00:08:59.086 00:08:59.086 ' 00:08:59.086 15:55:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:59.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.086 --rc genhtml_branch_coverage=1 00:08:59.086 --rc genhtml_function_coverage=1 00:08:59.086 --rc genhtml_legend=1 00:08:59.086 --rc geninfo_all_blocks=1 00:08:59.086 --rc geninfo_unexecuted_blocks=1 00:08:59.086 00:08:59.086 ' 00:08:59.086 15:55:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:59.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.086 --rc genhtml_branch_coverage=1 00:08:59.086 --rc genhtml_function_coverage=1 00:08:59.086 --rc genhtml_legend=1 00:08:59.086 --rc geninfo_all_blocks=1 00:08:59.086 --rc geninfo_unexecuted_blocks=1 00:08:59.086 00:08:59.086 ' 00:08:59.086 15:55:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:59.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.086 --rc genhtml_branch_coverage=1 00:08:59.086 --rc genhtml_function_coverage=1 00:08:59.086 --rc genhtml_legend=1 00:08:59.086 --rc geninfo_all_blocks=1 00:08:59.086 --rc geninfo_unexecuted_blocks=1 00:08:59.086 00:08:59.086 ' 00:08:59.086 15:55:22 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:59.086 15:55:22 -- nvmf/common.sh@7 -- # uname -s 00:08:59.086 15:55:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:59.086 15:55:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:59.086 15:55:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:59.086 15:55:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:59.086 15:55:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:59.086 15:55:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:59.086 15:55:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:59.086 15:55:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:59.086 15:55:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:59.086 15:55:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:59.086 15:55:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:59.086 15:55:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:59.086 15:55:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:59.086 15:55:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:59.086 15:55:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:59.086 15:55:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:59.086 15:55:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:59.086 15:55:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:59.086 15:55:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:59.086 15:55:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.086 15:55:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.086 15:55:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.086 15:55:22 -- paths/export.sh@5 -- # export PATH 00:08:59.086 15:55:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.086 15:55:22 -- nvmf/common.sh@46 -- # : 0 00:08:59.086 15:55:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:59.086 15:55:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:59.086 15:55:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:59.086 15:55:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:59.086 15:55:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:59.086 15:55:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:59.086 15:55:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:59.086 15:55:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:59.086 15:55:22 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:59.086 15:55:22 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:59.086 15:55:22 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:59.086 15:55:22 -- target/discovery.sh@15 -- # hash nvme 00:08:59.086 15:55:22 -- target/discovery.sh@20 -- # nvmftestinit 00:08:59.086 15:55:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:59.087 15:55:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:59.087 15:55:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:59.087 15:55:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:59.087 15:55:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:59.087 15:55:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:59.087 15:55:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:59.087 15:55:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:59.087 15:55:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:59.087 15:55:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:59.087 15:55:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:59.087 15:55:22 -- common/autotest_common.sh@10 -- # set +x 00:09:00.989 15:55:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:00.989 15:55:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:00.989 15:55:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:00.989 15:55:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:00.989 15:55:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:00.989 15:55:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:00.989 15:55:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:00.989 15:55:24 -- nvmf/common.sh@294 -- # net_devs=() 00:09:00.989 15:55:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:00.989 15:55:24 -- nvmf/common.sh@295 -- # e810=() 00:09:00.989 15:55:24 -- nvmf/common.sh@295 -- # local -ga e810 00:09:00.989 15:55:24 -- nvmf/common.sh@296 -- # x722=() 00:09:00.989 15:55:24 -- nvmf/common.sh@296 -- # local -ga x722 00:09:00.989 15:55:24 -- nvmf/common.sh@297 -- # mlx=() 00:09:00.989 15:55:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:00.989 15:55:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:00.989 15:55:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:00.989 15:55:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:00.989 15:55:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:00.989 15:55:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:00.989 15:55:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:00.989 15:55:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:00.989 15:55:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:00.989 15:55:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:00.989 15:55:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:00.989 15:55:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:00.990 15:55:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:00.990 15:55:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:00.990 15:55:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:00.990 15:55:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:00.990 15:55:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:00.990 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:00.990 15:55:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:00.990 15:55:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:00.990 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:00.990 15:55:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:00.990 15:55:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:00.990 15:55:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:00.990 15:55:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:00.990 15:55:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:00.990 15:55:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:00.990 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:00.990 15:55:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:00.990 15:55:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:00.990 15:55:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:00.990 15:55:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:00.990 15:55:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:00.990 15:55:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:00.990 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:00.990 15:55:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:00.990 15:55:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:00.990 15:55:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:00.990 15:55:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:00.990 15:55:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:00.990 15:55:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:00.990 15:55:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:00.990 15:55:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:00.990 15:55:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:00.990 15:55:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:00.990 15:55:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:00.990 15:55:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:00.990 15:55:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:00.990 15:55:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:00.990 15:55:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:00.990 15:55:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:00.990 15:55:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:00.990 15:55:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:00.990 15:55:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:00.990 15:55:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:00.990 15:55:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:00.990 15:55:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:00.990 15:55:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:00.990 15:55:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:00.990 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:00.990 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.343 ms 00:09:00.990 00:09:00.990 --- 10.0.0.2 ping statistics --- 00:09:00.990 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:00.990 rtt min/avg/max/mdev = 0.343/0.343/0.343/0.000 ms 00:09:00.990 15:55:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:00.990 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:00.990 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.170 ms 00:09:00.990 00:09:00.990 --- 10.0.0.1 ping statistics --- 00:09:00.990 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:00.990 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:09:00.990 15:55:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:00.990 15:55:24 -- nvmf/common.sh@410 -- # return 0 00:09:00.990 15:55:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:00.990 15:55:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:00.990 15:55:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:00.990 15:55:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:00.990 15:55:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:00.990 15:55:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:00.990 15:55:24 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:09:00.990 15:55:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:00.990 15:55:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:00.990 15:55:24 -- common/autotest_common.sh@10 -- # set +x 00:09:00.990 15:55:24 -- nvmf/common.sh@469 -- # nvmfpid=1490329 00:09:00.990 15:55:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:00.990 15:55:24 -- nvmf/common.sh@470 -- # waitforlisten 1490329 00:09:00.990 15:55:24 -- common/autotest_common.sh@829 -- # '[' -z 1490329 ']' 00:09:00.990 15:55:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:00.990 15:55:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:00.990 15:55:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:00.990 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:00.990 15:55:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:00.990 15:55:24 -- common/autotest_common.sh@10 -- # set +x 00:09:00.990 [2024-11-18 15:55:24.562732] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:00.990 [2024-11-18 15:55:24.562816] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:01.248 EAL: No free 2048 kB hugepages reported on node 1 00:09:01.248 [2024-11-18 15:55:24.630040] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:01.248 [2024-11-18 15:55:24.718961] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:01.248 [2024-11-18 15:55:24.719111] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:01.248 [2024-11-18 15:55:24.719130] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:01.248 [2024-11-18 15:55:24.719143] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:01.248 [2024-11-18 15:55:24.719224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:01.248 [2024-11-18 15:55:24.719241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:01.248 [2024-11-18 15:55:24.719267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:01.248 [2024-11-18 15:55:24.719269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:02.181 15:55:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:02.181 15:55:25 -- common/autotest_common.sh@862 -- # return 0 00:09:02.181 15:55:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:02.181 15:55:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:02.181 15:55:25 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 [2024-11-18 15:55:25.623509] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@26 -- # seq 1 4 00:09:02.181 15:55:25 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:02.181 15:55:25 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 Null1 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 [2024-11-18 15:55:25.667834] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:02.181 15:55:25 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 Null2 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:02.181 15:55:25 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 Null3 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:02.181 15:55:25 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 Null4 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.181 15:55:25 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:09:02.181 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.181 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.181 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.182 15:55:25 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:09:02.182 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.182 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.439 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.439 15:55:25 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:09:02.439 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.440 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.440 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.440 15:55:25 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:09:02.440 00:09:02.440 Discovery Log Number of Records 6, Generation counter 6 00:09:02.440 =====Discovery Log Entry 0====== 00:09:02.440 trtype: tcp 00:09:02.440 adrfam: ipv4 00:09:02.440 subtype: current discovery subsystem 00:09:02.440 treq: not required 00:09:02.440 portid: 0 00:09:02.440 trsvcid: 4420 00:09:02.440 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:02.440 traddr: 10.0.0.2 00:09:02.440 eflags: explicit discovery connections, duplicate discovery information 00:09:02.440 sectype: none 00:09:02.440 =====Discovery Log Entry 1====== 00:09:02.440 trtype: tcp 00:09:02.440 adrfam: ipv4 00:09:02.440 subtype: nvme subsystem 00:09:02.440 treq: not required 00:09:02.440 portid: 0 00:09:02.440 trsvcid: 4420 00:09:02.440 subnqn: nqn.2016-06.io.spdk:cnode1 00:09:02.440 traddr: 10.0.0.2 00:09:02.440 eflags: none 00:09:02.440 sectype: none 00:09:02.440 =====Discovery Log Entry 2====== 00:09:02.440 trtype: tcp 00:09:02.440 adrfam: ipv4 00:09:02.440 subtype: nvme subsystem 00:09:02.440 treq: not required 00:09:02.440 portid: 0 00:09:02.440 trsvcid: 4420 00:09:02.440 subnqn: nqn.2016-06.io.spdk:cnode2 00:09:02.440 traddr: 10.0.0.2 00:09:02.440 eflags: none 00:09:02.440 sectype: none 00:09:02.440 =====Discovery Log Entry 3====== 00:09:02.440 trtype: tcp 00:09:02.440 adrfam: ipv4 00:09:02.440 subtype: nvme subsystem 00:09:02.440 treq: not required 00:09:02.440 portid: 0 00:09:02.440 trsvcid: 4420 00:09:02.440 subnqn: nqn.2016-06.io.spdk:cnode3 00:09:02.440 traddr: 10.0.0.2 00:09:02.440 eflags: none 00:09:02.440 sectype: none 00:09:02.440 =====Discovery Log Entry 4====== 00:09:02.440 trtype: tcp 00:09:02.440 adrfam: ipv4 00:09:02.440 subtype: nvme subsystem 00:09:02.440 treq: not required 00:09:02.440 portid: 0 00:09:02.440 trsvcid: 4420 00:09:02.440 subnqn: nqn.2016-06.io.spdk:cnode4 00:09:02.440 traddr: 10.0.0.2 00:09:02.440 eflags: none 00:09:02.440 sectype: none 00:09:02.440 =====Discovery Log Entry 5====== 00:09:02.440 trtype: tcp 00:09:02.440 adrfam: ipv4 00:09:02.440 subtype: discovery subsystem referral 00:09:02.440 treq: not required 00:09:02.440 portid: 0 00:09:02.440 trsvcid: 4430 00:09:02.440 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:02.440 traddr: 10.0.0.2 00:09:02.440 eflags: none 00:09:02.440 sectype: none 00:09:02.440 15:55:25 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:09:02.440 Perform nvmf subsystem discovery via RPC 00:09:02.440 15:55:25 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:09:02.440 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.440 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.440 [2024-11-18 15:55:25.916446] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:09:02.440 [ 00:09:02.440 { 00:09:02.440 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:09:02.440 "subtype": "Discovery", 00:09:02.440 "listen_addresses": [ 00:09:02.440 { 00:09:02.440 "transport": "TCP", 00:09:02.440 "trtype": "TCP", 00:09:02.440 "adrfam": "IPv4", 00:09:02.440 "traddr": "10.0.0.2", 00:09:02.440 "trsvcid": "4420" 00:09:02.440 } 00:09:02.440 ], 00:09:02.440 "allow_any_host": true, 00:09:02.440 "hosts": [] 00:09:02.440 }, 00:09:02.440 { 00:09:02.440 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:09:02.440 "subtype": "NVMe", 00:09:02.440 "listen_addresses": [ 00:09:02.440 { 00:09:02.440 "transport": "TCP", 00:09:02.440 "trtype": "TCP", 00:09:02.440 "adrfam": "IPv4", 00:09:02.440 "traddr": "10.0.0.2", 00:09:02.440 "trsvcid": "4420" 00:09:02.440 } 00:09:02.440 ], 00:09:02.440 "allow_any_host": true, 00:09:02.440 "hosts": [], 00:09:02.440 "serial_number": "SPDK00000000000001", 00:09:02.440 "model_number": "SPDK bdev Controller", 00:09:02.440 "max_namespaces": 32, 00:09:02.440 "min_cntlid": 1, 00:09:02.440 "max_cntlid": 65519, 00:09:02.440 "namespaces": [ 00:09:02.440 { 00:09:02.440 "nsid": 1, 00:09:02.440 "bdev_name": "Null1", 00:09:02.440 "name": "Null1", 00:09:02.440 "nguid": "FA8670C7D5BD4AC48FE943EC6E4CA697", 00:09:02.440 "uuid": "fa8670c7-d5bd-4ac4-8fe9-43ec6e4ca697" 00:09:02.440 } 00:09:02.440 ] 00:09:02.440 }, 00:09:02.440 { 00:09:02.440 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:09:02.440 "subtype": "NVMe", 00:09:02.440 "listen_addresses": [ 00:09:02.440 { 00:09:02.440 "transport": "TCP", 00:09:02.440 "trtype": "TCP", 00:09:02.440 "adrfam": "IPv4", 00:09:02.440 "traddr": "10.0.0.2", 00:09:02.440 "trsvcid": "4420" 00:09:02.440 } 00:09:02.440 ], 00:09:02.440 "allow_any_host": true, 00:09:02.440 "hosts": [], 00:09:02.440 "serial_number": "SPDK00000000000002", 00:09:02.440 "model_number": "SPDK bdev Controller", 00:09:02.440 "max_namespaces": 32, 00:09:02.440 "min_cntlid": 1, 00:09:02.440 "max_cntlid": 65519, 00:09:02.440 "namespaces": [ 00:09:02.440 { 00:09:02.440 "nsid": 1, 00:09:02.440 "bdev_name": "Null2", 00:09:02.440 "name": "Null2", 00:09:02.440 "nguid": "C3D38CBACF374EFC8BC7C6798F6EFB5A", 00:09:02.440 "uuid": "c3d38cba-cf37-4efc-8bc7-c6798f6efb5a" 00:09:02.440 } 00:09:02.440 ] 00:09:02.440 }, 00:09:02.440 { 00:09:02.440 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:09:02.440 "subtype": "NVMe", 00:09:02.440 "listen_addresses": [ 00:09:02.440 { 00:09:02.440 "transport": "TCP", 00:09:02.440 "trtype": "TCP", 00:09:02.440 "adrfam": "IPv4", 00:09:02.440 "traddr": "10.0.0.2", 00:09:02.440 "trsvcid": "4420" 00:09:02.440 } 00:09:02.440 ], 00:09:02.440 "allow_any_host": true, 00:09:02.440 "hosts": [], 00:09:02.440 "serial_number": "SPDK00000000000003", 00:09:02.440 "model_number": "SPDK bdev Controller", 00:09:02.440 "max_namespaces": 32, 00:09:02.440 "min_cntlid": 1, 00:09:02.440 "max_cntlid": 65519, 00:09:02.440 "namespaces": [ 00:09:02.440 { 00:09:02.440 "nsid": 1, 00:09:02.440 "bdev_name": "Null3", 00:09:02.440 "name": "Null3", 00:09:02.440 "nguid": "817A60B44CAB4BEBABD065BFF11C4823", 00:09:02.440 "uuid": "817a60b4-4cab-4beb-abd0-65bff11c4823" 00:09:02.440 } 00:09:02.440 ] 00:09:02.440 }, 00:09:02.440 { 00:09:02.440 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:09:02.440 "subtype": "NVMe", 00:09:02.440 "listen_addresses": [ 00:09:02.440 { 00:09:02.440 "transport": "TCP", 00:09:02.440 "trtype": "TCP", 00:09:02.440 "adrfam": "IPv4", 00:09:02.440 "traddr": "10.0.0.2", 00:09:02.440 "trsvcid": "4420" 00:09:02.440 } 00:09:02.440 ], 00:09:02.440 "allow_any_host": true, 00:09:02.440 "hosts": [], 00:09:02.440 "serial_number": "SPDK00000000000004", 00:09:02.440 "model_number": "SPDK bdev Controller", 00:09:02.440 "max_namespaces": 32, 00:09:02.440 "min_cntlid": 1, 00:09:02.440 "max_cntlid": 65519, 00:09:02.440 "namespaces": [ 00:09:02.440 { 00:09:02.440 "nsid": 1, 00:09:02.440 "bdev_name": "Null4", 00:09:02.440 "name": "Null4", 00:09:02.440 "nguid": "77F442E50FA64F8998ABABB4C8158E28", 00:09:02.440 "uuid": "77f442e5-0fa6-4f89-98ab-abb4c8158e28" 00:09:02.440 } 00:09:02.440 ] 00:09:02.440 } 00:09:02.440 ] 00:09:02.440 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.440 15:55:25 -- target/discovery.sh@42 -- # seq 1 4 00:09:02.440 15:55:25 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:02.440 15:55:25 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:02.440 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.440 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.440 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.440 15:55:25 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:09:02.440 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.440 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.440 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.440 15:55:25 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:02.440 15:55:25 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:09:02.440 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.440 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.440 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.440 15:55:25 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:09:02.440 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.440 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.440 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.440 15:55:25 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:02.440 15:55:25 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:09:02.440 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.440 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.440 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.440 15:55:25 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:09:02.440 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.440 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.441 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.441 15:55:25 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:02.441 15:55:25 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:09:02.441 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.441 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.441 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.441 15:55:25 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:09:02.441 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.441 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.441 15:55:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.441 15:55:25 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:09:02.441 15:55:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.441 15:55:25 -- common/autotest_common.sh@10 -- # set +x 00:09:02.441 15:55:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.441 15:55:26 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:09:02.441 15:55:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.441 15:55:26 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:09:02.441 15:55:26 -- common/autotest_common.sh@10 -- # set +x 00:09:02.441 15:55:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.698 15:55:26 -- target/discovery.sh@49 -- # check_bdevs= 00:09:02.698 15:55:26 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:09:02.698 15:55:26 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:09:02.698 15:55:26 -- target/discovery.sh@57 -- # nvmftestfini 00:09:02.698 15:55:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:02.698 15:55:26 -- nvmf/common.sh@116 -- # sync 00:09:02.698 15:55:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:02.698 15:55:26 -- nvmf/common.sh@119 -- # set +e 00:09:02.698 15:55:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:02.698 15:55:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:02.698 rmmod nvme_tcp 00:09:02.698 rmmod nvme_fabrics 00:09:02.698 rmmod nvme_keyring 00:09:02.698 15:55:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:02.698 15:55:26 -- nvmf/common.sh@123 -- # set -e 00:09:02.698 15:55:26 -- nvmf/common.sh@124 -- # return 0 00:09:02.698 15:55:26 -- nvmf/common.sh@477 -- # '[' -n 1490329 ']' 00:09:02.698 15:55:26 -- nvmf/common.sh@478 -- # killprocess 1490329 00:09:02.698 15:55:26 -- common/autotest_common.sh@936 -- # '[' -z 1490329 ']' 00:09:02.698 15:55:26 -- common/autotest_common.sh@940 -- # kill -0 1490329 00:09:02.698 15:55:26 -- common/autotest_common.sh@941 -- # uname 00:09:02.698 15:55:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:02.698 15:55:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1490329 00:09:02.698 15:55:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:02.698 15:55:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:02.698 15:55:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1490329' 00:09:02.698 killing process with pid 1490329 00:09:02.698 15:55:26 -- common/autotest_common.sh@955 -- # kill 1490329 00:09:02.698 [2024-11-18 15:55:26.120804] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:09:02.698 15:55:26 -- common/autotest_common.sh@960 -- # wait 1490329 00:09:02.957 15:55:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:02.957 15:55:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:02.957 15:55:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:02.957 15:55:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:02.957 15:55:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:02.957 15:55:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:02.957 15:55:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:02.957 15:55:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:04.858 15:55:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:04.858 00:09:04.858 real 0m6.280s 00:09:04.858 user 0m7.592s 00:09:04.858 sys 0m1.981s 00:09:04.858 15:55:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:04.858 15:55:28 -- common/autotest_common.sh@10 -- # set +x 00:09:04.858 ************************************ 00:09:04.858 END TEST nvmf_discovery 00:09:04.858 ************************************ 00:09:04.858 15:55:28 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:09:04.858 15:55:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:04.858 15:55:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:04.858 15:55:28 -- common/autotest_common.sh@10 -- # set +x 00:09:04.858 ************************************ 00:09:04.858 START TEST nvmf_referrals 00:09:04.858 ************************************ 00:09:04.858 15:55:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:09:05.116 * Looking for test storage... 00:09:05.116 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:05.116 15:55:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:05.116 15:55:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:05.116 15:55:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:05.116 15:55:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:05.116 15:55:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:05.116 15:55:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:05.116 15:55:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:05.116 15:55:28 -- scripts/common.sh@335 -- # IFS=.-: 00:09:05.116 15:55:28 -- scripts/common.sh@335 -- # read -ra ver1 00:09:05.116 15:55:28 -- scripts/common.sh@336 -- # IFS=.-: 00:09:05.116 15:55:28 -- scripts/common.sh@336 -- # read -ra ver2 00:09:05.116 15:55:28 -- scripts/common.sh@337 -- # local 'op=<' 00:09:05.116 15:55:28 -- scripts/common.sh@339 -- # ver1_l=2 00:09:05.116 15:55:28 -- scripts/common.sh@340 -- # ver2_l=1 00:09:05.116 15:55:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:05.116 15:55:28 -- scripts/common.sh@343 -- # case "$op" in 00:09:05.116 15:55:28 -- scripts/common.sh@344 -- # : 1 00:09:05.116 15:55:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:05.116 15:55:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:05.116 15:55:28 -- scripts/common.sh@364 -- # decimal 1 00:09:05.116 15:55:28 -- scripts/common.sh@352 -- # local d=1 00:09:05.116 15:55:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:05.116 15:55:28 -- scripts/common.sh@354 -- # echo 1 00:09:05.116 15:55:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:05.116 15:55:28 -- scripts/common.sh@365 -- # decimal 2 00:09:05.116 15:55:28 -- scripts/common.sh@352 -- # local d=2 00:09:05.116 15:55:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:05.116 15:55:28 -- scripts/common.sh@354 -- # echo 2 00:09:05.116 15:55:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:05.116 15:55:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:05.116 15:55:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:05.116 15:55:28 -- scripts/common.sh@367 -- # return 0 00:09:05.116 15:55:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:05.116 15:55:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:05.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.116 --rc genhtml_branch_coverage=1 00:09:05.116 --rc genhtml_function_coverage=1 00:09:05.116 --rc genhtml_legend=1 00:09:05.116 --rc geninfo_all_blocks=1 00:09:05.116 --rc geninfo_unexecuted_blocks=1 00:09:05.116 00:09:05.116 ' 00:09:05.116 15:55:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:05.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.116 --rc genhtml_branch_coverage=1 00:09:05.116 --rc genhtml_function_coverage=1 00:09:05.116 --rc genhtml_legend=1 00:09:05.116 --rc geninfo_all_blocks=1 00:09:05.116 --rc geninfo_unexecuted_blocks=1 00:09:05.116 00:09:05.116 ' 00:09:05.116 15:55:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:05.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.116 --rc genhtml_branch_coverage=1 00:09:05.116 --rc genhtml_function_coverage=1 00:09:05.116 --rc genhtml_legend=1 00:09:05.116 --rc geninfo_all_blocks=1 00:09:05.116 --rc geninfo_unexecuted_blocks=1 00:09:05.116 00:09:05.116 ' 00:09:05.116 15:55:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:05.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.116 --rc genhtml_branch_coverage=1 00:09:05.116 --rc genhtml_function_coverage=1 00:09:05.116 --rc genhtml_legend=1 00:09:05.116 --rc geninfo_all_blocks=1 00:09:05.116 --rc geninfo_unexecuted_blocks=1 00:09:05.116 00:09:05.116 ' 00:09:05.117 15:55:28 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:05.117 15:55:28 -- nvmf/common.sh@7 -- # uname -s 00:09:05.117 15:55:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:05.117 15:55:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:05.117 15:55:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:05.117 15:55:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:05.117 15:55:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:05.117 15:55:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:05.117 15:55:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:05.117 15:55:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:05.117 15:55:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:05.117 15:55:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:05.117 15:55:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:05.117 15:55:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:05.117 15:55:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:05.117 15:55:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:05.117 15:55:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:05.117 15:55:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:05.117 15:55:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:05.117 15:55:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:05.117 15:55:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:05.117 15:55:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.117 15:55:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.117 15:55:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.117 15:55:28 -- paths/export.sh@5 -- # export PATH 00:09:05.117 15:55:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.117 15:55:28 -- nvmf/common.sh@46 -- # : 0 00:09:05.117 15:55:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:05.117 15:55:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:05.117 15:55:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:05.117 15:55:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:05.117 15:55:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:05.117 15:55:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:05.117 15:55:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:05.117 15:55:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:05.117 15:55:28 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:09:05.117 15:55:28 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:09:05.117 15:55:28 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:09:05.117 15:55:28 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:09:05.117 15:55:28 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:09:05.117 15:55:28 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:09:05.117 15:55:28 -- target/referrals.sh@37 -- # nvmftestinit 00:09:05.117 15:55:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:05.117 15:55:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:05.117 15:55:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:05.117 15:55:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:05.117 15:55:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:05.117 15:55:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:05.117 15:55:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:05.117 15:55:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:05.117 15:55:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:05.117 15:55:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:05.117 15:55:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:05.117 15:55:28 -- common/autotest_common.sh@10 -- # set +x 00:09:07.016 15:55:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:07.016 15:55:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:07.016 15:55:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:07.016 15:55:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:07.016 15:55:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:07.016 15:55:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:07.016 15:55:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:07.016 15:55:30 -- nvmf/common.sh@294 -- # net_devs=() 00:09:07.016 15:55:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:07.016 15:55:30 -- nvmf/common.sh@295 -- # e810=() 00:09:07.016 15:55:30 -- nvmf/common.sh@295 -- # local -ga e810 00:09:07.016 15:55:30 -- nvmf/common.sh@296 -- # x722=() 00:09:07.016 15:55:30 -- nvmf/common.sh@296 -- # local -ga x722 00:09:07.016 15:55:30 -- nvmf/common.sh@297 -- # mlx=() 00:09:07.016 15:55:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:07.016 15:55:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:07.016 15:55:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:07.016 15:55:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:07.016 15:55:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:07.016 15:55:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:07.016 15:55:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:07.017 15:55:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:07.017 15:55:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:07.017 15:55:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:07.017 15:55:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:07.017 15:55:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:07.017 15:55:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:07.017 15:55:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:07.017 15:55:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:07.017 15:55:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:07.017 15:55:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:07.017 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:07.017 15:55:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:07.017 15:55:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:07.017 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:07.017 15:55:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:07.017 15:55:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:07.017 15:55:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:07.017 15:55:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:07.017 15:55:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:07.017 15:55:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:07.017 15:55:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:07.017 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:07.017 15:55:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:07.017 15:55:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:07.017 15:55:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:07.275 15:55:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:07.275 15:55:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:07.275 15:55:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:07.275 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:07.275 15:55:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:07.275 15:55:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:07.275 15:55:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:07.275 15:55:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:07.275 15:55:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:07.275 15:55:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:07.275 15:55:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:07.275 15:55:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:07.275 15:55:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:07.275 15:55:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:07.275 15:55:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:07.275 15:55:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:07.275 15:55:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:07.275 15:55:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:07.275 15:55:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:07.275 15:55:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:07.275 15:55:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:07.275 15:55:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:07.275 15:55:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:07.275 15:55:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:07.275 15:55:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:07.275 15:55:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:07.275 15:55:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:07.275 15:55:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:07.275 15:55:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:07.275 15:55:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:07.275 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:07.275 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:09:07.275 00:09:07.275 --- 10.0.0.2 ping statistics --- 00:09:07.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:07.275 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:09:07.275 15:55:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:07.275 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:07.275 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:09:07.275 00:09:07.275 --- 10.0.0.1 ping statistics --- 00:09:07.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:07.275 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:09:07.275 15:55:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:07.275 15:55:30 -- nvmf/common.sh@410 -- # return 0 00:09:07.275 15:55:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:07.275 15:55:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:07.275 15:55:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:07.275 15:55:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:07.275 15:55:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:07.275 15:55:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:07.275 15:55:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:07.275 15:55:30 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:09:07.275 15:55:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:07.275 15:55:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:07.275 15:55:30 -- common/autotest_common.sh@10 -- # set +x 00:09:07.275 15:55:30 -- nvmf/common.sh@469 -- # nvmfpid=1492464 00:09:07.275 15:55:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:07.275 15:55:30 -- nvmf/common.sh@470 -- # waitforlisten 1492464 00:09:07.275 15:55:30 -- common/autotest_common.sh@829 -- # '[' -z 1492464 ']' 00:09:07.275 15:55:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:07.275 15:55:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:07.275 15:55:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:07.275 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:07.275 15:55:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:07.275 15:55:30 -- common/autotest_common.sh@10 -- # set +x 00:09:07.275 [2024-11-18 15:55:30.809803] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:07.275 [2024-11-18 15:55:30.809893] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:07.275 EAL: No free 2048 kB hugepages reported on node 1 00:09:07.534 [2024-11-18 15:55:30.878710] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:07.534 [2024-11-18 15:55:30.977031] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:07.534 [2024-11-18 15:55:30.977191] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:07.534 [2024-11-18 15:55:30.977221] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:07.534 [2024-11-18 15:55:30.977238] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:07.534 [2024-11-18 15:55:30.977334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:07.534 [2024-11-18 15:55:30.977387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:07.535 [2024-11-18 15:55:30.977431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:07.535 [2024-11-18 15:55:30.977434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:08.529 15:55:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:08.529 15:55:31 -- common/autotest_common.sh@862 -- # return 0 00:09:08.529 15:55:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:08.529 15:55:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:08.529 15:55:31 -- common/autotest_common.sh@10 -- # set +x 00:09:08.529 15:55:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:08.529 15:55:31 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:08.529 15:55:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.529 15:55:31 -- common/autotest_common.sh@10 -- # set +x 00:09:08.529 [2024-11-18 15:55:31.805293] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:08.529 15:55:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.529 15:55:31 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:09:08.529 15:55:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.529 15:55:31 -- common/autotest_common.sh@10 -- # set +x 00:09:08.529 [2024-11-18 15:55:31.817491] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:09:08.529 15:55:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.529 15:55:31 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:09:08.529 15:55:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.529 15:55:31 -- common/autotest_common.sh@10 -- # set +x 00:09:08.529 15:55:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.529 15:55:31 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:09:08.529 15:55:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.529 15:55:31 -- common/autotest_common.sh@10 -- # set +x 00:09:08.529 15:55:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.529 15:55:31 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:09:08.529 15:55:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.529 15:55:31 -- common/autotest_common.sh@10 -- # set +x 00:09:08.529 15:55:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.529 15:55:31 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:08.529 15:55:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.529 15:55:31 -- target/referrals.sh@48 -- # jq length 00:09:08.529 15:55:31 -- common/autotest_common.sh@10 -- # set +x 00:09:08.529 15:55:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.529 15:55:31 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:08.529 15:55:31 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:08.529 15:55:31 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:08.529 15:55:31 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:08.529 15:55:31 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:08.529 15:55:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.529 15:55:31 -- common/autotest_common.sh@10 -- # set +x 00:09:08.529 15:55:31 -- target/referrals.sh@21 -- # sort 00:09:08.529 15:55:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.529 15:55:31 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:08.529 15:55:31 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:08.529 15:55:31 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:08.529 15:55:31 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:08.529 15:55:31 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:08.529 15:55:31 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:08.529 15:55:31 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:08.529 15:55:31 -- target/referrals.sh@26 -- # sort 00:09:08.787 15:55:32 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:08.787 15:55:32 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:08.787 15:55:32 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:09:08.787 15:55:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.787 15:55:32 -- common/autotest_common.sh@10 -- # set +x 00:09:08.787 15:55:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.787 15:55:32 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:09:08.787 15:55:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.787 15:55:32 -- common/autotest_common.sh@10 -- # set +x 00:09:08.787 15:55:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.787 15:55:32 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:09:08.787 15:55:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.787 15:55:32 -- common/autotest_common.sh@10 -- # set +x 00:09:08.787 15:55:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.787 15:55:32 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:08.787 15:55:32 -- target/referrals.sh@56 -- # jq length 00:09:08.787 15:55:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.787 15:55:32 -- common/autotest_common.sh@10 -- # set +x 00:09:08.787 15:55:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.787 15:55:32 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:08.787 15:55:32 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:08.787 15:55:32 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:08.787 15:55:32 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:08.787 15:55:32 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:08.787 15:55:32 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:08.787 15:55:32 -- target/referrals.sh@26 -- # sort 00:09:09.045 15:55:32 -- target/referrals.sh@26 -- # echo 00:09:09.045 15:55:32 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:09.045 15:55:32 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:09:09.045 15:55:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.045 15:55:32 -- common/autotest_common.sh@10 -- # set +x 00:09:09.045 15:55:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.045 15:55:32 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:09.045 15:55:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.045 15:55:32 -- common/autotest_common.sh@10 -- # set +x 00:09:09.045 15:55:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.045 15:55:32 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:09.045 15:55:32 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:09.045 15:55:32 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:09.045 15:55:32 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:09.045 15:55:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.045 15:55:32 -- common/autotest_common.sh@10 -- # set +x 00:09:09.045 15:55:32 -- target/referrals.sh@21 -- # sort 00:09:09.045 15:55:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.045 15:55:32 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:09.045 15:55:32 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:09.045 15:55:32 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:09.045 15:55:32 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:09.045 15:55:32 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:09.045 15:55:32 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:09.045 15:55:32 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:09.045 15:55:32 -- target/referrals.sh@26 -- # sort 00:09:09.045 15:55:32 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:09.045 15:55:32 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:09.045 15:55:32 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:09.045 15:55:32 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:09.045 15:55:32 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:09.045 15:55:32 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:09.045 15:55:32 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:09.303 15:55:32 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:09.303 15:55:32 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:09.303 15:55:32 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:09.303 15:55:32 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:09.303 15:55:32 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:09.303 15:55:32 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:09.561 15:55:33 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:09.561 15:55:33 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:09.561 15:55:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.561 15:55:33 -- common/autotest_common.sh@10 -- # set +x 00:09:09.561 15:55:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.561 15:55:33 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:09.561 15:55:33 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:09.561 15:55:33 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:09.561 15:55:33 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:09.561 15:55:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:09.561 15:55:33 -- common/autotest_common.sh@10 -- # set +x 00:09:09.561 15:55:33 -- target/referrals.sh@21 -- # sort 00:09:09.561 15:55:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:09.561 15:55:33 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:09.561 15:55:33 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:09.561 15:55:33 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:09.561 15:55:33 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:09.561 15:55:33 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:09.561 15:55:33 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:09.561 15:55:33 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:09.561 15:55:33 -- target/referrals.sh@26 -- # sort 00:09:09.819 15:55:33 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:09.819 15:55:33 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:09.819 15:55:33 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:09.819 15:55:33 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:09.819 15:55:33 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:09.819 15:55:33 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:09.819 15:55:33 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:09.819 15:55:33 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:09.819 15:55:33 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:09.819 15:55:33 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:09.819 15:55:33 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:09.819 15:55:33 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:09.819 15:55:33 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:10.077 15:55:33 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:10.077 15:55:33 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:10.077 15:55:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.077 15:55:33 -- common/autotest_common.sh@10 -- # set +x 00:09:10.077 15:55:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.077 15:55:33 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:10.077 15:55:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.077 15:55:33 -- target/referrals.sh@82 -- # jq length 00:09:10.077 15:55:33 -- common/autotest_common.sh@10 -- # set +x 00:09:10.077 15:55:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.077 15:55:33 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:10.077 15:55:33 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:10.077 15:55:33 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:10.077 15:55:33 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:10.077 15:55:33 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:10.077 15:55:33 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:10.077 15:55:33 -- target/referrals.sh@26 -- # sort 00:09:10.335 15:55:33 -- target/referrals.sh@26 -- # echo 00:09:10.335 15:55:33 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:10.335 15:55:33 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:10.335 15:55:33 -- target/referrals.sh@86 -- # nvmftestfini 00:09:10.335 15:55:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:10.335 15:55:33 -- nvmf/common.sh@116 -- # sync 00:09:10.335 15:55:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:10.335 15:55:33 -- nvmf/common.sh@119 -- # set +e 00:09:10.335 15:55:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:10.335 15:55:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:10.335 rmmod nvme_tcp 00:09:10.335 rmmod nvme_fabrics 00:09:10.335 rmmod nvme_keyring 00:09:10.335 15:55:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:10.335 15:55:33 -- nvmf/common.sh@123 -- # set -e 00:09:10.335 15:55:33 -- nvmf/common.sh@124 -- # return 0 00:09:10.335 15:55:33 -- nvmf/common.sh@477 -- # '[' -n 1492464 ']' 00:09:10.335 15:55:33 -- nvmf/common.sh@478 -- # killprocess 1492464 00:09:10.335 15:55:33 -- common/autotest_common.sh@936 -- # '[' -z 1492464 ']' 00:09:10.335 15:55:33 -- common/autotest_common.sh@940 -- # kill -0 1492464 00:09:10.335 15:55:33 -- common/autotest_common.sh@941 -- # uname 00:09:10.335 15:55:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:10.335 15:55:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1492464 00:09:10.335 15:55:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:10.335 15:55:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:10.335 15:55:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1492464' 00:09:10.335 killing process with pid 1492464 00:09:10.335 15:55:33 -- common/autotest_common.sh@955 -- # kill 1492464 00:09:10.335 15:55:33 -- common/autotest_common.sh@960 -- # wait 1492464 00:09:10.594 15:55:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:10.594 15:55:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:10.594 15:55:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:10.594 15:55:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:10.594 15:55:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:10.594 15:55:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:10.594 15:55:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:10.594 15:55:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:13.130 15:55:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:13.130 00:09:13.130 real 0m7.761s 00:09:13.130 user 0m14.194s 00:09:13.130 sys 0m2.291s 00:09:13.130 15:55:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:13.130 15:55:36 -- common/autotest_common.sh@10 -- # set +x 00:09:13.130 ************************************ 00:09:13.130 END TEST nvmf_referrals 00:09:13.130 ************************************ 00:09:13.130 15:55:36 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:13.130 15:55:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:13.130 15:55:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:13.130 15:55:36 -- common/autotest_common.sh@10 -- # set +x 00:09:13.130 ************************************ 00:09:13.130 START TEST nvmf_connect_disconnect 00:09:13.130 ************************************ 00:09:13.130 15:55:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:13.130 * Looking for test storage... 00:09:13.130 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:13.130 15:55:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:13.130 15:55:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:13.130 15:55:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:13.130 15:55:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:13.130 15:55:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:13.130 15:55:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:13.130 15:55:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:13.130 15:55:36 -- scripts/common.sh@335 -- # IFS=.-: 00:09:13.130 15:55:36 -- scripts/common.sh@335 -- # read -ra ver1 00:09:13.130 15:55:36 -- scripts/common.sh@336 -- # IFS=.-: 00:09:13.130 15:55:36 -- scripts/common.sh@336 -- # read -ra ver2 00:09:13.130 15:55:36 -- scripts/common.sh@337 -- # local 'op=<' 00:09:13.130 15:55:36 -- scripts/common.sh@339 -- # ver1_l=2 00:09:13.130 15:55:36 -- scripts/common.sh@340 -- # ver2_l=1 00:09:13.130 15:55:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:13.130 15:55:36 -- scripts/common.sh@343 -- # case "$op" in 00:09:13.130 15:55:36 -- scripts/common.sh@344 -- # : 1 00:09:13.130 15:55:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:13.130 15:55:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:13.130 15:55:36 -- scripts/common.sh@364 -- # decimal 1 00:09:13.130 15:55:36 -- scripts/common.sh@352 -- # local d=1 00:09:13.130 15:55:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:13.130 15:55:36 -- scripts/common.sh@354 -- # echo 1 00:09:13.130 15:55:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:13.130 15:55:36 -- scripts/common.sh@365 -- # decimal 2 00:09:13.130 15:55:36 -- scripts/common.sh@352 -- # local d=2 00:09:13.130 15:55:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:13.130 15:55:36 -- scripts/common.sh@354 -- # echo 2 00:09:13.130 15:55:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:13.130 15:55:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:13.130 15:55:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:13.130 15:55:36 -- scripts/common.sh@367 -- # return 0 00:09:13.131 15:55:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:13.131 15:55:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:13.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:13.131 --rc genhtml_branch_coverage=1 00:09:13.131 --rc genhtml_function_coverage=1 00:09:13.131 --rc genhtml_legend=1 00:09:13.131 --rc geninfo_all_blocks=1 00:09:13.131 --rc geninfo_unexecuted_blocks=1 00:09:13.131 00:09:13.131 ' 00:09:13.131 15:55:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:13.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:13.131 --rc genhtml_branch_coverage=1 00:09:13.131 --rc genhtml_function_coverage=1 00:09:13.131 --rc genhtml_legend=1 00:09:13.131 --rc geninfo_all_blocks=1 00:09:13.131 --rc geninfo_unexecuted_blocks=1 00:09:13.131 00:09:13.131 ' 00:09:13.131 15:55:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:13.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:13.131 --rc genhtml_branch_coverage=1 00:09:13.131 --rc genhtml_function_coverage=1 00:09:13.131 --rc genhtml_legend=1 00:09:13.131 --rc geninfo_all_blocks=1 00:09:13.131 --rc geninfo_unexecuted_blocks=1 00:09:13.131 00:09:13.131 ' 00:09:13.131 15:55:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:13.131 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:13.131 --rc genhtml_branch_coverage=1 00:09:13.131 --rc genhtml_function_coverage=1 00:09:13.131 --rc genhtml_legend=1 00:09:13.131 --rc geninfo_all_blocks=1 00:09:13.131 --rc geninfo_unexecuted_blocks=1 00:09:13.131 00:09:13.131 ' 00:09:13.131 15:55:36 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:13.131 15:55:36 -- nvmf/common.sh@7 -- # uname -s 00:09:13.131 15:55:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:13.131 15:55:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:13.131 15:55:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:13.131 15:55:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:13.131 15:55:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:13.131 15:55:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:13.131 15:55:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:13.131 15:55:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:13.131 15:55:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:13.131 15:55:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:13.131 15:55:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:13.131 15:55:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:13.131 15:55:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:13.131 15:55:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:13.131 15:55:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:13.131 15:55:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:13.131 15:55:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:13.131 15:55:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:13.131 15:55:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:13.131 15:55:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:13.131 15:55:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:13.131 15:55:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:13.131 15:55:36 -- paths/export.sh@5 -- # export PATH 00:09:13.131 15:55:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:13.131 15:55:36 -- nvmf/common.sh@46 -- # : 0 00:09:13.131 15:55:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:13.131 15:55:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:13.131 15:55:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:13.131 15:55:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:13.131 15:55:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:13.131 15:55:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:13.131 15:55:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:13.131 15:55:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:13.131 15:55:36 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:13.131 15:55:36 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:13.131 15:55:36 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:13.131 15:55:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:13.131 15:55:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:13.131 15:55:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:13.131 15:55:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:13.131 15:55:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:13.131 15:55:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:13.131 15:55:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:13.131 15:55:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:13.131 15:55:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:13.131 15:55:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:13.131 15:55:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:13.131 15:55:36 -- common/autotest_common.sh@10 -- # set +x 00:09:15.032 15:55:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:15.032 15:55:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:15.032 15:55:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:15.032 15:55:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:15.032 15:55:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:15.032 15:55:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:15.032 15:55:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:15.032 15:55:38 -- nvmf/common.sh@294 -- # net_devs=() 00:09:15.032 15:55:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:15.032 15:55:38 -- nvmf/common.sh@295 -- # e810=() 00:09:15.032 15:55:38 -- nvmf/common.sh@295 -- # local -ga e810 00:09:15.032 15:55:38 -- nvmf/common.sh@296 -- # x722=() 00:09:15.032 15:55:38 -- nvmf/common.sh@296 -- # local -ga x722 00:09:15.032 15:55:38 -- nvmf/common.sh@297 -- # mlx=() 00:09:15.032 15:55:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:15.032 15:55:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:15.032 15:55:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:15.032 15:55:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:15.032 15:55:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:15.032 15:55:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:15.032 15:55:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:15.032 15:55:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:15.032 15:55:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:15.032 15:55:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:15.032 15:55:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:15.032 15:55:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:15.032 15:55:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:15.032 15:55:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:15.032 15:55:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:15.032 15:55:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:15.032 15:55:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:15.032 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:15.032 15:55:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:15.032 15:55:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:15.032 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:15.032 15:55:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:15.032 15:55:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:15.032 15:55:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:15.032 15:55:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:15.032 15:55:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:15.032 15:55:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:15.032 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:15.032 15:55:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:15.032 15:55:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:15.032 15:55:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:15.032 15:55:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:15.032 15:55:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:15.032 15:55:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:15.032 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:15.032 15:55:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:15.032 15:55:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:15.032 15:55:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:15.032 15:55:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:15.032 15:55:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:15.032 15:55:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:15.032 15:55:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:15.032 15:55:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:15.032 15:55:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:15.032 15:55:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:15.032 15:55:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:15.032 15:55:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:15.032 15:55:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:15.032 15:55:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:15.032 15:55:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:15.032 15:55:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:15.032 15:55:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:15.032 15:55:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:15.290 15:55:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:15.291 15:55:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:15.291 15:55:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:15.291 15:55:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:15.291 15:55:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:15.291 15:55:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:15.291 15:55:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:15.291 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:15.291 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.392 ms 00:09:15.291 00:09:15.291 --- 10.0.0.2 ping statistics --- 00:09:15.291 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:15.291 rtt min/avg/max/mdev = 0.392/0.392/0.392/0.000 ms 00:09:15.291 15:55:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:15.291 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:15.291 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:09:15.291 00:09:15.291 --- 10.0.0.1 ping statistics --- 00:09:15.291 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:15.291 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:09:15.291 15:55:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:15.291 15:55:38 -- nvmf/common.sh@410 -- # return 0 00:09:15.291 15:55:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:15.291 15:55:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:15.291 15:55:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:15.291 15:55:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:15.291 15:55:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:15.291 15:55:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:15.291 15:55:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:15.291 15:55:38 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:15.291 15:55:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:15.291 15:55:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:15.291 15:55:38 -- common/autotest_common.sh@10 -- # set +x 00:09:15.291 15:55:38 -- nvmf/common.sh@469 -- # nvmfpid=1494925 00:09:15.291 15:55:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:15.291 15:55:38 -- nvmf/common.sh@470 -- # waitforlisten 1494925 00:09:15.291 15:55:38 -- common/autotest_common.sh@829 -- # '[' -z 1494925 ']' 00:09:15.291 15:55:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:15.291 15:55:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:15.291 15:55:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:15.291 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:15.291 15:55:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:15.291 15:55:38 -- common/autotest_common.sh@10 -- # set +x 00:09:15.291 [2024-11-18 15:55:38.779653] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:15.291 [2024-11-18 15:55:38.779747] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:15.291 EAL: No free 2048 kB hugepages reported on node 1 00:09:15.291 [2024-11-18 15:55:38.856788] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:15.549 [2024-11-18 15:55:38.946193] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:15.549 [2024-11-18 15:55:38.946336] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:15.549 [2024-11-18 15:55:38.946352] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:15.549 [2024-11-18 15:55:38.946365] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:15.549 [2024-11-18 15:55:38.946461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:15.549 [2024-11-18 15:55:38.946517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:15.549 [2024-11-18 15:55:38.946583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:15.549 [2024-11-18 15:55:38.946585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:16.481 15:55:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:16.481 15:55:39 -- common/autotest_common.sh@862 -- # return 0 00:09:16.481 15:55:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:16.481 15:55:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:16.481 15:55:39 -- common/autotest_common.sh@10 -- # set +x 00:09:16.481 15:55:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:16.481 15:55:39 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:16.481 15:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.481 15:55:39 -- common/autotest_common.sh@10 -- # set +x 00:09:16.481 [2024-11-18 15:55:39.800312] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:16.481 15:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.481 15:55:39 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:16.481 15:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.481 15:55:39 -- common/autotest_common.sh@10 -- # set +x 00:09:16.481 15:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.481 15:55:39 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:16.481 15:55:39 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:16.481 15:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.481 15:55:39 -- common/autotest_common.sh@10 -- # set +x 00:09:16.481 15:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.481 15:55:39 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:16.481 15:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.481 15:55:39 -- common/autotest_common.sh@10 -- # set +x 00:09:16.481 15:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.481 15:55:39 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:16.481 15:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:16.481 15:55:39 -- common/autotest_common.sh@10 -- # set +x 00:09:16.481 [2024-11-18 15:55:39.857224] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:16.481 15:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:16.481 15:55:39 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:16.481 15:55:39 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:16.481 15:55:39 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:16.481 15:55:39 -- target/connect_disconnect.sh@34 -- # set +x 00:09:19.007 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.532 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.430 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.956 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.480 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.006 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.905 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.431 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.953 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.847 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.381 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.904 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.801 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.328 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.918 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.816 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.344 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.871 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.769 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.295 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.833 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.731 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.258 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.156 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.681 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.207 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.104 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.628 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.542 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.069 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.596 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.495 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.021 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.442 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.968 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.866 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.393 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.920 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.818 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.346 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.872 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.770 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.295 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.896 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.423 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.320 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.845 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.368 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.893 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.791 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.322 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.220 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.746 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.272 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.169 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.697 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.596 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.123 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.591 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.117 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.645 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.173 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.085 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.612 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.138 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:54.035 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:56.563 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.091 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.991 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:03.518 [2024-11-18 15:58:26.828465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2063730 is same with the state(5) to be set 00:12:03.518 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.049 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.946 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.472 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:12.998 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.945 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:17.472 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.999 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.899 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:24.426 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:26.951 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:28.848 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:31.372 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:33.897 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:35.793 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:38.318 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:40.844 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:42.742 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:45.269 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:47.799 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:49.696 [2024-11-18 15:59:13.177559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2063730 is same with the state(5) to be set 00:12:49.696 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:52.285 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:54.181 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:56.706 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:59.231 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:01.128 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:03.654 [2024-11-18 15:59:27.091405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2063730 is same with the state(5) to be set 00:13:03.654 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:06.180 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:08.709 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:08.709 15:59:31 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:13:08.709 15:59:31 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:13:08.709 15:59:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:08.709 15:59:31 -- nvmf/common.sh@116 -- # sync 00:13:08.709 15:59:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:08.709 15:59:31 -- nvmf/common.sh@119 -- # set +e 00:13:08.709 15:59:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:08.709 15:59:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:08.709 rmmod nvme_tcp 00:13:08.709 rmmod nvme_fabrics 00:13:08.709 rmmod nvme_keyring 00:13:08.709 15:59:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:08.709 15:59:31 -- nvmf/common.sh@123 -- # set -e 00:13:08.709 15:59:31 -- nvmf/common.sh@124 -- # return 0 00:13:08.709 15:59:31 -- nvmf/common.sh@477 -- # '[' -n 1494925 ']' 00:13:08.709 15:59:31 -- nvmf/common.sh@478 -- # killprocess 1494925 00:13:08.709 15:59:31 -- common/autotest_common.sh@936 -- # '[' -z 1494925 ']' 00:13:08.709 15:59:31 -- common/autotest_common.sh@940 -- # kill -0 1494925 00:13:08.709 15:59:31 -- common/autotest_common.sh@941 -- # uname 00:13:08.709 15:59:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:08.709 15:59:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1494925 00:13:08.709 15:59:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:08.709 15:59:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:08.709 15:59:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1494925' 00:13:08.709 killing process with pid 1494925 00:13:08.709 15:59:31 -- common/autotest_common.sh@955 -- # kill 1494925 00:13:08.709 15:59:31 -- common/autotest_common.sh@960 -- # wait 1494925 00:13:08.709 15:59:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:08.709 15:59:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:08.709 15:59:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:08.709 15:59:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:08.709 15:59:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:08.709 15:59:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:08.709 15:59:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:08.709 15:59:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:11.241 15:59:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:11.241 00:13:11.241 real 3m58.006s 00:13:11.241 user 15m7.511s 00:13:11.241 sys 0m34.508s 00:13:11.241 15:59:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:11.241 15:59:34 -- common/autotest_common.sh@10 -- # set +x 00:13:11.241 ************************************ 00:13:11.241 END TEST nvmf_connect_disconnect 00:13:11.241 ************************************ 00:13:11.241 15:59:34 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:11.241 15:59:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:11.241 15:59:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:11.241 15:59:34 -- common/autotest_common.sh@10 -- # set +x 00:13:11.241 ************************************ 00:13:11.241 START TEST nvmf_multitarget 00:13:11.241 ************************************ 00:13:11.241 15:59:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:11.241 * Looking for test storage... 00:13:11.241 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:11.241 15:59:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:11.241 15:59:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:11.241 15:59:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:11.241 15:59:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:11.241 15:59:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:11.241 15:59:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:11.241 15:59:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:11.241 15:59:34 -- scripts/common.sh@335 -- # IFS=.-: 00:13:11.241 15:59:34 -- scripts/common.sh@335 -- # read -ra ver1 00:13:11.241 15:59:34 -- scripts/common.sh@336 -- # IFS=.-: 00:13:11.241 15:59:34 -- scripts/common.sh@336 -- # read -ra ver2 00:13:11.241 15:59:34 -- scripts/common.sh@337 -- # local 'op=<' 00:13:11.241 15:59:34 -- scripts/common.sh@339 -- # ver1_l=2 00:13:11.241 15:59:34 -- scripts/common.sh@340 -- # ver2_l=1 00:13:11.241 15:59:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:11.241 15:59:34 -- scripts/common.sh@343 -- # case "$op" in 00:13:11.241 15:59:34 -- scripts/common.sh@344 -- # : 1 00:13:11.241 15:59:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:11.241 15:59:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:11.241 15:59:34 -- scripts/common.sh@364 -- # decimal 1 00:13:11.241 15:59:34 -- scripts/common.sh@352 -- # local d=1 00:13:11.241 15:59:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:11.241 15:59:34 -- scripts/common.sh@354 -- # echo 1 00:13:11.241 15:59:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:11.241 15:59:34 -- scripts/common.sh@365 -- # decimal 2 00:13:11.241 15:59:34 -- scripts/common.sh@352 -- # local d=2 00:13:11.241 15:59:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:11.241 15:59:34 -- scripts/common.sh@354 -- # echo 2 00:13:11.241 15:59:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:11.241 15:59:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:11.241 15:59:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:11.241 15:59:34 -- scripts/common.sh@367 -- # return 0 00:13:11.241 15:59:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:11.241 15:59:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:11.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.241 --rc genhtml_branch_coverage=1 00:13:11.241 --rc genhtml_function_coverage=1 00:13:11.241 --rc genhtml_legend=1 00:13:11.241 --rc geninfo_all_blocks=1 00:13:11.241 --rc geninfo_unexecuted_blocks=1 00:13:11.241 00:13:11.241 ' 00:13:11.241 15:59:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:11.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.241 --rc genhtml_branch_coverage=1 00:13:11.241 --rc genhtml_function_coverage=1 00:13:11.241 --rc genhtml_legend=1 00:13:11.241 --rc geninfo_all_blocks=1 00:13:11.241 --rc geninfo_unexecuted_blocks=1 00:13:11.241 00:13:11.241 ' 00:13:11.241 15:59:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:11.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.241 --rc genhtml_branch_coverage=1 00:13:11.241 --rc genhtml_function_coverage=1 00:13:11.241 --rc genhtml_legend=1 00:13:11.241 --rc geninfo_all_blocks=1 00:13:11.241 --rc geninfo_unexecuted_blocks=1 00:13:11.241 00:13:11.241 ' 00:13:11.241 15:59:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:11.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.241 --rc genhtml_branch_coverage=1 00:13:11.241 --rc genhtml_function_coverage=1 00:13:11.241 --rc genhtml_legend=1 00:13:11.241 --rc geninfo_all_blocks=1 00:13:11.241 --rc geninfo_unexecuted_blocks=1 00:13:11.241 00:13:11.241 ' 00:13:11.241 15:59:34 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:11.241 15:59:34 -- nvmf/common.sh@7 -- # uname -s 00:13:11.241 15:59:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:11.241 15:59:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:11.241 15:59:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:11.241 15:59:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:11.241 15:59:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:11.241 15:59:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:11.241 15:59:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:11.241 15:59:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:11.242 15:59:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:11.242 15:59:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:11.242 15:59:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:11.242 15:59:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:11.242 15:59:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:11.242 15:59:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:11.242 15:59:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:11.242 15:59:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:11.242 15:59:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:11.242 15:59:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:11.242 15:59:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:11.242 15:59:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.242 15:59:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.242 15:59:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.242 15:59:34 -- paths/export.sh@5 -- # export PATH 00:13:11.242 15:59:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.242 15:59:34 -- nvmf/common.sh@46 -- # : 0 00:13:11.242 15:59:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:11.242 15:59:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:11.242 15:59:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:11.242 15:59:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:11.242 15:59:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:11.242 15:59:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:11.242 15:59:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:11.242 15:59:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:11.242 15:59:34 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:11.242 15:59:34 -- target/multitarget.sh@15 -- # nvmftestinit 00:13:11.242 15:59:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:11.242 15:59:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:11.242 15:59:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:11.242 15:59:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:11.242 15:59:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:11.242 15:59:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:11.242 15:59:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:11.242 15:59:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:11.242 15:59:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:11.242 15:59:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:11.242 15:59:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:11.242 15:59:34 -- common/autotest_common.sh@10 -- # set +x 00:13:13.144 15:59:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:13.144 15:59:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:13.144 15:59:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:13.144 15:59:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:13.144 15:59:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:13.144 15:59:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:13.144 15:59:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:13.144 15:59:36 -- nvmf/common.sh@294 -- # net_devs=() 00:13:13.144 15:59:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:13.144 15:59:36 -- nvmf/common.sh@295 -- # e810=() 00:13:13.144 15:59:36 -- nvmf/common.sh@295 -- # local -ga e810 00:13:13.144 15:59:36 -- nvmf/common.sh@296 -- # x722=() 00:13:13.144 15:59:36 -- nvmf/common.sh@296 -- # local -ga x722 00:13:13.144 15:59:36 -- nvmf/common.sh@297 -- # mlx=() 00:13:13.144 15:59:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:13.144 15:59:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:13.144 15:59:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:13.144 15:59:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:13.144 15:59:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:13.144 15:59:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:13.144 15:59:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:13.144 15:59:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:13.144 15:59:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:13.144 15:59:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:13.144 15:59:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:13.144 15:59:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:13.144 15:59:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:13.144 15:59:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:13.144 15:59:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:13.144 15:59:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:13.144 15:59:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:13.144 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:13.144 15:59:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:13.144 15:59:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:13.144 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:13.144 15:59:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:13.144 15:59:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:13.144 15:59:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:13.144 15:59:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:13.144 15:59:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:13.144 15:59:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:13.144 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:13.144 15:59:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:13.144 15:59:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:13.144 15:59:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:13.144 15:59:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:13.144 15:59:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:13.144 15:59:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:13.144 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:13.144 15:59:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:13.144 15:59:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:13.144 15:59:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:13.144 15:59:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:13.144 15:59:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:13.144 15:59:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:13.144 15:59:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:13.144 15:59:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:13.144 15:59:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:13.144 15:59:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:13.144 15:59:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:13.144 15:59:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:13.144 15:59:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:13.144 15:59:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:13.144 15:59:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:13.144 15:59:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:13.144 15:59:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:13.144 15:59:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:13.144 15:59:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:13.144 15:59:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:13.144 15:59:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:13.144 15:59:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:13.144 15:59:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:13.144 15:59:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:13.144 15:59:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:13.144 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:13.144 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:13:13.144 00:13:13.144 --- 10.0.0.2 ping statistics --- 00:13:13.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:13.144 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:13:13.144 15:59:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:13.144 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:13.144 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:13:13.144 00:13:13.144 --- 10.0.0.1 ping statistics --- 00:13:13.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:13.144 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:13:13.144 15:59:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:13.144 15:59:36 -- nvmf/common.sh@410 -- # return 0 00:13:13.144 15:59:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:13.144 15:59:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:13.145 15:59:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:13.145 15:59:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:13.145 15:59:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:13.145 15:59:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:13.145 15:59:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:13.145 15:59:36 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:13.145 15:59:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:13.145 15:59:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:13.145 15:59:36 -- common/autotest_common.sh@10 -- # set +x 00:13:13.145 15:59:36 -- nvmf/common.sh@469 -- # nvmfpid=1527200 00:13:13.145 15:59:36 -- nvmf/common.sh@470 -- # waitforlisten 1527200 00:13:13.145 15:59:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:13.145 15:59:36 -- common/autotest_common.sh@829 -- # '[' -z 1527200 ']' 00:13:13.145 15:59:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:13.145 15:59:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:13.145 15:59:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:13.145 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:13.145 15:59:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:13.145 15:59:36 -- common/autotest_common.sh@10 -- # set +x 00:13:13.145 [2024-11-18 15:59:36.720683] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:13.145 [2024-11-18 15:59:36.720779] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:13.403 EAL: No free 2048 kB hugepages reported on node 1 00:13:13.403 [2024-11-18 15:59:36.790858] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:13.403 [2024-11-18 15:59:36.885089] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:13.403 [2024-11-18 15:59:36.885242] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:13.403 [2024-11-18 15:59:36.885261] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:13.403 [2024-11-18 15:59:36.885276] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:13.403 [2024-11-18 15:59:36.885350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:13.403 [2024-11-18 15:59:36.885403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:13.403 [2024-11-18 15:59:36.885470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:13.403 [2024-11-18 15:59:36.885473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:14.337 15:59:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:14.337 15:59:37 -- common/autotest_common.sh@862 -- # return 0 00:13:14.337 15:59:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:14.337 15:59:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:14.337 15:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:14.337 15:59:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:14.337 15:59:37 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:14.337 15:59:37 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:14.337 15:59:37 -- target/multitarget.sh@21 -- # jq length 00:13:14.337 15:59:37 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:14.337 15:59:37 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:14.595 "nvmf_tgt_1" 00:13:14.595 15:59:37 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:14.595 "nvmf_tgt_2" 00:13:14.595 15:59:38 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:14.595 15:59:38 -- target/multitarget.sh@28 -- # jq length 00:13:14.853 15:59:38 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:14.853 15:59:38 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:14.853 true 00:13:14.853 15:59:38 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:14.853 true 00:13:14.853 15:59:38 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:14.853 15:59:38 -- target/multitarget.sh@35 -- # jq length 00:13:15.110 15:59:38 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:15.110 15:59:38 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:15.110 15:59:38 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:15.110 15:59:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:15.110 15:59:38 -- nvmf/common.sh@116 -- # sync 00:13:15.110 15:59:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:15.110 15:59:38 -- nvmf/common.sh@119 -- # set +e 00:13:15.110 15:59:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:15.110 15:59:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:15.110 rmmod nvme_tcp 00:13:15.110 rmmod nvme_fabrics 00:13:15.110 rmmod nvme_keyring 00:13:15.110 15:59:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:15.110 15:59:38 -- nvmf/common.sh@123 -- # set -e 00:13:15.110 15:59:38 -- nvmf/common.sh@124 -- # return 0 00:13:15.110 15:59:38 -- nvmf/common.sh@477 -- # '[' -n 1527200 ']' 00:13:15.110 15:59:38 -- nvmf/common.sh@478 -- # killprocess 1527200 00:13:15.110 15:59:38 -- common/autotest_common.sh@936 -- # '[' -z 1527200 ']' 00:13:15.110 15:59:38 -- common/autotest_common.sh@940 -- # kill -0 1527200 00:13:15.110 15:59:38 -- common/autotest_common.sh@941 -- # uname 00:13:15.110 15:59:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:15.110 15:59:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1527200 00:13:15.110 15:59:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:15.110 15:59:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:15.110 15:59:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1527200' 00:13:15.110 killing process with pid 1527200 00:13:15.110 15:59:38 -- common/autotest_common.sh@955 -- # kill 1527200 00:13:15.110 15:59:38 -- common/autotest_common.sh@960 -- # wait 1527200 00:13:15.369 15:59:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:15.369 15:59:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:15.369 15:59:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:15.369 15:59:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:15.369 15:59:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:15.369 15:59:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:15.369 15:59:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:15.369 15:59:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:17.903 15:59:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:17.903 00:13:17.903 real 0m6.685s 00:13:17.903 user 0m9.794s 00:13:17.903 sys 0m2.011s 00:13:17.903 15:59:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:17.903 15:59:40 -- common/autotest_common.sh@10 -- # set +x 00:13:17.903 ************************************ 00:13:17.903 END TEST nvmf_multitarget 00:13:17.903 ************************************ 00:13:17.903 15:59:40 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:17.903 15:59:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:17.903 15:59:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:17.903 15:59:40 -- common/autotest_common.sh@10 -- # set +x 00:13:17.903 ************************************ 00:13:17.903 START TEST nvmf_rpc 00:13:17.903 ************************************ 00:13:17.903 15:59:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:17.903 * Looking for test storage... 00:13:17.903 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:17.903 15:59:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:17.903 15:59:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:17.903 15:59:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:17.903 15:59:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:17.903 15:59:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:17.903 15:59:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:17.903 15:59:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:17.903 15:59:41 -- scripts/common.sh@335 -- # IFS=.-: 00:13:17.903 15:59:41 -- scripts/common.sh@335 -- # read -ra ver1 00:13:17.903 15:59:41 -- scripts/common.sh@336 -- # IFS=.-: 00:13:17.903 15:59:41 -- scripts/common.sh@336 -- # read -ra ver2 00:13:17.904 15:59:41 -- scripts/common.sh@337 -- # local 'op=<' 00:13:17.904 15:59:41 -- scripts/common.sh@339 -- # ver1_l=2 00:13:17.904 15:59:41 -- scripts/common.sh@340 -- # ver2_l=1 00:13:17.904 15:59:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:17.904 15:59:41 -- scripts/common.sh@343 -- # case "$op" in 00:13:17.904 15:59:41 -- scripts/common.sh@344 -- # : 1 00:13:17.904 15:59:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:17.904 15:59:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:17.904 15:59:41 -- scripts/common.sh@364 -- # decimal 1 00:13:17.904 15:59:41 -- scripts/common.sh@352 -- # local d=1 00:13:17.904 15:59:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:17.904 15:59:41 -- scripts/common.sh@354 -- # echo 1 00:13:17.904 15:59:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:17.904 15:59:41 -- scripts/common.sh@365 -- # decimal 2 00:13:17.904 15:59:41 -- scripts/common.sh@352 -- # local d=2 00:13:17.904 15:59:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:17.904 15:59:41 -- scripts/common.sh@354 -- # echo 2 00:13:17.904 15:59:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:17.904 15:59:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:17.904 15:59:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:17.904 15:59:41 -- scripts/common.sh@367 -- # return 0 00:13:17.904 15:59:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:17.904 15:59:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:17.904 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.904 --rc genhtml_branch_coverage=1 00:13:17.904 --rc genhtml_function_coverage=1 00:13:17.904 --rc genhtml_legend=1 00:13:17.904 --rc geninfo_all_blocks=1 00:13:17.904 --rc geninfo_unexecuted_blocks=1 00:13:17.904 00:13:17.904 ' 00:13:17.904 15:59:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:17.904 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.904 --rc genhtml_branch_coverage=1 00:13:17.904 --rc genhtml_function_coverage=1 00:13:17.904 --rc genhtml_legend=1 00:13:17.904 --rc geninfo_all_blocks=1 00:13:17.904 --rc geninfo_unexecuted_blocks=1 00:13:17.904 00:13:17.904 ' 00:13:17.904 15:59:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:17.904 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.904 --rc genhtml_branch_coverage=1 00:13:17.904 --rc genhtml_function_coverage=1 00:13:17.904 --rc genhtml_legend=1 00:13:17.904 --rc geninfo_all_blocks=1 00:13:17.904 --rc geninfo_unexecuted_blocks=1 00:13:17.904 00:13:17.904 ' 00:13:17.904 15:59:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:17.904 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:17.904 --rc genhtml_branch_coverage=1 00:13:17.904 --rc genhtml_function_coverage=1 00:13:17.904 --rc genhtml_legend=1 00:13:17.904 --rc geninfo_all_blocks=1 00:13:17.904 --rc geninfo_unexecuted_blocks=1 00:13:17.904 00:13:17.904 ' 00:13:17.904 15:59:41 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:17.904 15:59:41 -- nvmf/common.sh@7 -- # uname -s 00:13:17.904 15:59:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:17.904 15:59:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:17.904 15:59:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:17.904 15:59:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:17.904 15:59:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:17.904 15:59:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:17.904 15:59:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:17.904 15:59:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:17.904 15:59:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:17.904 15:59:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:17.904 15:59:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:17.904 15:59:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:17.904 15:59:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:17.904 15:59:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:17.904 15:59:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:17.904 15:59:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:17.904 15:59:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:17.904 15:59:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:17.904 15:59:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:17.904 15:59:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.904 15:59:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.904 15:59:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.904 15:59:41 -- paths/export.sh@5 -- # export PATH 00:13:17.904 15:59:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:17.904 15:59:41 -- nvmf/common.sh@46 -- # : 0 00:13:17.904 15:59:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:17.904 15:59:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:17.904 15:59:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:17.904 15:59:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:17.904 15:59:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:17.904 15:59:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:17.904 15:59:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:17.904 15:59:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:17.904 15:59:41 -- target/rpc.sh@11 -- # loops=5 00:13:17.904 15:59:41 -- target/rpc.sh@23 -- # nvmftestinit 00:13:17.904 15:59:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:17.904 15:59:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:17.904 15:59:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:17.904 15:59:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:17.904 15:59:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:17.904 15:59:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:17.904 15:59:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:17.904 15:59:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:17.904 15:59:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:17.904 15:59:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:17.904 15:59:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:17.904 15:59:41 -- common/autotest_common.sh@10 -- # set +x 00:13:19.807 15:59:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:19.807 15:59:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:19.807 15:59:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:19.807 15:59:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:19.807 15:59:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:19.807 15:59:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:19.807 15:59:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:19.807 15:59:43 -- nvmf/common.sh@294 -- # net_devs=() 00:13:19.807 15:59:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:19.807 15:59:43 -- nvmf/common.sh@295 -- # e810=() 00:13:19.807 15:59:43 -- nvmf/common.sh@295 -- # local -ga e810 00:13:19.807 15:59:43 -- nvmf/common.sh@296 -- # x722=() 00:13:19.807 15:59:43 -- nvmf/common.sh@296 -- # local -ga x722 00:13:19.807 15:59:43 -- nvmf/common.sh@297 -- # mlx=() 00:13:19.807 15:59:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:19.807 15:59:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:19.807 15:59:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:19.807 15:59:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:19.807 15:59:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:19.807 15:59:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:19.807 15:59:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:19.807 15:59:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:19.807 15:59:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:19.807 15:59:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:19.807 15:59:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:19.807 15:59:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:19.807 15:59:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:19.807 15:59:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:19.807 15:59:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:19.807 15:59:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:19.807 15:59:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:19.807 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:19.807 15:59:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:19.807 15:59:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:19.807 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:19.807 15:59:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:19.807 15:59:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:19.807 15:59:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:19.807 15:59:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:19.807 15:59:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:19.807 15:59:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:19.807 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:19.807 15:59:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:19.807 15:59:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:19.807 15:59:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:19.807 15:59:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:19.807 15:59:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:19.807 15:59:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:19.807 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:19.807 15:59:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:19.807 15:59:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:19.807 15:59:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:19.807 15:59:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:19.807 15:59:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:19.807 15:59:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:19.807 15:59:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:19.807 15:59:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:19.807 15:59:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:19.807 15:59:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:19.807 15:59:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:19.807 15:59:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:19.807 15:59:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:19.807 15:59:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:19.807 15:59:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:19.807 15:59:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:19.807 15:59:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:19.807 15:59:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:19.807 15:59:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:19.807 15:59:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:19.807 15:59:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:19.807 15:59:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:19.807 15:59:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:19.807 15:59:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:19.807 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:19.807 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:13:19.807 00:13:19.807 --- 10.0.0.2 ping statistics --- 00:13:19.807 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:19.807 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:13:19.807 15:59:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:19.807 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:19.807 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:13:19.807 00:13:19.807 --- 10.0.0.1 ping statistics --- 00:13:19.807 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:19.807 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:13:19.807 15:59:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:19.807 15:59:43 -- nvmf/common.sh@410 -- # return 0 00:13:19.807 15:59:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:19.807 15:59:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:19.807 15:59:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:19.807 15:59:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:19.807 15:59:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:19.807 15:59:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:19.807 15:59:43 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:19.807 15:59:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:19.807 15:59:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:19.807 15:59:43 -- common/autotest_common.sh@10 -- # set +x 00:13:19.807 15:59:43 -- nvmf/common.sh@469 -- # nvmfpid=1529385 00:13:19.807 15:59:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:19.807 15:59:43 -- nvmf/common.sh@470 -- # waitforlisten 1529385 00:13:19.807 15:59:43 -- common/autotest_common.sh@829 -- # '[' -z 1529385 ']' 00:13:19.807 15:59:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:19.807 15:59:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:19.807 15:59:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:19.808 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:19.808 15:59:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:19.808 15:59:43 -- common/autotest_common.sh@10 -- # set +x 00:13:20.066 [2024-11-18 15:59:43.399769] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:20.066 [2024-11-18 15:59:43.399863] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:20.066 EAL: No free 2048 kB hugepages reported on node 1 00:13:20.066 [2024-11-18 15:59:43.468087] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:20.066 [2024-11-18 15:59:43.558042] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:20.066 [2024-11-18 15:59:43.558203] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:20.066 [2024-11-18 15:59:43.558221] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:20.066 [2024-11-18 15:59:43.558234] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:20.066 [2024-11-18 15:59:43.558292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:20.066 [2024-11-18 15:59:43.558354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:20.066 [2024-11-18 15:59:43.558400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:20.066 [2024-11-18 15:59:43.558402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:21.000 15:59:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:21.000 15:59:44 -- common/autotest_common.sh@862 -- # return 0 00:13:21.000 15:59:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:21.000 15:59:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:21.000 15:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:21.000 15:59:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:21.000 15:59:44 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:21.000 15:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.000 15:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:21.000 15:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.000 15:59:44 -- target/rpc.sh@26 -- # stats='{ 00:13:21.000 "tick_rate": 2700000000, 00:13:21.000 "poll_groups": [ 00:13:21.000 { 00:13:21.000 "name": "nvmf_tgt_poll_group_0", 00:13:21.000 "admin_qpairs": 0, 00:13:21.000 "io_qpairs": 0, 00:13:21.000 "current_admin_qpairs": 0, 00:13:21.000 "current_io_qpairs": 0, 00:13:21.000 "pending_bdev_io": 0, 00:13:21.000 "completed_nvme_io": 0, 00:13:21.000 "transports": [] 00:13:21.000 }, 00:13:21.000 { 00:13:21.000 "name": "nvmf_tgt_poll_group_1", 00:13:21.000 "admin_qpairs": 0, 00:13:21.000 "io_qpairs": 0, 00:13:21.000 "current_admin_qpairs": 0, 00:13:21.000 "current_io_qpairs": 0, 00:13:21.000 "pending_bdev_io": 0, 00:13:21.000 "completed_nvme_io": 0, 00:13:21.000 "transports": [] 00:13:21.000 }, 00:13:21.000 { 00:13:21.000 "name": "nvmf_tgt_poll_group_2", 00:13:21.000 "admin_qpairs": 0, 00:13:21.000 "io_qpairs": 0, 00:13:21.000 "current_admin_qpairs": 0, 00:13:21.000 "current_io_qpairs": 0, 00:13:21.000 "pending_bdev_io": 0, 00:13:21.000 "completed_nvme_io": 0, 00:13:21.000 "transports": [] 00:13:21.000 }, 00:13:21.000 { 00:13:21.000 "name": "nvmf_tgt_poll_group_3", 00:13:21.000 "admin_qpairs": 0, 00:13:21.000 "io_qpairs": 0, 00:13:21.000 "current_admin_qpairs": 0, 00:13:21.000 "current_io_qpairs": 0, 00:13:21.000 "pending_bdev_io": 0, 00:13:21.000 "completed_nvme_io": 0, 00:13:21.000 "transports": [] 00:13:21.000 } 00:13:21.000 ] 00:13:21.000 }' 00:13:21.000 15:59:44 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:21.000 15:59:44 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:21.000 15:59:44 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:21.000 15:59:44 -- target/rpc.sh@15 -- # wc -l 00:13:21.000 15:59:44 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:21.000 15:59:44 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:21.000 15:59:44 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:21.000 15:59:44 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:21.000 15:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.000 15:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:21.000 [2024-11-18 15:59:44.519691] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:21.000 15:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.000 15:59:44 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:21.000 15:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.000 15:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:21.000 15:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.001 15:59:44 -- target/rpc.sh@33 -- # stats='{ 00:13:21.001 "tick_rate": 2700000000, 00:13:21.001 "poll_groups": [ 00:13:21.001 { 00:13:21.001 "name": "nvmf_tgt_poll_group_0", 00:13:21.001 "admin_qpairs": 0, 00:13:21.001 "io_qpairs": 0, 00:13:21.001 "current_admin_qpairs": 0, 00:13:21.001 "current_io_qpairs": 0, 00:13:21.001 "pending_bdev_io": 0, 00:13:21.001 "completed_nvme_io": 0, 00:13:21.001 "transports": [ 00:13:21.001 { 00:13:21.001 "trtype": "TCP" 00:13:21.001 } 00:13:21.001 ] 00:13:21.001 }, 00:13:21.001 { 00:13:21.001 "name": "nvmf_tgt_poll_group_1", 00:13:21.001 "admin_qpairs": 0, 00:13:21.001 "io_qpairs": 0, 00:13:21.001 "current_admin_qpairs": 0, 00:13:21.001 "current_io_qpairs": 0, 00:13:21.001 "pending_bdev_io": 0, 00:13:21.001 "completed_nvme_io": 0, 00:13:21.001 "transports": [ 00:13:21.001 { 00:13:21.001 "trtype": "TCP" 00:13:21.001 } 00:13:21.001 ] 00:13:21.001 }, 00:13:21.001 { 00:13:21.001 "name": "nvmf_tgt_poll_group_2", 00:13:21.001 "admin_qpairs": 0, 00:13:21.001 "io_qpairs": 0, 00:13:21.001 "current_admin_qpairs": 0, 00:13:21.001 "current_io_qpairs": 0, 00:13:21.001 "pending_bdev_io": 0, 00:13:21.001 "completed_nvme_io": 0, 00:13:21.001 "transports": [ 00:13:21.001 { 00:13:21.001 "trtype": "TCP" 00:13:21.001 } 00:13:21.001 ] 00:13:21.001 }, 00:13:21.001 { 00:13:21.001 "name": "nvmf_tgt_poll_group_3", 00:13:21.001 "admin_qpairs": 0, 00:13:21.001 "io_qpairs": 0, 00:13:21.001 "current_admin_qpairs": 0, 00:13:21.001 "current_io_qpairs": 0, 00:13:21.001 "pending_bdev_io": 0, 00:13:21.001 "completed_nvme_io": 0, 00:13:21.001 "transports": [ 00:13:21.001 { 00:13:21.001 "trtype": "TCP" 00:13:21.001 } 00:13:21.001 ] 00:13:21.001 } 00:13:21.001 ] 00:13:21.001 }' 00:13:21.001 15:59:44 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:21.001 15:59:44 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:21.001 15:59:44 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:21.001 15:59:44 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:21.001 15:59:44 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:21.001 15:59:44 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:21.001 15:59:44 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:21.001 15:59:44 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:21.001 15:59:44 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:21.259 15:59:44 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:21.259 15:59:44 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:21.259 15:59:44 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:21.259 15:59:44 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:21.259 15:59:44 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:21.259 15:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.259 15:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:21.259 Malloc1 00:13:21.259 15:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.259 15:59:44 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:21.259 15:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.259 15:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:21.259 15:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.259 15:59:44 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:21.259 15:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.259 15:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:21.259 15:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.259 15:59:44 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:21.259 15:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.259 15:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:21.259 15:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.259 15:59:44 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:21.259 15:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.259 15:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:21.259 [2024-11-18 15:59:44.669154] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:21.259 15:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.259 15:59:44 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:21.259 15:59:44 -- common/autotest_common.sh@650 -- # local es=0 00:13:21.259 15:59:44 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:21.259 15:59:44 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:21.259 15:59:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:21.259 15:59:44 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:21.259 15:59:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:21.259 15:59:44 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:21.259 15:59:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:21.259 15:59:44 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:21.259 15:59:44 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:21.259 15:59:44 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:21.259 [2024-11-18 15:59:44.691681] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:21.259 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:21.259 could not add new controller: failed to write to nvme-fabrics device 00:13:21.259 15:59:44 -- common/autotest_common.sh@653 -- # es=1 00:13:21.259 15:59:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:21.259 15:59:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:21.259 15:59:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:21.259 15:59:44 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:21.259 15:59:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.259 15:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:21.259 15:59:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.259 15:59:44 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:21.824 15:59:45 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:21.824 15:59:45 -- common/autotest_common.sh@1187 -- # local i=0 00:13:21.824 15:59:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:21.824 15:59:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:21.824 15:59:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:24.350 15:59:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:24.350 15:59:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:24.350 15:59:47 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:24.350 15:59:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:24.351 15:59:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:24.351 15:59:47 -- common/autotest_common.sh@1197 -- # return 0 00:13:24.351 15:59:47 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:24.351 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:24.351 15:59:47 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:24.351 15:59:47 -- common/autotest_common.sh@1208 -- # local i=0 00:13:24.351 15:59:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:24.351 15:59:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:24.351 15:59:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:24.351 15:59:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:24.351 15:59:47 -- common/autotest_common.sh@1220 -- # return 0 00:13:24.351 15:59:47 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:24.351 15:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.351 15:59:47 -- common/autotest_common.sh@10 -- # set +x 00:13:24.351 15:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.351 15:59:47 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:24.351 15:59:47 -- common/autotest_common.sh@650 -- # local es=0 00:13:24.351 15:59:47 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:24.351 15:59:47 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:24.351 15:59:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:24.351 15:59:47 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:24.351 15:59:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:24.351 15:59:47 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:24.351 15:59:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:24.351 15:59:47 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:24.351 15:59:47 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:24.351 15:59:47 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:24.351 [2024-11-18 15:59:47.491374] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:24.351 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:24.351 could not add new controller: failed to write to nvme-fabrics device 00:13:24.351 15:59:47 -- common/autotest_common.sh@653 -- # es=1 00:13:24.351 15:59:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:24.351 15:59:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:24.351 15:59:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:24.351 15:59:47 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:24.351 15:59:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.351 15:59:47 -- common/autotest_common.sh@10 -- # set +x 00:13:24.351 15:59:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.351 15:59:47 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:24.965 15:59:48 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:24.965 15:59:48 -- common/autotest_common.sh@1187 -- # local i=0 00:13:24.965 15:59:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:24.965 15:59:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:24.965 15:59:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:26.885 15:59:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:26.885 15:59:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:26.885 15:59:50 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:26.885 15:59:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:26.885 15:59:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:26.885 15:59:50 -- common/autotest_common.sh@1197 -- # return 0 00:13:26.885 15:59:50 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:26.885 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:26.885 15:59:50 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:26.885 15:59:50 -- common/autotest_common.sh@1208 -- # local i=0 00:13:26.885 15:59:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:26.885 15:59:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:26.885 15:59:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:26.885 15:59:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:26.885 15:59:50 -- common/autotest_common.sh@1220 -- # return 0 00:13:26.885 15:59:50 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:26.885 15:59:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.885 15:59:50 -- common/autotest_common.sh@10 -- # set +x 00:13:26.885 15:59:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.885 15:59:50 -- target/rpc.sh@81 -- # seq 1 5 00:13:26.885 15:59:50 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:26.885 15:59:50 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:26.885 15:59:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.885 15:59:50 -- common/autotest_common.sh@10 -- # set +x 00:13:26.885 15:59:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.885 15:59:50 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:26.885 15:59:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.885 15:59:50 -- common/autotest_common.sh@10 -- # set +x 00:13:26.885 [2024-11-18 15:59:50.369795] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:26.885 15:59:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.885 15:59:50 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:26.885 15:59:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.885 15:59:50 -- common/autotest_common.sh@10 -- # set +x 00:13:26.885 15:59:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.885 15:59:50 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:26.885 15:59:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.885 15:59:50 -- common/autotest_common.sh@10 -- # set +x 00:13:26.885 15:59:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.885 15:59:50 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:27.829 15:59:51 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:27.829 15:59:51 -- common/autotest_common.sh@1187 -- # local i=0 00:13:27.829 15:59:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:27.829 15:59:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:27.829 15:59:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:29.729 15:59:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:29.729 15:59:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:29.729 15:59:53 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:29.729 15:59:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:29.729 15:59:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:29.729 15:59:53 -- common/autotest_common.sh@1197 -- # return 0 00:13:29.729 15:59:53 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:29.729 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:29.730 15:59:53 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:29.730 15:59:53 -- common/autotest_common.sh@1208 -- # local i=0 00:13:29.730 15:59:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:29.730 15:59:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:29.730 15:59:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:29.730 15:59:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:29.730 15:59:53 -- common/autotest_common.sh@1220 -- # return 0 00:13:29.730 15:59:53 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:29.730 15:59:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 15:59:53 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 15:59:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 15:59:53 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:29.730 15:59:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 15:59:53 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 15:59:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 15:59:53 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:29.730 15:59:53 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:29.730 15:59:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 15:59:53 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 15:59:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 15:59:53 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:29.730 15:59:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 15:59:53 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 [2024-11-18 15:59:53.192213] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:29.730 15:59:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 15:59:53 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:29.730 15:59:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 15:59:53 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 15:59:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 15:59:53 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:29.730 15:59:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 15:59:53 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 15:59:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 15:59:53 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:30.296 15:59:53 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:30.296 15:59:53 -- common/autotest_common.sh@1187 -- # local i=0 00:13:30.296 15:59:53 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:30.296 15:59:53 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:30.296 15:59:53 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:32.823 15:59:55 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:32.823 15:59:55 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:32.823 15:59:55 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:32.823 15:59:55 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:32.823 15:59:55 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:32.823 15:59:55 -- common/autotest_common.sh@1197 -- # return 0 00:13:32.823 15:59:55 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:32.823 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:32.823 15:59:55 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:32.823 15:59:55 -- common/autotest_common.sh@1208 -- # local i=0 00:13:32.823 15:59:55 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:32.823 15:59:55 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:32.823 15:59:55 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:32.823 15:59:55 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:32.823 15:59:55 -- common/autotest_common.sh@1220 -- # return 0 00:13:32.823 15:59:55 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:32.823 15:59:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.823 15:59:55 -- common/autotest_common.sh@10 -- # set +x 00:13:32.823 15:59:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.823 15:59:56 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:32.823 15:59:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.823 15:59:56 -- common/autotest_common.sh@10 -- # set +x 00:13:32.823 15:59:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.823 15:59:56 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:32.823 15:59:56 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:32.823 15:59:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.823 15:59:56 -- common/autotest_common.sh@10 -- # set +x 00:13:32.823 15:59:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.823 15:59:56 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:32.823 15:59:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.823 15:59:56 -- common/autotest_common.sh@10 -- # set +x 00:13:32.823 [2024-11-18 15:59:56.021328] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:32.823 15:59:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.823 15:59:56 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:32.823 15:59:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.823 15:59:56 -- common/autotest_common.sh@10 -- # set +x 00:13:32.823 15:59:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.823 15:59:56 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:32.823 15:59:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.823 15:59:56 -- common/autotest_common.sh@10 -- # set +x 00:13:32.823 15:59:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.823 15:59:56 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:33.082 15:59:56 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:33.082 15:59:56 -- common/autotest_common.sh@1187 -- # local i=0 00:13:33.082 15:59:56 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:33.082 15:59:56 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:33.082 15:59:56 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:35.608 15:59:58 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:35.608 15:59:58 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:35.608 15:59:58 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:35.608 15:59:58 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:35.608 15:59:58 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:35.608 15:59:58 -- common/autotest_common.sh@1197 -- # return 0 00:13:35.608 15:59:58 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:35.608 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:35.608 15:59:58 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:35.608 15:59:58 -- common/autotest_common.sh@1208 -- # local i=0 00:13:35.608 15:59:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:35.608 15:59:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:35.608 15:59:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:35.608 15:59:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:35.608 15:59:58 -- common/autotest_common.sh@1220 -- # return 0 00:13:35.608 15:59:58 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:35.608 15:59:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.608 15:59:58 -- common/autotest_common.sh@10 -- # set +x 00:13:35.608 15:59:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.608 15:59:58 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:35.608 15:59:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.608 15:59:58 -- common/autotest_common.sh@10 -- # set +x 00:13:35.608 15:59:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.608 15:59:58 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:35.608 15:59:58 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:35.608 15:59:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.608 15:59:58 -- common/autotest_common.sh@10 -- # set +x 00:13:35.608 15:59:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.608 15:59:58 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:35.608 15:59:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.608 15:59:58 -- common/autotest_common.sh@10 -- # set +x 00:13:35.608 [2024-11-18 15:59:58.808446] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:35.608 15:59:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.608 15:59:58 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:35.608 15:59:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.608 15:59:58 -- common/autotest_common.sh@10 -- # set +x 00:13:35.608 15:59:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.608 15:59:58 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:35.608 15:59:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.608 15:59:58 -- common/autotest_common.sh@10 -- # set +x 00:13:35.608 15:59:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.608 15:59:58 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:36.171 15:59:59 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:36.171 15:59:59 -- common/autotest_common.sh@1187 -- # local i=0 00:13:36.171 15:59:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:36.171 15:59:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:36.171 15:59:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:38.070 16:00:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:38.070 16:00:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:38.070 16:00:01 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:38.070 16:00:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:38.070 16:00:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:38.070 16:00:01 -- common/autotest_common.sh@1197 -- # return 0 00:13:38.070 16:00:01 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:38.070 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:38.070 16:00:01 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:38.070 16:00:01 -- common/autotest_common.sh@1208 -- # local i=0 00:13:38.070 16:00:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:38.070 16:00:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:38.070 16:00:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:38.070 16:00:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:38.070 16:00:01 -- common/autotest_common.sh@1220 -- # return 0 00:13:38.070 16:00:01 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:38.070 16:00:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.070 16:00:01 -- common/autotest_common.sh@10 -- # set +x 00:13:38.070 16:00:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.070 16:00:01 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:38.070 16:00:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.070 16:00:01 -- common/autotest_common.sh@10 -- # set +x 00:13:38.070 16:00:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.070 16:00:01 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:38.070 16:00:01 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:38.070 16:00:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.070 16:00:01 -- common/autotest_common.sh@10 -- # set +x 00:13:38.071 16:00:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.071 16:00:01 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:38.071 16:00:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.071 16:00:01 -- common/autotest_common.sh@10 -- # set +x 00:13:38.071 [2024-11-18 16:00:01.635756] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:38.071 16:00:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.071 16:00:01 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:38.071 16:00:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.071 16:00:01 -- common/autotest_common.sh@10 -- # set +x 00:13:38.071 16:00:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.071 16:00:01 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:38.071 16:00:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.071 16:00:01 -- common/autotest_common.sh@10 -- # set +x 00:13:38.071 16:00:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.071 16:00:01 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:39.005 16:00:02 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:39.005 16:00:02 -- common/autotest_common.sh@1187 -- # local i=0 00:13:39.005 16:00:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:39.005 16:00:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:39.005 16:00:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:40.906 16:00:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:40.906 16:00:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:40.906 16:00:04 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:40.906 16:00:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:40.906 16:00:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:40.906 16:00:04 -- common/autotest_common.sh@1197 -- # return 0 00:13:40.906 16:00:04 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:40.906 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:40.906 16:00:04 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:40.906 16:00:04 -- common/autotest_common.sh@1208 -- # local i=0 00:13:40.906 16:00:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:40.906 16:00:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:40.906 16:00:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:40.906 16:00:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:40.906 16:00:04 -- common/autotest_common.sh@1220 -- # return 0 00:13:40.906 16:00:04 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.906 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.906 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.906 16:00:04 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.906 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.906 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.906 16:00:04 -- target/rpc.sh@99 -- # seq 1 5 00:13:40.906 16:00:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:40.906 16:00:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.906 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.906 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.906 16:00:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.906 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.906 [2024-11-18 16:00:04.412633] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:40.906 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.906 16:00:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.906 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.906 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.906 16:00:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.906 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.906 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.906 16:00:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.906 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.906 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.906 16:00:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.906 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.906 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.906 16:00:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:40.906 16:00:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.906 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.906 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.906 16:00:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.906 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.906 [2024-11-18 16:00:04.460707] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:40.906 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.906 16:00:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.906 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.906 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.906 16:00:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:40.906 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.907 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.907 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.907 16:00:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:40.907 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.907 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:40.907 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.907 16:00:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:40.907 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.907 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.165 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.165 16:00:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:41.165 16:00:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:41.165 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.165 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.165 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.165 16:00:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:41.165 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.165 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.165 [2024-11-18 16:00:04.508872] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:41.165 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.165 16:00:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:41.165 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.165 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.165 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.165 16:00:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:41.165 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.165 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.165 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.165 16:00:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.165 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.165 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.165 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:41.166 16:00:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 [2024-11-18 16:00:04.557045] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:41.166 16:00:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 [2024-11-18 16:00:04.605222] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:41.166 16:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.166 16:00:04 -- common/autotest_common.sh@10 -- # set +x 00:13:41.166 16:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.166 16:00:04 -- target/rpc.sh@110 -- # stats='{ 00:13:41.166 "tick_rate": 2700000000, 00:13:41.166 "poll_groups": [ 00:13:41.166 { 00:13:41.166 "name": "nvmf_tgt_poll_group_0", 00:13:41.166 "admin_qpairs": 2, 00:13:41.166 "io_qpairs": 84, 00:13:41.166 "current_admin_qpairs": 0, 00:13:41.166 "current_io_qpairs": 0, 00:13:41.166 "pending_bdev_io": 0, 00:13:41.166 "completed_nvme_io": 233, 00:13:41.166 "transports": [ 00:13:41.166 { 00:13:41.166 "trtype": "TCP" 00:13:41.166 } 00:13:41.166 ] 00:13:41.166 }, 00:13:41.166 { 00:13:41.166 "name": "nvmf_tgt_poll_group_1", 00:13:41.166 "admin_qpairs": 2, 00:13:41.166 "io_qpairs": 84, 00:13:41.166 "current_admin_qpairs": 0, 00:13:41.166 "current_io_qpairs": 0, 00:13:41.166 "pending_bdev_io": 0, 00:13:41.166 "completed_nvme_io": 135, 00:13:41.166 "transports": [ 00:13:41.166 { 00:13:41.166 "trtype": "TCP" 00:13:41.166 } 00:13:41.166 ] 00:13:41.166 }, 00:13:41.166 { 00:13:41.166 "name": "nvmf_tgt_poll_group_2", 00:13:41.166 "admin_qpairs": 1, 00:13:41.166 "io_qpairs": 84, 00:13:41.166 "current_admin_qpairs": 0, 00:13:41.166 "current_io_qpairs": 0, 00:13:41.166 "pending_bdev_io": 0, 00:13:41.166 "completed_nvme_io": 184, 00:13:41.166 "transports": [ 00:13:41.166 { 00:13:41.166 "trtype": "TCP" 00:13:41.166 } 00:13:41.166 ] 00:13:41.166 }, 00:13:41.166 { 00:13:41.166 "name": "nvmf_tgt_poll_group_3", 00:13:41.166 "admin_qpairs": 2, 00:13:41.166 "io_qpairs": 84, 00:13:41.166 "current_admin_qpairs": 0, 00:13:41.166 "current_io_qpairs": 0, 00:13:41.166 "pending_bdev_io": 0, 00:13:41.166 "completed_nvme_io": 134, 00:13:41.166 "transports": [ 00:13:41.166 { 00:13:41.166 "trtype": "TCP" 00:13:41.166 } 00:13:41.166 ] 00:13:41.166 } 00:13:41.166 ] 00:13:41.166 }' 00:13:41.166 16:00:04 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:41.166 16:00:04 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:41.166 16:00:04 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:41.166 16:00:04 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:41.166 16:00:04 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:41.166 16:00:04 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:41.166 16:00:04 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:41.166 16:00:04 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:41.166 16:00:04 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:41.167 16:00:04 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:41.167 16:00:04 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:41.167 16:00:04 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:41.167 16:00:04 -- target/rpc.sh@123 -- # nvmftestfini 00:13:41.167 16:00:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:41.167 16:00:04 -- nvmf/common.sh@116 -- # sync 00:13:41.167 16:00:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:41.167 16:00:04 -- nvmf/common.sh@119 -- # set +e 00:13:41.167 16:00:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:41.167 16:00:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:41.167 rmmod nvme_tcp 00:13:41.167 rmmod nvme_fabrics 00:13:41.425 rmmod nvme_keyring 00:13:41.425 16:00:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:41.425 16:00:04 -- nvmf/common.sh@123 -- # set -e 00:13:41.425 16:00:04 -- nvmf/common.sh@124 -- # return 0 00:13:41.425 16:00:04 -- nvmf/common.sh@477 -- # '[' -n 1529385 ']' 00:13:41.425 16:00:04 -- nvmf/common.sh@478 -- # killprocess 1529385 00:13:41.425 16:00:04 -- common/autotest_common.sh@936 -- # '[' -z 1529385 ']' 00:13:41.425 16:00:04 -- common/autotest_common.sh@940 -- # kill -0 1529385 00:13:41.425 16:00:04 -- common/autotest_common.sh@941 -- # uname 00:13:41.425 16:00:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:41.425 16:00:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1529385 00:13:41.425 16:00:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:41.425 16:00:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:41.425 16:00:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1529385' 00:13:41.425 killing process with pid 1529385 00:13:41.425 16:00:04 -- common/autotest_common.sh@955 -- # kill 1529385 00:13:41.425 16:00:04 -- common/autotest_common.sh@960 -- # wait 1529385 00:13:41.683 16:00:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:41.683 16:00:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:41.683 16:00:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:41.683 16:00:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:41.683 16:00:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:41.683 16:00:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:41.683 16:00:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:41.683 16:00:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:43.583 16:00:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:43.583 00:13:43.583 real 0m26.156s 00:13:43.583 user 1m25.486s 00:13:43.583 sys 0m4.185s 00:13:43.583 16:00:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:43.583 16:00:07 -- common/autotest_common.sh@10 -- # set +x 00:13:43.583 ************************************ 00:13:43.583 END TEST nvmf_rpc 00:13:43.583 ************************************ 00:13:43.583 16:00:07 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:43.583 16:00:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:43.583 16:00:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:43.583 16:00:07 -- common/autotest_common.sh@10 -- # set +x 00:13:43.583 ************************************ 00:13:43.583 START TEST nvmf_invalid 00:13:43.583 ************************************ 00:13:43.583 16:00:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:43.842 * Looking for test storage... 00:13:43.842 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:43.842 16:00:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:43.842 16:00:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:43.842 16:00:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:43.842 16:00:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:43.842 16:00:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:43.842 16:00:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:43.842 16:00:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:43.842 16:00:07 -- scripts/common.sh@335 -- # IFS=.-: 00:13:43.842 16:00:07 -- scripts/common.sh@335 -- # read -ra ver1 00:13:43.842 16:00:07 -- scripts/common.sh@336 -- # IFS=.-: 00:13:43.842 16:00:07 -- scripts/common.sh@336 -- # read -ra ver2 00:13:43.842 16:00:07 -- scripts/common.sh@337 -- # local 'op=<' 00:13:43.842 16:00:07 -- scripts/common.sh@339 -- # ver1_l=2 00:13:43.842 16:00:07 -- scripts/common.sh@340 -- # ver2_l=1 00:13:43.842 16:00:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:43.842 16:00:07 -- scripts/common.sh@343 -- # case "$op" in 00:13:43.842 16:00:07 -- scripts/common.sh@344 -- # : 1 00:13:43.842 16:00:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:43.842 16:00:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:43.842 16:00:07 -- scripts/common.sh@364 -- # decimal 1 00:13:43.842 16:00:07 -- scripts/common.sh@352 -- # local d=1 00:13:43.842 16:00:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:43.842 16:00:07 -- scripts/common.sh@354 -- # echo 1 00:13:43.842 16:00:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:43.842 16:00:07 -- scripts/common.sh@365 -- # decimal 2 00:13:43.842 16:00:07 -- scripts/common.sh@352 -- # local d=2 00:13:43.842 16:00:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:43.842 16:00:07 -- scripts/common.sh@354 -- # echo 2 00:13:43.842 16:00:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:43.842 16:00:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:43.842 16:00:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:43.842 16:00:07 -- scripts/common.sh@367 -- # return 0 00:13:43.842 16:00:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:43.842 16:00:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:43.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.842 --rc genhtml_branch_coverage=1 00:13:43.842 --rc genhtml_function_coverage=1 00:13:43.842 --rc genhtml_legend=1 00:13:43.842 --rc geninfo_all_blocks=1 00:13:43.842 --rc geninfo_unexecuted_blocks=1 00:13:43.842 00:13:43.842 ' 00:13:43.842 16:00:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:43.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.843 --rc genhtml_branch_coverage=1 00:13:43.843 --rc genhtml_function_coverage=1 00:13:43.843 --rc genhtml_legend=1 00:13:43.843 --rc geninfo_all_blocks=1 00:13:43.843 --rc geninfo_unexecuted_blocks=1 00:13:43.843 00:13:43.843 ' 00:13:43.843 16:00:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:43.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.843 --rc genhtml_branch_coverage=1 00:13:43.843 --rc genhtml_function_coverage=1 00:13:43.843 --rc genhtml_legend=1 00:13:43.843 --rc geninfo_all_blocks=1 00:13:43.843 --rc geninfo_unexecuted_blocks=1 00:13:43.843 00:13:43.843 ' 00:13:43.843 16:00:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:43.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.843 --rc genhtml_branch_coverage=1 00:13:43.843 --rc genhtml_function_coverage=1 00:13:43.843 --rc genhtml_legend=1 00:13:43.843 --rc geninfo_all_blocks=1 00:13:43.843 --rc geninfo_unexecuted_blocks=1 00:13:43.843 00:13:43.843 ' 00:13:43.843 16:00:07 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:43.843 16:00:07 -- nvmf/common.sh@7 -- # uname -s 00:13:43.843 16:00:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:43.843 16:00:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:43.843 16:00:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:43.843 16:00:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:43.843 16:00:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:43.843 16:00:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:43.843 16:00:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:43.843 16:00:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:43.843 16:00:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:43.843 16:00:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:43.843 16:00:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:43.843 16:00:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:43.843 16:00:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:43.843 16:00:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:43.843 16:00:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:43.843 16:00:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:43.843 16:00:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:43.843 16:00:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:43.843 16:00:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:43.843 16:00:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.843 16:00:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.843 16:00:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.843 16:00:07 -- paths/export.sh@5 -- # export PATH 00:13:43.843 16:00:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.843 16:00:07 -- nvmf/common.sh@46 -- # : 0 00:13:43.843 16:00:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:43.843 16:00:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:43.843 16:00:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:43.843 16:00:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:43.843 16:00:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:43.843 16:00:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:43.843 16:00:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:43.843 16:00:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:43.843 16:00:07 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:43.843 16:00:07 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:43.843 16:00:07 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:43.843 16:00:07 -- target/invalid.sh@14 -- # target=foobar 00:13:43.843 16:00:07 -- target/invalid.sh@16 -- # RANDOM=0 00:13:43.843 16:00:07 -- target/invalid.sh@34 -- # nvmftestinit 00:13:43.843 16:00:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:43.843 16:00:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:43.843 16:00:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:43.843 16:00:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:43.843 16:00:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:43.843 16:00:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:43.843 16:00:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:43.843 16:00:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:43.843 16:00:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:43.843 16:00:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:43.843 16:00:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:43.843 16:00:07 -- common/autotest_common.sh@10 -- # set +x 00:13:45.751 16:00:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:45.751 16:00:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:45.751 16:00:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:45.751 16:00:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:45.751 16:00:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:45.751 16:00:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:45.751 16:00:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:45.751 16:00:09 -- nvmf/common.sh@294 -- # net_devs=() 00:13:45.751 16:00:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:45.751 16:00:09 -- nvmf/common.sh@295 -- # e810=() 00:13:45.751 16:00:09 -- nvmf/common.sh@295 -- # local -ga e810 00:13:45.751 16:00:09 -- nvmf/common.sh@296 -- # x722=() 00:13:45.751 16:00:09 -- nvmf/common.sh@296 -- # local -ga x722 00:13:45.751 16:00:09 -- nvmf/common.sh@297 -- # mlx=() 00:13:45.751 16:00:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:45.751 16:00:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:45.751 16:00:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:45.751 16:00:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:45.751 16:00:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:45.751 16:00:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:45.751 16:00:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:45.751 16:00:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:45.751 16:00:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:45.751 16:00:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:45.751 16:00:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:45.751 16:00:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:45.751 16:00:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:45.751 16:00:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:45.751 16:00:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:45.751 16:00:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:45.751 16:00:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:45.751 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:45.751 16:00:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:45.751 16:00:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:45.751 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:45.751 16:00:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:45.751 16:00:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:45.751 16:00:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:45.751 16:00:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:45.751 16:00:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:45.751 16:00:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:45.751 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:45.751 16:00:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:45.751 16:00:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:45.751 16:00:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:45.751 16:00:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:45.751 16:00:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:45.751 16:00:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:45.751 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:45.751 16:00:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:45.751 16:00:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:45.751 16:00:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:45.751 16:00:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:45.751 16:00:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:45.751 16:00:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:45.751 16:00:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:45.751 16:00:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:45.751 16:00:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:45.751 16:00:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:45.751 16:00:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:45.751 16:00:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:45.751 16:00:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:45.751 16:00:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:45.751 16:00:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:45.751 16:00:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:45.751 16:00:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:45.751 16:00:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:46.010 16:00:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:46.010 16:00:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:46.010 16:00:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:46.010 16:00:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:46.010 16:00:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:46.010 16:00:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:46.010 16:00:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:46.010 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:46.010 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.394 ms 00:13:46.010 00:13:46.010 --- 10.0.0.2 ping statistics --- 00:13:46.010 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:46.010 rtt min/avg/max/mdev = 0.394/0.394/0.394/0.000 ms 00:13:46.010 16:00:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:46.010 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:46.010 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:13:46.010 00:13:46.010 --- 10.0.0.1 ping statistics --- 00:13:46.010 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:46.010 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:13:46.010 16:00:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:46.010 16:00:09 -- nvmf/common.sh@410 -- # return 0 00:13:46.010 16:00:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:46.010 16:00:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:46.010 16:00:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:46.010 16:00:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:46.010 16:00:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:46.010 16:00:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:46.010 16:00:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:46.010 16:00:09 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:46.010 16:00:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:46.010 16:00:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:46.010 16:00:09 -- common/autotest_common.sh@10 -- # set +x 00:13:46.010 16:00:09 -- nvmf/common.sh@469 -- # nvmfpid=1534683 00:13:46.010 16:00:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:46.010 16:00:09 -- nvmf/common.sh@470 -- # waitforlisten 1534683 00:13:46.010 16:00:09 -- common/autotest_common.sh@829 -- # '[' -z 1534683 ']' 00:13:46.010 16:00:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:46.010 16:00:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:46.010 16:00:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:46.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:46.010 16:00:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:46.010 16:00:09 -- common/autotest_common.sh@10 -- # set +x 00:13:46.010 [2024-11-18 16:00:09.491274] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:46.010 [2024-11-18 16:00:09.491352] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:46.010 EAL: No free 2048 kB hugepages reported on node 1 00:13:46.010 [2024-11-18 16:00:09.561975] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:46.269 [2024-11-18 16:00:09.655910] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:46.269 [2024-11-18 16:00:09.656061] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:46.269 [2024-11-18 16:00:09.656080] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:46.269 [2024-11-18 16:00:09.656103] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:46.269 [2024-11-18 16:00:09.656168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:46.269 [2024-11-18 16:00:09.656203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:46.269 [2024-11-18 16:00:09.656230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:46.269 [2024-11-18 16:00:09.656233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:47.202 16:00:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:47.202 16:00:10 -- common/autotest_common.sh@862 -- # return 0 00:13:47.202 16:00:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:47.202 16:00:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:47.202 16:00:10 -- common/autotest_common.sh@10 -- # set +x 00:13:47.202 16:00:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:47.202 16:00:10 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:47.202 16:00:10 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode2550 00:13:47.202 [2024-11-18 16:00:10.721010] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:47.202 16:00:10 -- target/invalid.sh@40 -- # out='request: 00:13:47.202 { 00:13:47.202 "nqn": "nqn.2016-06.io.spdk:cnode2550", 00:13:47.202 "tgt_name": "foobar", 00:13:47.202 "method": "nvmf_create_subsystem", 00:13:47.202 "req_id": 1 00:13:47.202 } 00:13:47.202 Got JSON-RPC error response 00:13:47.202 response: 00:13:47.202 { 00:13:47.202 "code": -32603, 00:13:47.202 "message": "Unable to find target foobar" 00:13:47.202 }' 00:13:47.202 16:00:10 -- target/invalid.sh@41 -- # [[ request: 00:13:47.202 { 00:13:47.202 "nqn": "nqn.2016-06.io.spdk:cnode2550", 00:13:47.202 "tgt_name": "foobar", 00:13:47.202 "method": "nvmf_create_subsystem", 00:13:47.202 "req_id": 1 00:13:47.202 } 00:13:47.202 Got JSON-RPC error response 00:13:47.202 response: 00:13:47.202 { 00:13:47.202 "code": -32603, 00:13:47.202 "message": "Unable to find target foobar" 00:13:47.202 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:47.202 16:00:10 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:47.202 16:00:10 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode8755 00:13:47.460 [2024-11-18 16:00:10.981933] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8755: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:47.460 16:00:11 -- target/invalid.sh@45 -- # out='request: 00:13:47.460 { 00:13:47.460 "nqn": "nqn.2016-06.io.spdk:cnode8755", 00:13:47.460 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:47.460 "method": "nvmf_create_subsystem", 00:13:47.460 "req_id": 1 00:13:47.460 } 00:13:47.460 Got JSON-RPC error response 00:13:47.460 response: 00:13:47.460 { 00:13:47.460 "code": -32602, 00:13:47.460 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:47.460 }' 00:13:47.460 16:00:11 -- target/invalid.sh@46 -- # [[ request: 00:13:47.460 { 00:13:47.460 "nqn": "nqn.2016-06.io.spdk:cnode8755", 00:13:47.460 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:47.460 "method": "nvmf_create_subsystem", 00:13:47.460 "req_id": 1 00:13:47.460 } 00:13:47.460 Got JSON-RPC error response 00:13:47.460 response: 00:13:47.460 { 00:13:47.460 "code": -32602, 00:13:47.460 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:47.460 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:47.460 16:00:11 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:47.460 16:00:11 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode17983 00:13:47.718 [2024-11-18 16:00:11.234709] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17983: invalid model number 'SPDK_Controller' 00:13:47.718 16:00:11 -- target/invalid.sh@50 -- # out='request: 00:13:47.718 { 00:13:47.718 "nqn": "nqn.2016-06.io.spdk:cnode17983", 00:13:47.718 "model_number": "SPDK_Controller\u001f", 00:13:47.718 "method": "nvmf_create_subsystem", 00:13:47.718 "req_id": 1 00:13:47.718 } 00:13:47.718 Got JSON-RPC error response 00:13:47.718 response: 00:13:47.718 { 00:13:47.718 "code": -32602, 00:13:47.718 "message": "Invalid MN SPDK_Controller\u001f" 00:13:47.718 }' 00:13:47.718 16:00:11 -- target/invalid.sh@51 -- # [[ request: 00:13:47.718 { 00:13:47.718 "nqn": "nqn.2016-06.io.spdk:cnode17983", 00:13:47.718 "model_number": "SPDK_Controller\u001f", 00:13:47.718 "method": "nvmf_create_subsystem", 00:13:47.718 "req_id": 1 00:13:47.718 } 00:13:47.718 Got JSON-RPC error response 00:13:47.718 response: 00:13:47.718 { 00:13:47.718 "code": -32602, 00:13:47.718 "message": "Invalid MN SPDK_Controller\u001f" 00:13:47.718 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:47.718 16:00:11 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:47.718 16:00:11 -- target/invalid.sh@19 -- # local length=21 ll 00:13:47.718 16:00:11 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:47.718 16:00:11 -- target/invalid.sh@21 -- # local chars 00:13:47.718 16:00:11 -- target/invalid.sh@22 -- # local string 00:13:47.718 16:00:11 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:47.718 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.718 16:00:11 -- target/invalid.sh@25 -- # printf %x 89 00:13:47.718 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:47.718 16:00:11 -- target/invalid.sh@25 -- # string+=Y 00:13:47.718 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.718 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.718 16:00:11 -- target/invalid.sh@25 -- # printf %x 94 00:13:47.718 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:47.718 16:00:11 -- target/invalid.sh@25 -- # string+='^' 00:13:47.718 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.718 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.718 16:00:11 -- target/invalid.sh@25 -- # printf %x 85 00:13:47.718 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:47.718 16:00:11 -- target/invalid.sh@25 -- # string+=U 00:13:47.718 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.718 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.718 16:00:11 -- target/invalid.sh@25 -- # printf %x 91 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # string+='[' 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # printf %x 121 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # string+=y 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # printf %x 59 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # string+=';' 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # printf %x 117 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # string+=u 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # printf %x 115 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # string+=s 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # printf %x 84 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x54' 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # string+=T 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # printf %x 114 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x72' 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # string+=r 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # printf %x 80 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # string+=P 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # printf %x 116 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # string+=t 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # printf %x 42 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # string+='*' 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.719 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.719 16:00:11 -- target/invalid.sh@25 -- # printf %x 120 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x78' 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # string+=x 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # printf %x 76 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # string+=L 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # printf %x 35 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x23' 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # string+='#' 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # printf %x 111 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # string+=o 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # printf %x 126 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # string+='~' 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # printf %x 58 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # string+=: 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # printf %x 93 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # string+=']' 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # printf %x 105 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:47.977 16:00:11 -- target/invalid.sh@25 -- # string+=i 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:47.977 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:47.977 16:00:11 -- target/invalid.sh@28 -- # [[ Y == \- ]] 00:13:47.977 16:00:11 -- target/invalid.sh@31 -- # echo 'Y^U[y;usTrPt*xL#o~:]i' 00:13:47.977 16:00:11 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'Y^U[y;usTrPt*xL#o~:]i' nqn.2016-06.io.spdk:cnode16054 00:13:48.236 [2024-11-18 16:00:11.567818] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16054: invalid serial number 'Y^U[y;usTrPt*xL#o~:]i' 00:13:48.236 16:00:11 -- target/invalid.sh@54 -- # out='request: 00:13:48.236 { 00:13:48.236 "nqn": "nqn.2016-06.io.spdk:cnode16054", 00:13:48.236 "serial_number": "Y^U[y;usTrPt*xL#o~:]i", 00:13:48.236 "method": "nvmf_create_subsystem", 00:13:48.236 "req_id": 1 00:13:48.236 } 00:13:48.236 Got JSON-RPC error response 00:13:48.236 response: 00:13:48.236 { 00:13:48.236 "code": -32602, 00:13:48.236 "message": "Invalid SN Y^U[y;usTrPt*xL#o~:]i" 00:13:48.236 }' 00:13:48.236 16:00:11 -- target/invalid.sh@55 -- # [[ request: 00:13:48.236 { 00:13:48.236 "nqn": "nqn.2016-06.io.spdk:cnode16054", 00:13:48.236 "serial_number": "Y^U[y;usTrPt*xL#o~:]i", 00:13:48.236 "method": "nvmf_create_subsystem", 00:13:48.236 "req_id": 1 00:13:48.236 } 00:13:48.236 Got JSON-RPC error response 00:13:48.236 response: 00:13:48.236 { 00:13:48.236 "code": -32602, 00:13:48.236 "message": "Invalid SN Y^U[y;usTrPt*xL#o~:]i" 00:13:48.236 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:48.236 16:00:11 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:48.236 16:00:11 -- target/invalid.sh@19 -- # local length=41 ll 00:13:48.236 16:00:11 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:48.236 16:00:11 -- target/invalid.sh@21 -- # local chars 00:13:48.236 16:00:11 -- target/invalid.sh@22 -- # local string 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 124 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+='|' 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 64 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+=@ 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 71 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+=G 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 34 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x22' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+='"' 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 123 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+='{' 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 114 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x72' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+=r 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 66 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x42' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+=B 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 67 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x43' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+=C 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 100 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+=d 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 92 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+='\' 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 70 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+=F 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 61 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+== 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 42 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+='*' 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 73 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x49' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+=I 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 94 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # string+='^' 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.236 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # printf %x 67 00:13:48.236 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x43' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=C 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 80 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=P 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 86 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x56' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=V 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 44 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=, 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 77 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=M 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 120 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x78' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=x 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 107 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=k 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 48 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=0 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 76 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=L 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 122 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=z 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 66 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x42' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=B 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 61 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+== 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 56 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x38' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=8 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 44 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=, 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 36 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x24' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+='$' 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 59 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=';' 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 126 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+='~' 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 69 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x45' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=E 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 51 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x33' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=3 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 72 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=H 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 63 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+='?' 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 104 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x68' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=h 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 73 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x49' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=I 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 87 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x57' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=W 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 37 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=% 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # printf %x 109 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:13:48.237 16:00:11 -- target/invalid.sh@25 -- # string+=m 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:48.237 16:00:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:48.237 16:00:11 -- target/invalid.sh@28 -- # [[ | == \- ]] 00:13:48.237 16:00:11 -- target/invalid.sh@31 -- # echo '|@G"{rBCd\F=*I^CPV,Mxk0LzB=8,$;~E3H?hIW%m' 00:13:48.238 16:00:11 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '|@G"{rBCd\F=*I^CPV,Mxk0LzB=8,$;~E3H?hIW%m' nqn.2016-06.io.spdk:cnode29670 00:13:48.496 [2024-11-18 16:00:11.941080] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29670: invalid model number '|@G"{rBCd\F=*I^CPV,Mxk0LzB=8,$;~E3H?hIW%m' 00:13:48.496 16:00:11 -- target/invalid.sh@58 -- # out='request: 00:13:48.496 { 00:13:48.496 "nqn": "nqn.2016-06.io.spdk:cnode29670", 00:13:48.496 "model_number": "|@G\"{rBCd\\F=*I^CPV,Mxk0LzB=8,$;~E3H?hIW%m", 00:13:48.496 "method": "nvmf_create_subsystem", 00:13:48.496 "req_id": 1 00:13:48.496 } 00:13:48.496 Got JSON-RPC error response 00:13:48.496 response: 00:13:48.496 { 00:13:48.496 "code": -32602, 00:13:48.496 "message": "Invalid MN |@G\"{rBCd\\F=*I^CPV,Mxk0LzB=8,$;~E3H?hIW%m" 00:13:48.496 }' 00:13:48.496 16:00:11 -- target/invalid.sh@59 -- # [[ request: 00:13:48.496 { 00:13:48.496 "nqn": "nqn.2016-06.io.spdk:cnode29670", 00:13:48.496 "model_number": "|@G\"{rBCd\\F=*I^CPV,Mxk0LzB=8,$;~E3H?hIW%m", 00:13:48.496 "method": "nvmf_create_subsystem", 00:13:48.496 "req_id": 1 00:13:48.496 } 00:13:48.496 Got JSON-RPC error response 00:13:48.496 response: 00:13:48.496 { 00:13:48.496 "code": -32602, 00:13:48.496 "message": "Invalid MN |@G\"{rBCd\\F=*I^CPV,Mxk0LzB=8,$;~E3H?hIW%m" 00:13:48.496 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:48.496 16:00:11 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:48.755 [2024-11-18 16:00:12.189968] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:48.755 16:00:12 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:49.012 16:00:12 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:49.012 16:00:12 -- target/invalid.sh@67 -- # echo '' 00:13:49.012 16:00:12 -- target/invalid.sh@67 -- # head -n 1 00:13:49.012 16:00:12 -- target/invalid.sh@67 -- # IP= 00:13:49.012 16:00:12 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:49.270 [2024-11-18 16:00:12.687683] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:49.270 16:00:12 -- target/invalid.sh@69 -- # out='request: 00:13:49.270 { 00:13:49.270 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:49.270 "listen_address": { 00:13:49.270 "trtype": "tcp", 00:13:49.270 "traddr": "", 00:13:49.270 "trsvcid": "4421" 00:13:49.270 }, 00:13:49.270 "method": "nvmf_subsystem_remove_listener", 00:13:49.270 "req_id": 1 00:13:49.270 } 00:13:49.270 Got JSON-RPC error response 00:13:49.270 response: 00:13:49.270 { 00:13:49.270 "code": -32602, 00:13:49.270 "message": "Invalid parameters" 00:13:49.270 }' 00:13:49.270 16:00:12 -- target/invalid.sh@70 -- # [[ request: 00:13:49.270 { 00:13:49.270 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:49.270 "listen_address": { 00:13:49.270 "trtype": "tcp", 00:13:49.270 "traddr": "", 00:13:49.270 "trsvcid": "4421" 00:13:49.270 }, 00:13:49.270 "method": "nvmf_subsystem_remove_listener", 00:13:49.270 "req_id": 1 00:13:49.270 } 00:13:49.270 Got JSON-RPC error response 00:13:49.270 response: 00:13:49.270 { 00:13:49.270 "code": -32602, 00:13:49.270 "message": "Invalid parameters" 00:13:49.270 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:49.270 16:00:12 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode15463 -i 0 00:13:49.526 [2024-11-18 16:00:12.956497] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15463: invalid cntlid range [0-65519] 00:13:49.526 16:00:12 -- target/invalid.sh@73 -- # out='request: 00:13:49.526 { 00:13:49.526 "nqn": "nqn.2016-06.io.spdk:cnode15463", 00:13:49.526 "min_cntlid": 0, 00:13:49.526 "method": "nvmf_create_subsystem", 00:13:49.526 "req_id": 1 00:13:49.526 } 00:13:49.526 Got JSON-RPC error response 00:13:49.526 response: 00:13:49.526 { 00:13:49.526 "code": -32602, 00:13:49.526 "message": "Invalid cntlid range [0-65519]" 00:13:49.526 }' 00:13:49.527 16:00:12 -- target/invalid.sh@74 -- # [[ request: 00:13:49.527 { 00:13:49.527 "nqn": "nqn.2016-06.io.spdk:cnode15463", 00:13:49.527 "min_cntlid": 0, 00:13:49.527 "method": "nvmf_create_subsystem", 00:13:49.527 "req_id": 1 00:13:49.527 } 00:13:49.527 Got JSON-RPC error response 00:13:49.527 response: 00:13:49.527 { 00:13:49.527 "code": -32602, 00:13:49.527 "message": "Invalid cntlid range [0-65519]" 00:13:49.527 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:49.527 16:00:12 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode16304 -i 65520 00:13:49.783 [2024-11-18 16:00:13.213368] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16304: invalid cntlid range [65520-65519] 00:13:49.783 16:00:13 -- target/invalid.sh@75 -- # out='request: 00:13:49.783 { 00:13:49.783 "nqn": "nqn.2016-06.io.spdk:cnode16304", 00:13:49.783 "min_cntlid": 65520, 00:13:49.783 "method": "nvmf_create_subsystem", 00:13:49.783 "req_id": 1 00:13:49.783 } 00:13:49.783 Got JSON-RPC error response 00:13:49.783 response: 00:13:49.783 { 00:13:49.783 "code": -32602, 00:13:49.783 "message": "Invalid cntlid range [65520-65519]" 00:13:49.783 }' 00:13:49.783 16:00:13 -- target/invalid.sh@76 -- # [[ request: 00:13:49.783 { 00:13:49.783 "nqn": "nqn.2016-06.io.spdk:cnode16304", 00:13:49.783 "min_cntlid": 65520, 00:13:49.783 "method": "nvmf_create_subsystem", 00:13:49.783 "req_id": 1 00:13:49.783 } 00:13:49.783 Got JSON-RPC error response 00:13:49.783 response: 00:13:49.783 { 00:13:49.783 "code": -32602, 00:13:49.783 "message": "Invalid cntlid range [65520-65519]" 00:13:49.783 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:49.783 16:00:13 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2084 -I 0 00:13:50.041 [2024-11-18 16:00:13.462203] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2084: invalid cntlid range [1-0] 00:13:50.041 16:00:13 -- target/invalid.sh@77 -- # out='request: 00:13:50.041 { 00:13:50.041 "nqn": "nqn.2016-06.io.spdk:cnode2084", 00:13:50.041 "max_cntlid": 0, 00:13:50.041 "method": "nvmf_create_subsystem", 00:13:50.041 "req_id": 1 00:13:50.041 } 00:13:50.041 Got JSON-RPC error response 00:13:50.041 response: 00:13:50.041 { 00:13:50.041 "code": -32602, 00:13:50.041 "message": "Invalid cntlid range [1-0]" 00:13:50.041 }' 00:13:50.041 16:00:13 -- target/invalid.sh@78 -- # [[ request: 00:13:50.041 { 00:13:50.041 "nqn": "nqn.2016-06.io.spdk:cnode2084", 00:13:50.041 "max_cntlid": 0, 00:13:50.041 "method": "nvmf_create_subsystem", 00:13:50.041 "req_id": 1 00:13:50.041 } 00:13:50.041 Got JSON-RPC error response 00:13:50.041 response: 00:13:50.041 { 00:13:50.041 "code": -32602, 00:13:50.041 "message": "Invalid cntlid range [1-0]" 00:13:50.041 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:50.041 16:00:13 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode19179 -I 65520 00:13:50.309 [2024-11-18 16:00:13.715051] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode19179: invalid cntlid range [1-65520] 00:13:50.309 16:00:13 -- target/invalid.sh@79 -- # out='request: 00:13:50.309 { 00:13:50.309 "nqn": "nqn.2016-06.io.spdk:cnode19179", 00:13:50.309 "max_cntlid": 65520, 00:13:50.309 "method": "nvmf_create_subsystem", 00:13:50.309 "req_id": 1 00:13:50.309 } 00:13:50.309 Got JSON-RPC error response 00:13:50.309 response: 00:13:50.309 { 00:13:50.309 "code": -32602, 00:13:50.309 "message": "Invalid cntlid range [1-65520]" 00:13:50.309 }' 00:13:50.309 16:00:13 -- target/invalid.sh@80 -- # [[ request: 00:13:50.309 { 00:13:50.309 "nqn": "nqn.2016-06.io.spdk:cnode19179", 00:13:50.309 "max_cntlid": 65520, 00:13:50.309 "method": "nvmf_create_subsystem", 00:13:50.309 "req_id": 1 00:13:50.309 } 00:13:50.309 Got JSON-RPC error response 00:13:50.309 response: 00:13:50.309 { 00:13:50.309 "code": -32602, 00:13:50.309 "message": "Invalid cntlid range [1-65520]" 00:13:50.309 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:50.309 16:00:13 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode31772 -i 6 -I 5 00:13:50.566 [2024-11-18 16:00:13.979954] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31772: invalid cntlid range [6-5] 00:13:50.566 16:00:13 -- target/invalid.sh@83 -- # out='request: 00:13:50.566 { 00:13:50.566 "nqn": "nqn.2016-06.io.spdk:cnode31772", 00:13:50.566 "min_cntlid": 6, 00:13:50.566 "max_cntlid": 5, 00:13:50.566 "method": "nvmf_create_subsystem", 00:13:50.566 "req_id": 1 00:13:50.566 } 00:13:50.566 Got JSON-RPC error response 00:13:50.566 response: 00:13:50.566 { 00:13:50.566 "code": -32602, 00:13:50.566 "message": "Invalid cntlid range [6-5]" 00:13:50.566 }' 00:13:50.566 16:00:13 -- target/invalid.sh@84 -- # [[ request: 00:13:50.566 { 00:13:50.566 "nqn": "nqn.2016-06.io.spdk:cnode31772", 00:13:50.566 "min_cntlid": 6, 00:13:50.566 "max_cntlid": 5, 00:13:50.566 "method": "nvmf_create_subsystem", 00:13:50.566 "req_id": 1 00:13:50.566 } 00:13:50.566 Got JSON-RPC error response 00:13:50.566 response: 00:13:50.566 { 00:13:50.566 "code": -32602, 00:13:50.566 "message": "Invalid cntlid range [6-5]" 00:13:50.566 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:50.566 16:00:14 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:50.566 16:00:14 -- target/invalid.sh@87 -- # out='request: 00:13:50.566 { 00:13:50.566 "name": "foobar", 00:13:50.566 "method": "nvmf_delete_target", 00:13:50.566 "req_id": 1 00:13:50.566 } 00:13:50.566 Got JSON-RPC error response 00:13:50.566 response: 00:13:50.566 { 00:13:50.566 "code": -32602, 00:13:50.566 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:50.566 }' 00:13:50.566 16:00:14 -- target/invalid.sh@88 -- # [[ request: 00:13:50.566 { 00:13:50.566 "name": "foobar", 00:13:50.566 "method": "nvmf_delete_target", 00:13:50.566 "req_id": 1 00:13:50.566 } 00:13:50.566 Got JSON-RPC error response 00:13:50.566 response: 00:13:50.566 { 00:13:50.566 "code": -32602, 00:13:50.566 "message": "The specified target doesn't exist, cannot delete it." 00:13:50.566 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:50.567 16:00:14 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:50.567 16:00:14 -- target/invalid.sh@91 -- # nvmftestfini 00:13:50.567 16:00:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:50.567 16:00:14 -- nvmf/common.sh@116 -- # sync 00:13:50.567 16:00:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:50.567 16:00:14 -- nvmf/common.sh@119 -- # set +e 00:13:50.567 16:00:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:50.567 16:00:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:50.567 rmmod nvme_tcp 00:13:50.567 rmmod nvme_fabrics 00:13:50.567 rmmod nvme_keyring 00:13:50.824 16:00:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:50.824 16:00:14 -- nvmf/common.sh@123 -- # set -e 00:13:50.824 16:00:14 -- nvmf/common.sh@124 -- # return 0 00:13:50.824 16:00:14 -- nvmf/common.sh@477 -- # '[' -n 1534683 ']' 00:13:50.824 16:00:14 -- nvmf/common.sh@478 -- # killprocess 1534683 00:13:50.824 16:00:14 -- common/autotest_common.sh@936 -- # '[' -z 1534683 ']' 00:13:50.824 16:00:14 -- common/autotest_common.sh@940 -- # kill -0 1534683 00:13:50.824 16:00:14 -- common/autotest_common.sh@941 -- # uname 00:13:50.824 16:00:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:50.824 16:00:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1534683 00:13:50.824 16:00:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:50.824 16:00:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:50.824 16:00:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1534683' 00:13:50.824 killing process with pid 1534683 00:13:50.824 16:00:14 -- common/autotest_common.sh@955 -- # kill 1534683 00:13:50.824 16:00:14 -- common/autotest_common.sh@960 -- # wait 1534683 00:13:51.081 16:00:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:51.081 16:00:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:51.081 16:00:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:51.081 16:00:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:51.081 16:00:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:51.081 16:00:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.081 16:00:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.081 16:00:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.990 16:00:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:52.990 00:13:52.990 real 0m9.328s 00:13:52.990 user 0m22.943s 00:13:52.990 sys 0m2.344s 00:13:52.990 16:00:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:52.990 16:00:16 -- common/autotest_common.sh@10 -- # set +x 00:13:52.990 ************************************ 00:13:52.990 END TEST nvmf_invalid 00:13:52.990 ************************************ 00:13:52.990 16:00:16 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:52.990 16:00:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:52.990 16:00:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:52.990 16:00:16 -- common/autotest_common.sh@10 -- # set +x 00:13:52.990 ************************************ 00:13:52.990 START TEST nvmf_abort 00:13:52.990 ************************************ 00:13:52.990 16:00:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:52.990 * Looking for test storage... 00:13:52.990 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:52.990 16:00:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:52.990 16:00:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:52.990 16:00:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:53.248 16:00:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:53.248 16:00:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:53.248 16:00:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:53.248 16:00:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:53.248 16:00:16 -- scripts/common.sh@335 -- # IFS=.-: 00:13:53.248 16:00:16 -- scripts/common.sh@335 -- # read -ra ver1 00:13:53.248 16:00:16 -- scripts/common.sh@336 -- # IFS=.-: 00:13:53.248 16:00:16 -- scripts/common.sh@336 -- # read -ra ver2 00:13:53.248 16:00:16 -- scripts/common.sh@337 -- # local 'op=<' 00:13:53.248 16:00:16 -- scripts/common.sh@339 -- # ver1_l=2 00:13:53.248 16:00:16 -- scripts/common.sh@340 -- # ver2_l=1 00:13:53.248 16:00:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:53.248 16:00:16 -- scripts/common.sh@343 -- # case "$op" in 00:13:53.248 16:00:16 -- scripts/common.sh@344 -- # : 1 00:13:53.248 16:00:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:53.248 16:00:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:53.248 16:00:16 -- scripts/common.sh@364 -- # decimal 1 00:13:53.248 16:00:16 -- scripts/common.sh@352 -- # local d=1 00:13:53.248 16:00:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:53.248 16:00:16 -- scripts/common.sh@354 -- # echo 1 00:13:53.248 16:00:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:53.248 16:00:16 -- scripts/common.sh@365 -- # decimal 2 00:13:53.248 16:00:16 -- scripts/common.sh@352 -- # local d=2 00:13:53.248 16:00:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:53.248 16:00:16 -- scripts/common.sh@354 -- # echo 2 00:13:53.248 16:00:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:53.248 16:00:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:53.248 16:00:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:53.248 16:00:16 -- scripts/common.sh@367 -- # return 0 00:13:53.249 16:00:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:53.249 16:00:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:53.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.249 --rc genhtml_branch_coverage=1 00:13:53.249 --rc genhtml_function_coverage=1 00:13:53.249 --rc genhtml_legend=1 00:13:53.249 --rc geninfo_all_blocks=1 00:13:53.249 --rc geninfo_unexecuted_blocks=1 00:13:53.249 00:13:53.249 ' 00:13:53.249 16:00:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:53.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.249 --rc genhtml_branch_coverage=1 00:13:53.249 --rc genhtml_function_coverage=1 00:13:53.249 --rc genhtml_legend=1 00:13:53.249 --rc geninfo_all_blocks=1 00:13:53.249 --rc geninfo_unexecuted_blocks=1 00:13:53.249 00:13:53.249 ' 00:13:53.249 16:00:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:53.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.249 --rc genhtml_branch_coverage=1 00:13:53.249 --rc genhtml_function_coverage=1 00:13:53.249 --rc genhtml_legend=1 00:13:53.249 --rc geninfo_all_blocks=1 00:13:53.249 --rc geninfo_unexecuted_blocks=1 00:13:53.249 00:13:53.249 ' 00:13:53.249 16:00:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:53.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.249 --rc genhtml_branch_coverage=1 00:13:53.249 --rc genhtml_function_coverage=1 00:13:53.249 --rc genhtml_legend=1 00:13:53.249 --rc geninfo_all_blocks=1 00:13:53.249 --rc geninfo_unexecuted_blocks=1 00:13:53.249 00:13:53.249 ' 00:13:53.249 16:00:16 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:53.249 16:00:16 -- nvmf/common.sh@7 -- # uname -s 00:13:53.249 16:00:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:53.249 16:00:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:53.249 16:00:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:53.249 16:00:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:53.249 16:00:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:53.249 16:00:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:53.249 16:00:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:53.249 16:00:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:53.249 16:00:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:53.249 16:00:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:53.249 16:00:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.249 16:00:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.249 16:00:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:53.249 16:00:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:53.249 16:00:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:53.249 16:00:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:53.249 16:00:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:53.249 16:00:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:53.249 16:00:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:53.249 16:00:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.249 16:00:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.249 16:00:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.249 16:00:16 -- paths/export.sh@5 -- # export PATH 00:13:53.249 16:00:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.249 16:00:16 -- nvmf/common.sh@46 -- # : 0 00:13:53.249 16:00:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:53.249 16:00:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:53.249 16:00:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:53.249 16:00:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:53.249 16:00:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:53.249 16:00:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:53.249 16:00:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:53.249 16:00:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:53.249 16:00:16 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:53.249 16:00:16 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:53.249 16:00:16 -- target/abort.sh@14 -- # nvmftestinit 00:13:53.249 16:00:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:53.249 16:00:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:53.249 16:00:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:53.249 16:00:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:53.249 16:00:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:53.249 16:00:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:53.249 16:00:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:53.249 16:00:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.249 16:00:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:53.249 16:00:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:53.249 16:00:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:53.249 16:00:16 -- common/autotest_common.sh@10 -- # set +x 00:13:55.182 16:00:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:55.182 16:00:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:55.182 16:00:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:55.182 16:00:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:55.182 16:00:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:55.182 16:00:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:55.182 16:00:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:55.182 16:00:18 -- nvmf/common.sh@294 -- # net_devs=() 00:13:55.182 16:00:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:55.182 16:00:18 -- nvmf/common.sh@295 -- # e810=() 00:13:55.182 16:00:18 -- nvmf/common.sh@295 -- # local -ga e810 00:13:55.182 16:00:18 -- nvmf/common.sh@296 -- # x722=() 00:13:55.182 16:00:18 -- nvmf/common.sh@296 -- # local -ga x722 00:13:55.182 16:00:18 -- nvmf/common.sh@297 -- # mlx=() 00:13:55.182 16:00:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:55.182 16:00:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:55.182 16:00:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:55.182 16:00:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:55.182 16:00:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:55.182 16:00:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:55.182 16:00:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:55.182 16:00:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:55.182 16:00:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:55.182 16:00:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:55.182 16:00:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:55.182 16:00:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:55.182 16:00:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:55.182 16:00:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:55.182 16:00:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:55.182 16:00:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:55.182 16:00:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:55.182 16:00:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:55.182 16:00:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.182 16:00:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:55.182 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:55.182 16:00:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.182 16:00:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.182 16:00:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.182 16:00:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.182 16:00:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.182 16:00:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.182 16:00:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:55.182 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:55.182 16:00:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.183 16:00:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.183 16:00:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.183 16:00:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.183 16:00:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.183 16:00:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:55.183 16:00:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:55.183 16:00:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:55.183 16:00:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.183 16:00:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.183 16:00:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.183 16:00:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.183 16:00:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:55.183 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:55.183 16:00:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.183 16:00:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.183 16:00:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.183 16:00:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.183 16:00:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.183 16:00:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:55.183 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:55.183 16:00:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.183 16:00:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:55.183 16:00:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:55.183 16:00:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:55.183 16:00:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:55.183 16:00:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:55.183 16:00:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:55.183 16:00:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:55.183 16:00:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:55.183 16:00:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:55.183 16:00:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:55.183 16:00:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:55.183 16:00:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:55.183 16:00:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:55.183 16:00:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:55.183 16:00:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:55.183 16:00:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:55.183 16:00:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:55.183 16:00:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:55.465 16:00:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:55.465 16:00:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:55.465 16:00:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:55.465 16:00:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:55.465 16:00:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:55.465 16:00:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:55.465 16:00:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:55.465 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:55.465 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:13:55.465 00:13:55.465 --- 10.0.0.2 ping statistics --- 00:13:55.465 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.465 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:13:55.465 16:00:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:55.465 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:55.465 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:13:55.465 00:13:55.465 --- 10.0.0.1 ping statistics --- 00:13:55.465 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.465 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:13:55.465 16:00:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:55.465 16:00:18 -- nvmf/common.sh@410 -- # return 0 00:13:55.465 16:00:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:55.465 16:00:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:55.465 16:00:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:55.465 16:00:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:55.465 16:00:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:55.465 16:00:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:55.465 16:00:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:55.465 16:00:18 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:55.465 16:00:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:55.465 16:00:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:55.465 16:00:18 -- common/autotest_common.sh@10 -- # set +x 00:13:55.465 16:00:18 -- nvmf/common.sh@469 -- # nvmfpid=1537475 00:13:55.465 16:00:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:55.465 16:00:18 -- nvmf/common.sh@470 -- # waitforlisten 1537475 00:13:55.465 16:00:18 -- common/autotest_common.sh@829 -- # '[' -z 1537475 ']' 00:13:55.465 16:00:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:55.465 16:00:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:55.465 16:00:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:55.465 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:55.465 16:00:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:55.465 16:00:18 -- common/autotest_common.sh@10 -- # set +x 00:13:55.465 [2024-11-18 16:00:18.911044] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:55.465 [2024-11-18 16:00:18.911125] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:55.465 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.465 [2024-11-18 16:00:18.984948] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:55.724 [2024-11-18 16:00:19.076791] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:55.724 [2024-11-18 16:00:19.076943] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:55.724 [2024-11-18 16:00:19.076962] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:55.724 [2024-11-18 16:00:19.076977] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:55.724 [2024-11-18 16:00:19.077059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:55.724 [2024-11-18 16:00:19.077114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:55.724 [2024-11-18 16:00:19.077118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:56.290 16:00:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:56.290 16:00:19 -- common/autotest_common.sh@862 -- # return 0 00:13:56.290 16:00:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:56.290 16:00:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:56.290 16:00:19 -- common/autotest_common.sh@10 -- # set +x 00:13:56.290 16:00:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:56.290 16:00:19 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:56.290 16:00:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.290 16:00:19 -- common/autotest_common.sh@10 -- # set +x 00:13:56.290 [2024-11-18 16:00:19.874349] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:56.290 16:00:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.548 16:00:19 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:56.548 16:00:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.548 16:00:19 -- common/autotest_common.sh@10 -- # set +x 00:13:56.548 Malloc0 00:13:56.548 16:00:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.548 16:00:19 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:56.548 16:00:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.548 16:00:19 -- common/autotest_common.sh@10 -- # set +x 00:13:56.548 Delay0 00:13:56.548 16:00:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.549 16:00:19 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:56.549 16:00:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.549 16:00:19 -- common/autotest_common.sh@10 -- # set +x 00:13:56.549 16:00:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.549 16:00:19 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:56.549 16:00:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.549 16:00:19 -- common/autotest_common.sh@10 -- # set +x 00:13:56.549 16:00:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.549 16:00:19 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:56.549 16:00:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.549 16:00:19 -- common/autotest_common.sh@10 -- # set +x 00:13:56.549 [2024-11-18 16:00:19.951819] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.549 16:00:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.549 16:00:19 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:56.549 16:00:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.549 16:00:19 -- common/autotest_common.sh@10 -- # set +x 00:13:56.549 16:00:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.549 16:00:19 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:56.549 EAL: No free 2048 kB hugepages reported on node 1 00:13:56.549 [2024-11-18 16:00:20.006319] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:59.078 Initializing NVMe Controllers 00:13:59.078 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:59.078 controller IO queue size 128 less than required 00:13:59.078 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:59.078 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:59.078 Initialization complete. Launching workers. 00:13:59.078 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34385 00:13:59.078 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34446, failed to submit 62 00:13:59.078 success 34385, unsuccess 61, failed 0 00:13:59.078 16:00:22 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:59.078 16:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.078 16:00:22 -- common/autotest_common.sh@10 -- # set +x 00:13:59.078 16:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.078 16:00:22 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:59.078 16:00:22 -- target/abort.sh@38 -- # nvmftestfini 00:13:59.078 16:00:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:59.078 16:00:22 -- nvmf/common.sh@116 -- # sync 00:13:59.078 16:00:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:59.078 16:00:22 -- nvmf/common.sh@119 -- # set +e 00:13:59.078 16:00:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:59.078 16:00:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:59.078 rmmod nvme_tcp 00:13:59.078 rmmod nvme_fabrics 00:13:59.078 rmmod nvme_keyring 00:13:59.078 16:00:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:59.078 16:00:22 -- nvmf/common.sh@123 -- # set -e 00:13:59.078 16:00:22 -- nvmf/common.sh@124 -- # return 0 00:13:59.078 16:00:22 -- nvmf/common.sh@477 -- # '[' -n 1537475 ']' 00:13:59.078 16:00:22 -- nvmf/common.sh@478 -- # killprocess 1537475 00:13:59.078 16:00:22 -- common/autotest_common.sh@936 -- # '[' -z 1537475 ']' 00:13:59.078 16:00:22 -- common/autotest_common.sh@940 -- # kill -0 1537475 00:13:59.078 16:00:22 -- common/autotest_common.sh@941 -- # uname 00:13:59.078 16:00:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:59.078 16:00:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1537475 00:13:59.078 16:00:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:59.078 16:00:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:59.078 16:00:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1537475' 00:13:59.078 killing process with pid 1537475 00:13:59.078 16:00:22 -- common/autotest_common.sh@955 -- # kill 1537475 00:13:59.078 16:00:22 -- common/autotest_common.sh@960 -- # wait 1537475 00:13:59.078 16:00:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:59.079 16:00:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:59.079 16:00:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:59.079 16:00:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:59.079 16:00:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:59.079 16:00:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:59.079 16:00:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:59.079 16:00:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:00.984 16:00:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:00.984 00:14:00.984 real 0m8.060s 00:14:00.984 user 0m12.866s 00:14:00.984 sys 0m2.527s 00:14:00.984 16:00:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:00.984 16:00:24 -- common/autotest_common.sh@10 -- # set +x 00:14:00.984 ************************************ 00:14:00.984 END TEST nvmf_abort 00:14:00.984 ************************************ 00:14:00.984 16:00:24 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:00.984 16:00:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:00.984 16:00:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:00.984 16:00:24 -- common/autotest_common.sh@10 -- # set +x 00:14:00.984 ************************************ 00:14:00.984 START TEST nvmf_ns_hotplug_stress 00:14:00.984 ************************************ 00:14:00.984 16:00:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:14:01.244 * Looking for test storage... 00:14:01.244 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:01.244 16:00:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:01.244 16:00:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:01.244 16:00:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:01.244 16:00:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:01.244 16:00:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:01.244 16:00:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:01.244 16:00:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:01.244 16:00:24 -- scripts/common.sh@335 -- # IFS=.-: 00:14:01.244 16:00:24 -- scripts/common.sh@335 -- # read -ra ver1 00:14:01.244 16:00:24 -- scripts/common.sh@336 -- # IFS=.-: 00:14:01.244 16:00:24 -- scripts/common.sh@336 -- # read -ra ver2 00:14:01.244 16:00:24 -- scripts/common.sh@337 -- # local 'op=<' 00:14:01.244 16:00:24 -- scripts/common.sh@339 -- # ver1_l=2 00:14:01.244 16:00:24 -- scripts/common.sh@340 -- # ver2_l=1 00:14:01.244 16:00:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:01.244 16:00:24 -- scripts/common.sh@343 -- # case "$op" in 00:14:01.244 16:00:24 -- scripts/common.sh@344 -- # : 1 00:14:01.244 16:00:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:01.244 16:00:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:01.244 16:00:24 -- scripts/common.sh@364 -- # decimal 1 00:14:01.244 16:00:24 -- scripts/common.sh@352 -- # local d=1 00:14:01.244 16:00:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:01.244 16:00:24 -- scripts/common.sh@354 -- # echo 1 00:14:01.244 16:00:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:01.244 16:00:24 -- scripts/common.sh@365 -- # decimal 2 00:14:01.244 16:00:24 -- scripts/common.sh@352 -- # local d=2 00:14:01.244 16:00:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:01.244 16:00:24 -- scripts/common.sh@354 -- # echo 2 00:14:01.244 16:00:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:01.244 16:00:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:01.244 16:00:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:01.244 16:00:24 -- scripts/common.sh@367 -- # return 0 00:14:01.244 16:00:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:01.244 16:00:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:01.244 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.244 --rc genhtml_branch_coverage=1 00:14:01.244 --rc genhtml_function_coverage=1 00:14:01.244 --rc genhtml_legend=1 00:14:01.244 --rc geninfo_all_blocks=1 00:14:01.244 --rc geninfo_unexecuted_blocks=1 00:14:01.244 00:14:01.244 ' 00:14:01.244 16:00:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:01.244 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.244 --rc genhtml_branch_coverage=1 00:14:01.244 --rc genhtml_function_coverage=1 00:14:01.244 --rc genhtml_legend=1 00:14:01.244 --rc geninfo_all_blocks=1 00:14:01.244 --rc geninfo_unexecuted_blocks=1 00:14:01.244 00:14:01.244 ' 00:14:01.244 16:00:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:01.244 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.244 --rc genhtml_branch_coverage=1 00:14:01.244 --rc genhtml_function_coverage=1 00:14:01.244 --rc genhtml_legend=1 00:14:01.244 --rc geninfo_all_blocks=1 00:14:01.244 --rc geninfo_unexecuted_blocks=1 00:14:01.244 00:14:01.244 ' 00:14:01.244 16:00:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:01.244 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.244 --rc genhtml_branch_coverage=1 00:14:01.244 --rc genhtml_function_coverage=1 00:14:01.244 --rc genhtml_legend=1 00:14:01.244 --rc geninfo_all_blocks=1 00:14:01.244 --rc geninfo_unexecuted_blocks=1 00:14:01.244 00:14:01.244 ' 00:14:01.244 16:00:24 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:01.244 16:00:24 -- nvmf/common.sh@7 -- # uname -s 00:14:01.244 16:00:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:01.244 16:00:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:01.244 16:00:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:01.244 16:00:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:01.244 16:00:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:01.244 16:00:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:01.244 16:00:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:01.244 16:00:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:01.244 16:00:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:01.244 16:00:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:01.244 16:00:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:01.244 16:00:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:01.244 16:00:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:01.244 16:00:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:01.244 16:00:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:01.244 16:00:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:01.244 16:00:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:01.244 16:00:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:01.244 16:00:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:01.244 16:00:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.244 16:00:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.244 16:00:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.244 16:00:24 -- paths/export.sh@5 -- # export PATH 00:14:01.244 16:00:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.244 16:00:24 -- nvmf/common.sh@46 -- # : 0 00:14:01.244 16:00:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:01.244 16:00:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:01.244 16:00:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:01.244 16:00:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:01.244 16:00:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:01.244 16:00:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:01.244 16:00:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:01.244 16:00:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:01.244 16:00:24 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:01.244 16:00:24 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:14:01.244 16:00:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:01.244 16:00:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:01.244 16:00:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:01.244 16:00:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:01.244 16:00:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:01.244 16:00:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:01.244 16:00:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:01.244 16:00:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:01.244 16:00:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:01.244 16:00:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:01.245 16:00:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:01.245 16:00:24 -- common/autotest_common.sh@10 -- # set +x 00:14:03.777 16:00:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:03.777 16:00:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:03.777 16:00:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:03.777 16:00:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:03.777 16:00:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:03.777 16:00:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:03.777 16:00:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:03.777 16:00:26 -- nvmf/common.sh@294 -- # net_devs=() 00:14:03.777 16:00:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:03.778 16:00:26 -- nvmf/common.sh@295 -- # e810=() 00:14:03.778 16:00:26 -- nvmf/common.sh@295 -- # local -ga e810 00:14:03.778 16:00:26 -- nvmf/common.sh@296 -- # x722=() 00:14:03.778 16:00:26 -- nvmf/common.sh@296 -- # local -ga x722 00:14:03.778 16:00:26 -- nvmf/common.sh@297 -- # mlx=() 00:14:03.778 16:00:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:03.778 16:00:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:03.778 16:00:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:03.778 16:00:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:03.778 16:00:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:03.778 16:00:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:03.778 16:00:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:03.778 16:00:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:03.778 16:00:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:03.778 16:00:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:03.778 16:00:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:03.778 16:00:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:03.778 16:00:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:03.778 16:00:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:03.778 16:00:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:03.778 16:00:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:03.778 16:00:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:03.778 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:03.778 16:00:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:03.778 16:00:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:03.778 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:03.778 16:00:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:03.778 16:00:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:03.778 16:00:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:03.778 16:00:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:03.778 16:00:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:03.778 16:00:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:03.778 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:03.778 16:00:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:03.778 16:00:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:03.778 16:00:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:03.778 16:00:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:03.778 16:00:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:03.778 16:00:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:03.778 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:03.778 16:00:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:03.778 16:00:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:03.778 16:00:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:03.778 16:00:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:03.778 16:00:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:03.778 16:00:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:03.778 16:00:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:03.778 16:00:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:03.778 16:00:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:03.778 16:00:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:03.778 16:00:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:03.778 16:00:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:03.778 16:00:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:03.778 16:00:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:03.778 16:00:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:03.778 16:00:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:03.778 16:00:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:03.778 16:00:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:03.778 16:00:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:03.778 16:00:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:03.778 16:00:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:03.778 16:00:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:03.778 16:00:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:03.778 16:00:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:03.778 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:03.778 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:14:03.778 00:14:03.778 --- 10.0.0.2 ping statistics --- 00:14:03.778 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:03.778 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:14:03.778 16:00:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:03.778 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:03.778 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.158 ms 00:14:03.778 00:14:03.778 --- 10.0.0.1 ping statistics --- 00:14:03.778 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:03.778 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:14:03.778 16:00:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:03.778 16:00:26 -- nvmf/common.sh@410 -- # return 0 00:14:03.778 16:00:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:03.778 16:00:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:03.778 16:00:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:03.778 16:00:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:03.778 16:00:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:03.778 16:00:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:03.778 16:00:26 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:14:03.778 16:00:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:03.778 16:00:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:03.778 16:00:26 -- common/autotest_common.sh@10 -- # set +x 00:14:03.778 16:00:26 -- nvmf/common.sh@469 -- # nvmfpid=1539861 00:14:03.778 16:00:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:03.778 16:00:26 -- nvmf/common.sh@470 -- # waitforlisten 1539861 00:14:03.778 16:00:26 -- common/autotest_common.sh@829 -- # '[' -z 1539861 ']' 00:14:03.778 16:00:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:03.778 16:00:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:03.778 16:00:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:03.778 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:03.778 16:00:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:03.778 16:00:26 -- common/autotest_common.sh@10 -- # set +x 00:14:03.778 [2024-11-18 16:00:26.945024] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:03.779 [2024-11-18 16:00:26.945110] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:03.779 EAL: No free 2048 kB hugepages reported on node 1 00:14:03.779 [2024-11-18 16:00:27.010437] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:03.779 [2024-11-18 16:00:27.099326] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:03.779 [2024-11-18 16:00:27.099492] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:03.779 [2024-11-18 16:00:27.099525] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:03.779 [2024-11-18 16:00:27.099539] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:03.779 [2024-11-18 16:00:27.099637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:03.779 [2024-11-18 16:00:27.099692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:03.779 [2024-11-18 16:00:27.099695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:04.713 16:00:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:04.713 16:00:27 -- common/autotest_common.sh@862 -- # return 0 00:14:04.713 16:00:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:04.713 16:00:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:04.713 16:00:27 -- common/autotest_common.sh@10 -- # set +x 00:14:04.713 16:00:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:04.713 16:00:27 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:14:04.713 16:00:27 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:04.713 [2024-11-18 16:00:28.204355] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:04.713 16:00:28 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:04.971 16:00:28 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:05.230 [2024-11-18 16:00:28.763790] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:05.230 16:00:28 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:05.794 16:00:29 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:14:05.794 Malloc0 00:14:05.794 16:00:29 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:06.052 Delay0 00:14:06.052 16:00:29 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:06.310 16:00:29 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:14:06.568 NULL1 00:14:06.568 16:00:30 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:06.825 16:00:30 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1540295 00:14:06.825 16:00:30 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:14:06.825 16:00:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:06.825 16:00:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.825 EAL: No free 2048 kB hugepages reported on node 1 00:14:08.200 Read completed with error (sct=0, sc=11) 00:14:08.200 16:00:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:08.200 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:08.200 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:08.200 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:08.200 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:08.458 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:08.458 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:08.458 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:08.458 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:08.458 16:00:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:14:08.458 16:00:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:14:08.715 true 00:14:08.715 16:00:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:08.715 16:00:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.649 16:00:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.908 16:00:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:14:09.908 16:00:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:10.166 true 00:14:10.166 16:00:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:10.166 16:00:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.424 16:00:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.682 16:00:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:14:10.682 16:00:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:14:10.940 true 00:14:10.940 16:00:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:10.940 16:00:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.198 16:00:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:11.455 16:00:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:11.455 16:00:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:11.455 true 00:14:11.713 16:00:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:11.713 16:00:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.648 16:00:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.906 16:00:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:12.906 16:00:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:13.164 true 00:14:13.164 16:00:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:13.164 16:00:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.422 16:00:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.679 16:00:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:13.679 16:00:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:13.938 true 00:14:13.938 16:00:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:13.938 16:00:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.196 16:00:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:14.454 16:00:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:14.454 16:00:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:14.712 true 00:14:14.712 16:00:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:14.712 16:00:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.084 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.084 16:00:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.084 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:16.084 16:00:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:16.084 16:00:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:16.342 true 00:14:16.342 16:00:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:16.342 16:00:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.599 16:00:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.857 16:00:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:16.857 16:00:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:17.115 true 00:14:17.115 16:00:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:17.115 16:00:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.047 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:18.047 16:00:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.047 16:00:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:18.047 16:00:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:18.304 true 00:14:18.304 16:00:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:18.304 16:00:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.562 16:00:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.820 16:00:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:18.820 16:00:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:19.079 true 00:14:19.079 16:00:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:19.079 16:00:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.013 16:00:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.271 16:00:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:20.271 16:00:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:20.529 true 00:14:20.529 16:00:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:20.529 16:00:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.787 16:00:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.047 16:00:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:21.047 16:00:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:21.306 true 00:14:21.306 16:00:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:21.306 16:00:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.566 16:00:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.826 16:00:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:21.826 16:00:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:22.131 true 00:14:22.131 16:00:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:22.131 16:00:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.088 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:23.345 16:00:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.345 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:23.604 16:00:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:23.604 16:00:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:23.862 true 00:14:23.862 16:00:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:23.862 16:00:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:24.121 16:00:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:24.379 16:00:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:24.379 16:00:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:24.637 true 00:14:24.637 16:00:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:24.637 16:00:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:24.895 16:00:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.152 16:00:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:25.153 16:00:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:25.410 true 00:14:25.410 16:00:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:25.410 16:00:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.783 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:26.783 16:00:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.783 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:26.783 16:00:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:26.783 16:00:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:27.042 true 00:14:27.042 16:00:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:27.042 16:00:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:27.316 16:00:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:27.574 16:00:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:27.574 16:00:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:27.832 true 00:14:27.832 16:00:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:27.832 16:00:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.765 16:00:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:28.765 16:00:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:28.765 16:00:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:29.331 true 00:14:29.331 16:00:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:29.331 16:00:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.331 16:00:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:29.589 16:00:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:29.589 16:00:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:29.848 true 00:14:29.848 16:00:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:29.848 16:00:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.106 16:00:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:30.363 16:00:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:30.363 16:00:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:30.621 true 00:14:30.621 16:00:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:30.621 16:00:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.995 16:00:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:31.995 16:00:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:31.995 16:00:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:32.253 true 00:14:32.253 16:00:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:32.253 16:00:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.512 16:00:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:32.769 16:00:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:32.769 16:00:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:33.028 true 00:14:33.028 16:00:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:33.028 16:00:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.962 16:00:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:33.962 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:33.962 16:00:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:33.962 16:00:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:34.219 true 00:14:34.219 16:00:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:34.219 16:00:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.477 16:00:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:34.735 16:00:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:34.735 16:00:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:34.992 true 00:14:34.992 16:00:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:34.992 16:00:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.925 16:00:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:36.182 16:00:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:36.182 16:00:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:36.440 true 00:14:36.440 16:00:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:36.440 16:00:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.698 16:01:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:36.956 16:01:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:36.956 16:01:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:37.213 true 00:14:37.213 16:01:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:37.213 16:01:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.213 Initializing NVMe Controllers 00:14:37.213 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:37.213 Controller IO queue size 128, less than required. 00:14:37.213 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:37.213 Controller IO queue size 128, less than required. 00:14:37.213 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:37.213 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:37.213 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:37.213 Initialization complete. Launching workers. 00:14:37.213 ======================================================== 00:14:37.213 Latency(us) 00:14:37.213 Device Information : IOPS MiB/s Average min max 00:14:37.213 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 620.28 0.30 92068.74 2092.64 1028999.02 00:14:37.213 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10295.76 5.03 12432.03 1573.61 440677.66 00:14:37.213 ======================================================== 00:14:37.213 Total : 10916.04 5.33 16957.19 1573.61 1028999.02 00:14:37.213 00:14:37.471 16:01:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:37.728 16:01:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:37.728 16:01:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:37.985 true 00:14:37.985 16:01:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1540295 00:14:37.985 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1540295) - No such process 00:14:37.985 16:01:01 -- target/ns_hotplug_stress.sh@53 -- # wait 1540295 00:14:37.985 16:01:01 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.243 16:01:01 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:38.501 16:01:01 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:38.501 16:01:01 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:38.501 16:01:01 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:38.501 16:01:01 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:38.501 16:01:01 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:38.758 null0 00:14:38.758 16:01:02 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:38.758 16:01:02 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:38.758 16:01:02 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:39.015 null1 00:14:39.015 16:01:02 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:39.015 16:01:02 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:39.015 16:01:02 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:39.273 null2 00:14:39.273 16:01:02 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:39.273 16:01:02 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:39.273 16:01:02 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:39.529 null3 00:14:39.530 16:01:02 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:39.530 16:01:02 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:39.530 16:01:02 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:39.786 null4 00:14:39.786 16:01:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:39.786 16:01:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:39.786 16:01:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:40.043 null5 00:14:40.043 16:01:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:40.043 16:01:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:40.043 16:01:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:40.299 null6 00:14:40.299 16:01:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:40.299 16:01:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:40.299 16:01:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:40.557 null7 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:40.557 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@66 -- # wait 1544459 1544460 1544462 1544464 1544466 1544468 1544470 1544472 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:40.558 16:01:03 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:40.815 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:40.815 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:40.815 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:40.815 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:40.815 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:40.815 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:40.815 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:40.815 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.074 16:01:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:41.332 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:41.332 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:41.332 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:41.332 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:41.332 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:41.332 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:41.332 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:41.332 16:01:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:41.590 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:41.848 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:41.848 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:41.848 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:41.848 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:41.848 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:41.848 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:41.848 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:41.848 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.106 16:01:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:42.364 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:42.364 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:42.364 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:42.364 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:42.364 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:42.364 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:42.622 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:42.622 16:01:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:42.622 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.622 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.622 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:42.880 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:43.138 16:01:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:43.138 16:01:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:43.138 16:01:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:43.138 16:01:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:43.138 16:01:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:43.138 16:01:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:43.138 16:01:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:43.138 16:01:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.396 16:01:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:43.654 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:43.654 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:43.654 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:43.654 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:43.654 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:43.654 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:43.654 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:43.654 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:43.912 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:44.170 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:44.170 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:44.170 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:44.170 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:44.170 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:44.170 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:44.170 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:44.170 16:01:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.428 16:01:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:44.686 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:44.686 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:44.686 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:44.686 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:44.686 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:44.686 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:44.686 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:44.686 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:44.944 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.944 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:44.945 16:01:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:45.202 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:45.202 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:45.202 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:45.202 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:45.202 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:45.203 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:45.203 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:45.203 16:01:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:45.461 16:01:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:45.719 16:01:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:45.719 16:01:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:45.719 16:01:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:45.719 16:01:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:45.719 16:01:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:45.978 16:01:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:45.978 16:01:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:45.978 16:01:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:46.270 16:01:09 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:46.270 16:01:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:46.270 16:01:09 -- nvmf/common.sh@116 -- # sync 00:14:46.270 16:01:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:46.270 16:01:09 -- nvmf/common.sh@119 -- # set +e 00:14:46.270 16:01:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:46.270 16:01:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:46.270 rmmod nvme_tcp 00:14:46.270 rmmod nvme_fabrics 00:14:46.270 rmmod nvme_keyring 00:14:46.270 16:01:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:46.270 16:01:09 -- nvmf/common.sh@123 -- # set -e 00:14:46.270 16:01:09 -- nvmf/common.sh@124 -- # return 0 00:14:46.270 16:01:09 -- nvmf/common.sh@477 -- # '[' -n 1539861 ']' 00:14:46.270 16:01:09 -- nvmf/common.sh@478 -- # killprocess 1539861 00:14:46.270 16:01:09 -- common/autotest_common.sh@936 -- # '[' -z 1539861 ']' 00:14:46.270 16:01:09 -- common/autotest_common.sh@940 -- # kill -0 1539861 00:14:46.270 16:01:09 -- common/autotest_common.sh@941 -- # uname 00:14:46.270 16:01:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:46.270 16:01:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1539861 00:14:46.270 16:01:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:46.270 16:01:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:46.270 16:01:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1539861' 00:14:46.270 killing process with pid 1539861 00:14:46.270 16:01:09 -- common/autotest_common.sh@955 -- # kill 1539861 00:14:46.270 16:01:09 -- common/autotest_common.sh@960 -- # wait 1539861 00:14:46.553 16:01:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:46.553 16:01:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:46.553 16:01:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:46.553 16:01:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:46.553 16:01:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:46.553 16:01:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:46.553 16:01:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:46.553 16:01:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:48.454 16:01:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:48.454 00:14:48.454 real 0m47.438s 00:14:48.454 user 3m37.138s 00:14:48.454 sys 0m15.376s 00:14:48.454 16:01:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:48.454 16:01:12 -- common/autotest_common.sh@10 -- # set +x 00:14:48.454 ************************************ 00:14:48.454 END TEST nvmf_ns_hotplug_stress 00:14:48.454 ************************************ 00:14:48.454 16:01:12 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:48.454 16:01:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:48.454 16:01:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:48.454 16:01:12 -- common/autotest_common.sh@10 -- # set +x 00:14:48.454 ************************************ 00:14:48.454 START TEST nvmf_connect_stress 00:14:48.454 ************************************ 00:14:48.454 16:01:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:48.713 * Looking for test storage... 00:14:48.713 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:48.713 16:01:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:48.713 16:01:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:48.713 16:01:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:48.713 16:01:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:48.713 16:01:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:48.713 16:01:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:48.713 16:01:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:48.713 16:01:12 -- scripts/common.sh@335 -- # IFS=.-: 00:14:48.713 16:01:12 -- scripts/common.sh@335 -- # read -ra ver1 00:14:48.713 16:01:12 -- scripts/common.sh@336 -- # IFS=.-: 00:14:48.713 16:01:12 -- scripts/common.sh@336 -- # read -ra ver2 00:14:48.713 16:01:12 -- scripts/common.sh@337 -- # local 'op=<' 00:14:48.713 16:01:12 -- scripts/common.sh@339 -- # ver1_l=2 00:14:48.713 16:01:12 -- scripts/common.sh@340 -- # ver2_l=1 00:14:48.713 16:01:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:48.713 16:01:12 -- scripts/common.sh@343 -- # case "$op" in 00:14:48.713 16:01:12 -- scripts/common.sh@344 -- # : 1 00:14:48.713 16:01:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:48.713 16:01:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:48.713 16:01:12 -- scripts/common.sh@364 -- # decimal 1 00:14:48.713 16:01:12 -- scripts/common.sh@352 -- # local d=1 00:14:48.713 16:01:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:48.713 16:01:12 -- scripts/common.sh@354 -- # echo 1 00:14:48.713 16:01:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:48.713 16:01:12 -- scripts/common.sh@365 -- # decimal 2 00:14:48.713 16:01:12 -- scripts/common.sh@352 -- # local d=2 00:14:48.713 16:01:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:48.713 16:01:12 -- scripts/common.sh@354 -- # echo 2 00:14:48.713 16:01:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:48.713 16:01:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:48.713 16:01:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:48.713 16:01:12 -- scripts/common.sh@367 -- # return 0 00:14:48.713 16:01:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:48.713 16:01:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:48.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:48.713 --rc genhtml_branch_coverage=1 00:14:48.713 --rc genhtml_function_coverage=1 00:14:48.713 --rc genhtml_legend=1 00:14:48.713 --rc geninfo_all_blocks=1 00:14:48.713 --rc geninfo_unexecuted_blocks=1 00:14:48.713 00:14:48.713 ' 00:14:48.713 16:01:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:48.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:48.713 --rc genhtml_branch_coverage=1 00:14:48.713 --rc genhtml_function_coverage=1 00:14:48.713 --rc genhtml_legend=1 00:14:48.713 --rc geninfo_all_blocks=1 00:14:48.713 --rc geninfo_unexecuted_blocks=1 00:14:48.713 00:14:48.713 ' 00:14:48.713 16:01:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:48.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:48.713 --rc genhtml_branch_coverage=1 00:14:48.713 --rc genhtml_function_coverage=1 00:14:48.713 --rc genhtml_legend=1 00:14:48.713 --rc geninfo_all_blocks=1 00:14:48.713 --rc geninfo_unexecuted_blocks=1 00:14:48.713 00:14:48.713 ' 00:14:48.713 16:01:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:48.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:48.713 --rc genhtml_branch_coverage=1 00:14:48.713 --rc genhtml_function_coverage=1 00:14:48.713 --rc genhtml_legend=1 00:14:48.713 --rc geninfo_all_blocks=1 00:14:48.713 --rc geninfo_unexecuted_blocks=1 00:14:48.713 00:14:48.713 ' 00:14:48.713 16:01:12 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:48.713 16:01:12 -- nvmf/common.sh@7 -- # uname -s 00:14:48.713 16:01:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:48.713 16:01:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:48.713 16:01:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:48.713 16:01:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:48.713 16:01:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:48.713 16:01:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:48.713 16:01:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:48.713 16:01:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:48.713 16:01:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:48.713 16:01:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:48.713 16:01:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:48.713 16:01:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:48.713 16:01:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:48.713 16:01:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:48.713 16:01:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:48.713 16:01:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:48.713 16:01:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:48.713 16:01:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:48.713 16:01:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:48.713 16:01:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.713 16:01:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.713 16:01:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.713 16:01:12 -- paths/export.sh@5 -- # export PATH 00:14:48.713 16:01:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.713 16:01:12 -- nvmf/common.sh@46 -- # : 0 00:14:48.713 16:01:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:48.713 16:01:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:48.713 16:01:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:48.714 16:01:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:48.714 16:01:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:48.714 16:01:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:48.714 16:01:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:48.714 16:01:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:48.714 16:01:12 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:48.714 16:01:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:48.714 16:01:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:48.714 16:01:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:48.714 16:01:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:48.714 16:01:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:48.714 16:01:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:48.714 16:01:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:48.714 16:01:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:48.714 16:01:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:48.714 16:01:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:48.714 16:01:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:48.714 16:01:12 -- common/autotest_common.sh@10 -- # set +x 00:14:50.617 16:01:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:50.617 16:01:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:50.617 16:01:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:50.617 16:01:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:50.617 16:01:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:50.617 16:01:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:50.617 16:01:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:50.617 16:01:14 -- nvmf/common.sh@294 -- # net_devs=() 00:14:50.617 16:01:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:50.617 16:01:14 -- nvmf/common.sh@295 -- # e810=() 00:14:50.617 16:01:14 -- nvmf/common.sh@295 -- # local -ga e810 00:14:50.617 16:01:14 -- nvmf/common.sh@296 -- # x722=() 00:14:50.617 16:01:14 -- nvmf/common.sh@296 -- # local -ga x722 00:14:50.617 16:01:14 -- nvmf/common.sh@297 -- # mlx=() 00:14:50.617 16:01:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:50.617 16:01:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:50.617 16:01:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:50.617 16:01:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:50.617 16:01:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:50.617 16:01:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:50.617 16:01:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:50.617 16:01:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:50.617 16:01:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:50.617 16:01:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:50.617 16:01:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:50.617 16:01:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:50.617 16:01:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:50.617 16:01:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:50.617 16:01:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:50.617 16:01:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:50.617 16:01:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:50.617 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:50.617 16:01:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:50.617 16:01:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:50.617 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:50.617 16:01:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:50.617 16:01:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:50.617 16:01:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:50.617 16:01:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:50.617 16:01:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:50.617 16:01:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:50.617 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:50.617 16:01:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:50.617 16:01:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:50.617 16:01:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:50.617 16:01:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:50.617 16:01:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:50.617 16:01:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:50.617 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:50.617 16:01:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:50.617 16:01:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:50.617 16:01:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:50.617 16:01:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:50.617 16:01:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:50.617 16:01:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:50.617 16:01:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:50.617 16:01:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:50.617 16:01:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:50.617 16:01:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:50.617 16:01:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:50.617 16:01:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:50.617 16:01:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:50.617 16:01:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:50.617 16:01:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:50.617 16:01:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:50.617 16:01:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:50.617 16:01:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:50.877 16:01:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:50.877 16:01:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:50.877 16:01:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:50.877 16:01:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:50.877 16:01:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:50.877 16:01:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:50.877 16:01:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:50.877 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:50.877 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:14:50.877 00:14:50.877 --- 10.0.0.2 ping statistics --- 00:14:50.877 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:50.877 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:14:50.877 16:01:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:50.877 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:50.877 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.157 ms 00:14:50.877 00:14:50.877 --- 10.0.0.1 ping statistics --- 00:14:50.877 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:50.877 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:14:50.877 16:01:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:50.877 16:01:14 -- nvmf/common.sh@410 -- # return 0 00:14:50.877 16:01:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:50.877 16:01:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:50.877 16:01:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:50.877 16:01:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:50.877 16:01:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:50.877 16:01:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:50.877 16:01:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:50.877 16:01:14 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:50.877 16:01:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:50.877 16:01:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:50.877 16:01:14 -- common/autotest_common.sh@10 -- # set +x 00:14:50.877 16:01:14 -- nvmf/common.sh@469 -- # nvmfpid=1547275 00:14:50.877 16:01:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:50.877 16:01:14 -- nvmf/common.sh@470 -- # waitforlisten 1547275 00:14:50.877 16:01:14 -- common/autotest_common.sh@829 -- # '[' -z 1547275 ']' 00:14:50.877 16:01:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:50.877 16:01:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:50.877 16:01:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:50.877 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:50.877 16:01:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:50.877 16:01:14 -- common/autotest_common.sh@10 -- # set +x 00:14:51.136 [2024-11-18 16:01:14.474281] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:51.136 [2024-11-18 16:01:14.474353] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:51.136 EAL: No free 2048 kB hugepages reported on node 1 00:14:51.136 [2024-11-18 16:01:14.545004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:51.136 [2024-11-18 16:01:14.634636] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:51.136 [2024-11-18 16:01:14.634805] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:51.136 [2024-11-18 16:01:14.634824] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:51.136 [2024-11-18 16:01:14.634839] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:51.136 [2024-11-18 16:01:14.634925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:51.136 [2024-11-18 16:01:14.635045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:51.136 [2024-11-18 16:01:14.635048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:52.071 16:01:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:52.071 16:01:15 -- common/autotest_common.sh@862 -- # return 0 00:14:52.071 16:01:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:52.071 16:01:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:52.071 16:01:15 -- common/autotest_common.sh@10 -- # set +x 00:14:52.072 16:01:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:52.072 16:01:15 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:52.072 16:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.072 16:01:15 -- common/autotest_common.sh@10 -- # set +x 00:14:52.072 [2024-11-18 16:01:15.459445] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:52.072 16:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.072 16:01:15 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:52.072 16:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.072 16:01:15 -- common/autotest_common.sh@10 -- # set +x 00:14:52.072 16:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.072 16:01:15 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:52.072 16:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.072 16:01:15 -- common/autotest_common.sh@10 -- # set +x 00:14:52.072 [2024-11-18 16:01:15.490765] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:52.072 16:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.072 16:01:15 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:52.072 16:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.072 16:01:15 -- common/autotest_common.sh@10 -- # set +x 00:14:52.072 NULL1 00:14:52.072 16:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.072 16:01:15 -- target/connect_stress.sh@21 -- # PERF_PID=1547422 00:14:52.072 16:01:15 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:52.072 16:01:15 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:52.072 16:01:15 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 EAL: No free 2048 kB hugepages reported on node 1 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:52.072 16:01:15 -- target/connect_stress.sh@28 -- # cat 00:14:52.072 16:01:15 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:52.072 16:01:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.072 16:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.072 16:01:15 -- common/autotest_common.sh@10 -- # set +x 00:14:52.331 16:01:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.331 16:01:15 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:52.331 16:01:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.331 16:01:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.331 16:01:15 -- common/autotest_common.sh@10 -- # set +x 00:14:52.898 16:01:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.898 16:01:16 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:52.898 16:01:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.898 16:01:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.898 16:01:16 -- common/autotest_common.sh@10 -- # set +x 00:14:53.155 16:01:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.155 16:01:16 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:53.155 16:01:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.155 16:01:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.155 16:01:16 -- common/autotest_common.sh@10 -- # set +x 00:14:53.414 16:01:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.414 16:01:16 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:53.414 16:01:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.414 16:01:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.414 16:01:16 -- common/autotest_common.sh@10 -- # set +x 00:14:53.672 16:01:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.672 16:01:17 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:53.672 16:01:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.672 16:01:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.672 16:01:17 -- common/autotest_common.sh@10 -- # set +x 00:14:53.930 16:01:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.930 16:01:17 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:53.930 16:01:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.930 16:01:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.930 16:01:17 -- common/autotest_common.sh@10 -- # set +x 00:14:54.495 16:01:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.495 16:01:17 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:54.495 16:01:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.495 16:01:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.495 16:01:17 -- common/autotest_common.sh@10 -- # set +x 00:14:54.753 16:01:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.753 16:01:18 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:54.753 16:01:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.753 16:01:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.753 16:01:18 -- common/autotest_common.sh@10 -- # set +x 00:14:55.011 16:01:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.011 16:01:18 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:55.011 16:01:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.011 16:01:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.011 16:01:18 -- common/autotest_common.sh@10 -- # set +x 00:14:55.270 16:01:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.270 16:01:18 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:55.270 16:01:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.270 16:01:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.270 16:01:18 -- common/autotest_common.sh@10 -- # set +x 00:14:55.528 16:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.528 16:01:19 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:55.528 16:01:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.528 16:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.528 16:01:19 -- common/autotest_common.sh@10 -- # set +x 00:14:56.093 16:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.093 16:01:19 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:56.093 16:01:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:56.093 16:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.093 16:01:19 -- common/autotest_common.sh@10 -- # set +x 00:14:56.350 16:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.350 16:01:19 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:56.350 16:01:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:56.350 16:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.350 16:01:19 -- common/autotest_common.sh@10 -- # set +x 00:14:56.608 16:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.608 16:01:20 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:56.608 16:01:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:56.608 16:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.608 16:01:20 -- common/autotest_common.sh@10 -- # set +x 00:14:56.866 16:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.866 16:01:20 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:56.866 16:01:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:56.866 16:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.866 16:01:20 -- common/autotest_common.sh@10 -- # set +x 00:14:57.124 16:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.124 16:01:20 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:57.124 16:01:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.124 16:01:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.124 16:01:20 -- common/autotest_common.sh@10 -- # set +x 00:14:57.689 16:01:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.689 16:01:21 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:57.689 16:01:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.689 16:01:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.689 16:01:21 -- common/autotest_common.sh@10 -- # set +x 00:14:57.947 16:01:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.947 16:01:21 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:57.947 16:01:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:57.947 16:01:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.947 16:01:21 -- common/autotest_common.sh@10 -- # set +x 00:14:58.205 16:01:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.205 16:01:21 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:58.205 16:01:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:58.205 16:01:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.205 16:01:21 -- common/autotest_common.sh@10 -- # set +x 00:14:58.463 16:01:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.463 16:01:21 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:58.463 16:01:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:58.463 16:01:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.463 16:01:21 -- common/autotest_common.sh@10 -- # set +x 00:14:58.721 16:01:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.721 16:01:22 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:58.721 16:01:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:58.721 16:01:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.721 16:01:22 -- common/autotest_common.sh@10 -- # set +x 00:14:59.286 16:01:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.286 16:01:22 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:59.286 16:01:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.286 16:01:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.286 16:01:22 -- common/autotest_common.sh@10 -- # set +x 00:14:59.544 16:01:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.544 16:01:22 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:59.544 16:01:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.544 16:01:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.544 16:01:22 -- common/autotest_common.sh@10 -- # set +x 00:14:59.802 16:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.802 16:01:23 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:14:59.802 16:01:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:59.802 16:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.802 16:01:23 -- common/autotest_common.sh@10 -- # set +x 00:15:00.060 16:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.060 16:01:23 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:15:00.060 16:01:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.060 16:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.060 16:01:23 -- common/autotest_common.sh@10 -- # set +x 00:15:00.318 16:01:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.318 16:01:23 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:15:00.318 16:01:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.318 16:01:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.318 16:01:23 -- common/autotest_common.sh@10 -- # set +x 00:15:00.884 16:01:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.884 16:01:24 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:15:00.884 16:01:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:00.884 16:01:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.884 16:01:24 -- common/autotest_common.sh@10 -- # set +x 00:15:01.141 16:01:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.141 16:01:24 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:15:01.141 16:01:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.141 16:01:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.141 16:01:24 -- common/autotest_common.sh@10 -- # set +x 00:15:01.400 16:01:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.400 16:01:24 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:15:01.400 16:01:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.400 16:01:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.400 16:01:24 -- common/autotest_common.sh@10 -- # set +x 00:15:01.657 16:01:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.657 16:01:25 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:15:01.657 16:01:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:01.657 16:01:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.657 16:01:25 -- common/autotest_common.sh@10 -- # set +x 00:15:02.224 16:01:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.224 16:01:25 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:15:02.224 16:01:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:02.224 16:01:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.224 16:01:25 -- common/autotest_common.sh@10 -- # set +x 00:15:02.224 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:02.482 16:01:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.482 16:01:25 -- target/connect_stress.sh@34 -- # kill -0 1547422 00:15:02.482 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1547422) - No such process 00:15:02.482 16:01:25 -- target/connect_stress.sh@38 -- # wait 1547422 00:15:02.482 16:01:25 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:02.482 16:01:25 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:02.482 16:01:25 -- target/connect_stress.sh@43 -- # nvmftestfini 00:15:02.482 16:01:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:02.482 16:01:25 -- nvmf/common.sh@116 -- # sync 00:15:02.482 16:01:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:02.482 16:01:25 -- nvmf/common.sh@119 -- # set +e 00:15:02.482 16:01:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:02.482 16:01:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:02.482 rmmod nvme_tcp 00:15:02.482 rmmod nvme_fabrics 00:15:02.482 rmmod nvme_keyring 00:15:02.482 16:01:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:02.482 16:01:25 -- nvmf/common.sh@123 -- # set -e 00:15:02.482 16:01:25 -- nvmf/common.sh@124 -- # return 0 00:15:02.482 16:01:25 -- nvmf/common.sh@477 -- # '[' -n 1547275 ']' 00:15:02.482 16:01:25 -- nvmf/common.sh@478 -- # killprocess 1547275 00:15:02.482 16:01:25 -- common/autotest_common.sh@936 -- # '[' -z 1547275 ']' 00:15:02.482 16:01:25 -- common/autotest_common.sh@940 -- # kill -0 1547275 00:15:02.482 16:01:25 -- common/autotest_common.sh@941 -- # uname 00:15:02.482 16:01:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:02.482 16:01:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1547275 00:15:02.482 16:01:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:02.482 16:01:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:02.482 16:01:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1547275' 00:15:02.482 killing process with pid 1547275 00:15:02.482 16:01:25 -- common/autotest_common.sh@955 -- # kill 1547275 00:15:02.482 16:01:25 -- common/autotest_common.sh@960 -- # wait 1547275 00:15:02.740 16:01:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:02.740 16:01:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:02.740 16:01:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:02.740 16:01:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:02.740 16:01:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:02.740 16:01:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:02.741 16:01:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:02.741 16:01:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:04.637 16:01:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:04.637 00:15:04.637 real 0m16.139s 00:15:04.637 user 0m41.028s 00:15:04.637 sys 0m5.611s 00:15:04.637 16:01:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:04.637 16:01:28 -- common/autotest_common.sh@10 -- # set +x 00:15:04.637 ************************************ 00:15:04.637 END TEST nvmf_connect_stress 00:15:04.637 ************************************ 00:15:04.637 16:01:28 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:04.637 16:01:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:04.637 16:01:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:04.637 16:01:28 -- common/autotest_common.sh@10 -- # set +x 00:15:04.637 ************************************ 00:15:04.637 START TEST nvmf_fused_ordering 00:15:04.637 ************************************ 00:15:04.637 16:01:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:04.895 * Looking for test storage... 00:15:04.895 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:04.895 16:01:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:04.895 16:01:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:04.895 16:01:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:04.895 16:01:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:04.895 16:01:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:04.895 16:01:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:04.895 16:01:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:04.895 16:01:28 -- scripts/common.sh@335 -- # IFS=.-: 00:15:04.895 16:01:28 -- scripts/common.sh@335 -- # read -ra ver1 00:15:04.895 16:01:28 -- scripts/common.sh@336 -- # IFS=.-: 00:15:04.895 16:01:28 -- scripts/common.sh@336 -- # read -ra ver2 00:15:04.895 16:01:28 -- scripts/common.sh@337 -- # local 'op=<' 00:15:04.895 16:01:28 -- scripts/common.sh@339 -- # ver1_l=2 00:15:04.895 16:01:28 -- scripts/common.sh@340 -- # ver2_l=1 00:15:04.895 16:01:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:04.895 16:01:28 -- scripts/common.sh@343 -- # case "$op" in 00:15:04.895 16:01:28 -- scripts/common.sh@344 -- # : 1 00:15:04.895 16:01:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:04.895 16:01:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:04.895 16:01:28 -- scripts/common.sh@364 -- # decimal 1 00:15:04.895 16:01:28 -- scripts/common.sh@352 -- # local d=1 00:15:04.895 16:01:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:04.895 16:01:28 -- scripts/common.sh@354 -- # echo 1 00:15:04.895 16:01:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:04.895 16:01:28 -- scripts/common.sh@365 -- # decimal 2 00:15:04.895 16:01:28 -- scripts/common.sh@352 -- # local d=2 00:15:04.895 16:01:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:04.895 16:01:28 -- scripts/common.sh@354 -- # echo 2 00:15:04.895 16:01:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:04.895 16:01:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:04.895 16:01:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:04.895 16:01:28 -- scripts/common.sh@367 -- # return 0 00:15:04.895 16:01:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:04.895 16:01:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:04.895 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.895 --rc genhtml_branch_coverage=1 00:15:04.895 --rc genhtml_function_coverage=1 00:15:04.895 --rc genhtml_legend=1 00:15:04.895 --rc geninfo_all_blocks=1 00:15:04.895 --rc geninfo_unexecuted_blocks=1 00:15:04.895 00:15:04.895 ' 00:15:04.895 16:01:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:04.895 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.895 --rc genhtml_branch_coverage=1 00:15:04.895 --rc genhtml_function_coverage=1 00:15:04.895 --rc genhtml_legend=1 00:15:04.895 --rc geninfo_all_blocks=1 00:15:04.895 --rc geninfo_unexecuted_blocks=1 00:15:04.895 00:15:04.895 ' 00:15:04.895 16:01:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:04.895 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.895 --rc genhtml_branch_coverage=1 00:15:04.895 --rc genhtml_function_coverage=1 00:15:04.895 --rc genhtml_legend=1 00:15:04.895 --rc geninfo_all_blocks=1 00:15:04.895 --rc geninfo_unexecuted_blocks=1 00:15:04.895 00:15:04.895 ' 00:15:04.895 16:01:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:04.895 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.895 --rc genhtml_branch_coverage=1 00:15:04.895 --rc genhtml_function_coverage=1 00:15:04.895 --rc genhtml_legend=1 00:15:04.895 --rc geninfo_all_blocks=1 00:15:04.895 --rc geninfo_unexecuted_blocks=1 00:15:04.895 00:15:04.895 ' 00:15:04.895 16:01:28 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:04.895 16:01:28 -- nvmf/common.sh@7 -- # uname -s 00:15:04.895 16:01:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:04.895 16:01:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:04.895 16:01:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:04.895 16:01:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:04.895 16:01:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:04.895 16:01:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:04.895 16:01:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:04.895 16:01:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:04.895 16:01:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:04.895 16:01:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:04.895 16:01:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:04.895 16:01:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:04.895 16:01:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:04.895 16:01:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:04.895 16:01:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:04.895 16:01:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:04.895 16:01:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:04.895 16:01:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:04.896 16:01:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:04.896 16:01:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.896 16:01:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.896 16:01:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.896 16:01:28 -- paths/export.sh@5 -- # export PATH 00:15:04.896 16:01:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.896 16:01:28 -- nvmf/common.sh@46 -- # : 0 00:15:04.896 16:01:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:04.896 16:01:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:04.896 16:01:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:04.896 16:01:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:04.896 16:01:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:04.896 16:01:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:04.896 16:01:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:04.896 16:01:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:04.896 16:01:28 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:15:04.896 16:01:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:04.896 16:01:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:04.896 16:01:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:04.896 16:01:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:04.896 16:01:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:04.896 16:01:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:04.896 16:01:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:04.896 16:01:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:04.896 16:01:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:04.896 16:01:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:04.896 16:01:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:04.896 16:01:28 -- common/autotest_common.sh@10 -- # set +x 00:15:06.795 16:01:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:06.795 16:01:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:06.795 16:01:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:06.795 16:01:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:06.795 16:01:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:06.795 16:01:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:06.795 16:01:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:06.795 16:01:30 -- nvmf/common.sh@294 -- # net_devs=() 00:15:06.795 16:01:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:06.795 16:01:30 -- nvmf/common.sh@295 -- # e810=() 00:15:06.795 16:01:30 -- nvmf/common.sh@295 -- # local -ga e810 00:15:06.795 16:01:30 -- nvmf/common.sh@296 -- # x722=() 00:15:06.795 16:01:30 -- nvmf/common.sh@296 -- # local -ga x722 00:15:06.795 16:01:30 -- nvmf/common.sh@297 -- # mlx=() 00:15:06.795 16:01:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:06.795 16:01:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:06.795 16:01:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:06.795 16:01:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:06.795 16:01:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:06.795 16:01:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:06.795 16:01:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:06.795 16:01:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:06.795 16:01:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:06.795 16:01:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:06.795 16:01:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:06.795 16:01:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:06.795 16:01:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:06.795 16:01:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:06.795 16:01:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:06.795 16:01:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:06.795 16:01:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:06.795 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:06.795 16:01:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:06.795 16:01:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:06.795 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:06.795 16:01:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:06.795 16:01:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:06.795 16:01:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:06.795 16:01:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:06.795 16:01:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:06.795 16:01:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:06.795 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:06.795 16:01:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:06.795 16:01:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:06.795 16:01:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:06.795 16:01:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:06.795 16:01:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:06.795 16:01:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:06.795 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:06.795 16:01:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:06.795 16:01:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:06.795 16:01:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:06.795 16:01:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:06.795 16:01:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:06.795 16:01:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:06.795 16:01:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:06.795 16:01:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:06.795 16:01:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:06.795 16:01:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:06.795 16:01:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:06.795 16:01:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:06.795 16:01:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:06.795 16:01:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:06.795 16:01:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:06.795 16:01:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:06.796 16:01:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:06.796 16:01:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:07.054 16:01:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:07.054 16:01:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:07.054 16:01:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:07.054 16:01:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:07.054 16:01:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:07.054 16:01:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:07.054 16:01:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:07.054 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:07.054 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.338 ms 00:15:07.054 00:15:07.054 --- 10.0.0.2 ping statistics --- 00:15:07.054 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:07.054 rtt min/avg/max/mdev = 0.338/0.338/0.338/0.000 ms 00:15:07.054 16:01:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:07.054 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:07.054 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.069 ms 00:15:07.054 00:15:07.054 --- 10.0.0.1 ping statistics --- 00:15:07.054 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:07.054 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:15:07.054 16:01:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:07.054 16:01:30 -- nvmf/common.sh@410 -- # return 0 00:15:07.054 16:01:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:07.054 16:01:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:07.054 16:01:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:07.054 16:01:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:07.054 16:01:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:07.054 16:01:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:07.054 16:01:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:07.054 16:01:30 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:15:07.054 16:01:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:07.054 16:01:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:07.054 16:01:30 -- common/autotest_common.sh@10 -- # set +x 00:15:07.054 16:01:30 -- nvmf/common.sh@469 -- # nvmfpid=1550742 00:15:07.054 16:01:30 -- nvmf/common.sh@470 -- # waitforlisten 1550742 00:15:07.054 16:01:30 -- common/autotest_common.sh@829 -- # '[' -z 1550742 ']' 00:15:07.054 16:01:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:07.054 16:01:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:07.054 16:01:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:07.054 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:07.054 16:01:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:07.054 16:01:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:07.054 16:01:30 -- common/autotest_common.sh@10 -- # set +x 00:15:07.054 [2024-11-18 16:01:30.546801] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:07.054 [2024-11-18 16:01:30.546875] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:07.054 EAL: No free 2048 kB hugepages reported on node 1 00:15:07.054 [2024-11-18 16:01:30.615793] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:07.312 [2024-11-18 16:01:30.706474] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:07.312 [2024-11-18 16:01:30.706652] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:07.312 [2024-11-18 16:01:30.706673] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:07.312 [2024-11-18 16:01:30.706688] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:07.312 [2024-11-18 16:01:30.706723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:08.246 16:01:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:08.246 16:01:31 -- common/autotest_common.sh@862 -- # return 0 00:15:08.246 16:01:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:08.246 16:01:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:08.246 16:01:31 -- common/autotest_common.sh@10 -- # set +x 00:15:08.246 16:01:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:08.246 16:01:31 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:08.246 16:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.246 16:01:31 -- common/autotest_common.sh@10 -- # set +x 00:15:08.246 [2024-11-18 16:01:31.540094] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:08.246 16:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.246 16:01:31 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:08.246 16:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.246 16:01:31 -- common/autotest_common.sh@10 -- # set +x 00:15:08.246 16:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.246 16:01:31 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:08.246 16:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.247 16:01:31 -- common/autotest_common.sh@10 -- # set +x 00:15:08.247 [2024-11-18 16:01:31.556284] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:08.247 16:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.247 16:01:31 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:08.247 16:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.247 16:01:31 -- common/autotest_common.sh@10 -- # set +x 00:15:08.247 NULL1 00:15:08.247 16:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.247 16:01:31 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:08.247 16:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.247 16:01:31 -- common/autotest_common.sh@10 -- # set +x 00:15:08.247 16:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.247 16:01:31 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:08.247 16:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.247 16:01:31 -- common/autotest_common.sh@10 -- # set +x 00:15:08.247 16:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.247 16:01:31 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:08.247 [2024-11-18 16:01:31.600546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:08.247 [2024-11-18 16:01:31.600587] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1550900 ] 00:15:08.247 EAL: No free 2048 kB hugepages reported on node 1 00:15:08.505 Attached to nqn.2016-06.io.spdk:cnode1 00:15:08.505 Namespace ID: 1 size: 1GB 00:15:08.505 fused_ordering(0) 00:15:08.505 fused_ordering(1) 00:15:08.505 fused_ordering(2) 00:15:08.505 fused_ordering(3) 00:15:08.505 fused_ordering(4) 00:15:08.505 fused_ordering(5) 00:15:08.505 fused_ordering(6) 00:15:08.505 fused_ordering(7) 00:15:08.505 fused_ordering(8) 00:15:08.505 fused_ordering(9) 00:15:08.505 fused_ordering(10) 00:15:08.505 fused_ordering(11) 00:15:08.505 fused_ordering(12) 00:15:08.505 fused_ordering(13) 00:15:08.505 fused_ordering(14) 00:15:08.505 fused_ordering(15) 00:15:08.505 fused_ordering(16) 00:15:08.505 fused_ordering(17) 00:15:08.505 fused_ordering(18) 00:15:08.505 fused_ordering(19) 00:15:08.505 fused_ordering(20) 00:15:08.505 fused_ordering(21) 00:15:08.505 fused_ordering(22) 00:15:08.505 fused_ordering(23) 00:15:08.505 fused_ordering(24) 00:15:08.505 fused_ordering(25) 00:15:08.505 fused_ordering(26) 00:15:08.505 fused_ordering(27) 00:15:08.505 fused_ordering(28) 00:15:08.505 fused_ordering(29) 00:15:08.505 fused_ordering(30) 00:15:08.505 fused_ordering(31) 00:15:08.505 fused_ordering(32) 00:15:08.505 fused_ordering(33) 00:15:08.505 fused_ordering(34) 00:15:08.505 fused_ordering(35) 00:15:08.505 fused_ordering(36) 00:15:08.505 fused_ordering(37) 00:15:08.505 fused_ordering(38) 00:15:08.505 fused_ordering(39) 00:15:08.505 fused_ordering(40) 00:15:08.505 fused_ordering(41) 00:15:08.505 fused_ordering(42) 00:15:08.505 fused_ordering(43) 00:15:08.505 fused_ordering(44) 00:15:08.505 fused_ordering(45) 00:15:08.505 fused_ordering(46) 00:15:08.505 fused_ordering(47) 00:15:08.505 fused_ordering(48) 00:15:08.505 fused_ordering(49) 00:15:08.505 fused_ordering(50) 00:15:08.505 fused_ordering(51) 00:15:08.505 fused_ordering(52) 00:15:08.505 fused_ordering(53) 00:15:08.505 fused_ordering(54) 00:15:08.505 fused_ordering(55) 00:15:08.505 fused_ordering(56) 00:15:08.505 fused_ordering(57) 00:15:08.505 fused_ordering(58) 00:15:08.505 fused_ordering(59) 00:15:08.505 fused_ordering(60) 00:15:08.505 fused_ordering(61) 00:15:08.505 fused_ordering(62) 00:15:08.505 fused_ordering(63) 00:15:08.505 fused_ordering(64) 00:15:08.505 fused_ordering(65) 00:15:08.505 fused_ordering(66) 00:15:08.505 fused_ordering(67) 00:15:08.505 fused_ordering(68) 00:15:08.505 fused_ordering(69) 00:15:08.505 fused_ordering(70) 00:15:08.505 fused_ordering(71) 00:15:08.505 fused_ordering(72) 00:15:08.505 fused_ordering(73) 00:15:08.505 fused_ordering(74) 00:15:08.505 fused_ordering(75) 00:15:08.505 fused_ordering(76) 00:15:08.505 fused_ordering(77) 00:15:08.505 fused_ordering(78) 00:15:08.505 fused_ordering(79) 00:15:08.505 fused_ordering(80) 00:15:08.505 fused_ordering(81) 00:15:08.505 fused_ordering(82) 00:15:08.505 fused_ordering(83) 00:15:08.505 fused_ordering(84) 00:15:08.505 fused_ordering(85) 00:15:08.505 fused_ordering(86) 00:15:08.505 fused_ordering(87) 00:15:08.505 fused_ordering(88) 00:15:08.505 fused_ordering(89) 00:15:08.505 fused_ordering(90) 00:15:08.505 fused_ordering(91) 00:15:08.505 fused_ordering(92) 00:15:08.505 fused_ordering(93) 00:15:08.505 fused_ordering(94) 00:15:08.505 fused_ordering(95) 00:15:08.505 fused_ordering(96) 00:15:08.505 fused_ordering(97) 00:15:08.505 fused_ordering(98) 00:15:08.505 fused_ordering(99) 00:15:08.505 fused_ordering(100) 00:15:08.505 fused_ordering(101) 00:15:08.505 fused_ordering(102) 00:15:08.505 fused_ordering(103) 00:15:08.505 fused_ordering(104) 00:15:08.505 fused_ordering(105) 00:15:08.505 fused_ordering(106) 00:15:08.505 fused_ordering(107) 00:15:08.505 fused_ordering(108) 00:15:08.505 fused_ordering(109) 00:15:08.505 fused_ordering(110) 00:15:08.505 fused_ordering(111) 00:15:08.505 fused_ordering(112) 00:15:08.505 fused_ordering(113) 00:15:08.505 fused_ordering(114) 00:15:08.505 fused_ordering(115) 00:15:08.505 fused_ordering(116) 00:15:08.505 fused_ordering(117) 00:15:08.505 fused_ordering(118) 00:15:08.505 fused_ordering(119) 00:15:08.505 fused_ordering(120) 00:15:08.505 fused_ordering(121) 00:15:08.505 fused_ordering(122) 00:15:08.505 fused_ordering(123) 00:15:08.505 fused_ordering(124) 00:15:08.505 fused_ordering(125) 00:15:08.505 fused_ordering(126) 00:15:08.505 fused_ordering(127) 00:15:08.505 fused_ordering(128) 00:15:08.505 fused_ordering(129) 00:15:08.505 fused_ordering(130) 00:15:08.505 fused_ordering(131) 00:15:08.505 fused_ordering(132) 00:15:08.505 fused_ordering(133) 00:15:08.505 fused_ordering(134) 00:15:08.505 fused_ordering(135) 00:15:08.505 fused_ordering(136) 00:15:08.505 fused_ordering(137) 00:15:08.505 fused_ordering(138) 00:15:08.505 fused_ordering(139) 00:15:08.505 fused_ordering(140) 00:15:08.505 fused_ordering(141) 00:15:08.505 fused_ordering(142) 00:15:08.505 fused_ordering(143) 00:15:08.505 fused_ordering(144) 00:15:08.505 fused_ordering(145) 00:15:08.505 fused_ordering(146) 00:15:08.505 fused_ordering(147) 00:15:08.505 fused_ordering(148) 00:15:08.505 fused_ordering(149) 00:15:08.505 fused_ordering(150) 00:15:08.505 fused_ordering(151) 00:15:08.505 fused_ordering(152) 00:15:08.505 fused_ordering(153) 00:15:08.505 fused_ordering(154) 00:15:08.505 fused_ordering(155) 00:15:08.505 fused_ordering(156) 00:15:08.505 fused_ordering(157) 00:15:08.505 fused_ordering(158) 00:15:08.505 fused_ordering(159) 00:15:08.505 fused_ordering(160) 00:15:08.505 fused_ordering(161) 00:15:08.505 fused_ordering(162) 00:15:08.505 fused_ordering(163) 00:15:08.505 fused_ordering(164) 00:15:08.505 fused_ordering(165) 00:15:08.505 fused_ordering(166) 00:15:08.505 fused_ordering(167) 00:15:08.505 fused_ordering(168) 00:15:08.505 fused_ordering(169) 00:15:08.505 fused_ordering(170) 00:15:08.505 fused_ordering(171) 00:15:08.505 fused_ordering(172) 00:15:08.505 fused_ordering(173) 00:15:08.505 fused_ordering(174) 00:15:08.505 fused_ordering(175) 00:15:08.505 fused_ordering(176) 00:15:08.505 fused_ordering(177) 00:15:08.505 fused_ordering(178) 00:15:08.505 fused_ordering(179) 00:15:08.505 fused_ordering(180) 00:15:08.505 fused_ordering(181) 00:15:08.505 fused_ordering(182) 00:15:08.505 fused_ordering(183) 00:15:08.505 fused_ordering(184) 00:15:08.505 fused_ordering(185) 00:15:08.505 fused_ordering(186) 00:15:08.505 fused_ordering(187) 00:15:08.505 fused_ordering(188) 00:15:08.505 fused_ordering(189) 00:15:08.505 fused_ordering(190) 00:15:08.505 fused_ordering(191) 00:15:08.505 fused_ordering(192) 00:15:08.505 fused_ordering(193) 00:15:08.505 fused_ordering(194) 00:15:08.505 fused_ordering(195) 00:15:08.505 fused_ordering(196) 00:15:08.505 fused_ordering(197) 00:15:08.505 fused_ordering(198) 00:15:08.505 fused_ordering(199) 00:15:08.505 fused_ordering(200) 00:15:08.505 fused_ordering(201) 00:15:08.505 fused_ordering(202) 00:15:08.505 fused_ordering(203) 00:15:08.505 fused_ordering(204) 00:15:08.505 fused_ordering(205) 00:15:09.072 fused_ordering(206) 00:15:09.072 fused_ordering(207) 00:15:09.072 fused_ordering(208) 00:15:09.072 fused_ordering(209) 00:15:09.072 fused_ordering(210) 00:15:09.072 fused_ordering(211) 00:15:09.072 fused_ordering(212) 00:15:09.072 fused_ordering(213) 00:15:09.072 fused_ordering(214) 00:15:09.072 fused_ordering(215) 00:15:09.072 fused_ordering(216) 00:15:09.072 fused_ordering(217) 00:15:09.072 fused_ordering(218) 00:15:09.072 fused_ordering(219) 00:15:09.072 fused_ordering(220) 00:15:09.072 fused_ordering(221) 00:15:09.072 fused_ordering(222) 00:15:09.072 fused_ordering(223) 00:15:09.072 fused_ordering(224) 00:15:09.072 fused_ordering(225) 00:15:09.072 fused_ordering(226) 00:15:09.072 fused_ordering(227) 00:15:09.072 fused_ordering(228) 00:15:09.072 fused_ordering(229) 00:15:09.072 fused_ordering(230) 00:15:09.072 fused_ordering(231) 00:15:09.072 fused_ordering(232) 00:15:09.072 fused_ordering(233) 00:15:09.072 fused_ordering(234) 00:15:09.072 fused_ordering(235) 00:15:09.072 fused_ordering(236) 00:15:09.072 fused_ordering(237) 00:15:09.072 fused_ordering(238) 00:15:09.072 fused_ordering(239) 00:15:09.072 fused_ordering(240) 00:15:09.072 fused_ordering(241) 00:15:09.072 fused_ordering(242) 00:15:09.072 fused_ordering(243) 00:15:09.072 fused_ordering(244) 00:15:09.072 fused_ordering(245) 00:15:09.072 fused_ordering(246) 00:15:09.072 fused_ordering(247) 00:15:09.072 fused_ordering(248) 00:15:09.072 fused_ordering(249) 00:15:09.072 fused_ordering(250) 00:15:09.072 fused_ordering(251) 00:15:09.072 fused_ordering(252) 00:15:09.072 fused_ordering(253) 00:15:09.072 fused_ordering(254) 00:15:09.072 fused_ordering(255) 00:15:09.072 fused_ordering(256) 00:15:09.072 fused_ordering(257) 00:15:09.072 fused_ordering(258) 00:15:09.072 fused_ordering(259) 00:15:09.072 fused_ordering(260) 00:15:09.072 fused_ordering(261) 00:15:09.072 fused_ordering(262) 00:15:09.072 fused_ordering(263) 00:15:09.072 fused_ordering(264) 00:15:09.072 fused_ordering(265) 00:15:09.072 fused_ordering(266) 00:15:09.072 fused_ordering(267) 00:15:09.072 fused_ordering(268) 00:15:09.072 fused_ordering(269) 00:15:09.072 fused_ordering(270) 00:15:09.072 fused_ordering(271) 00:15:09.072 fused_ordering(272) 00:15:09.072 fused_ordering(273) 00:15:09.072 fused_ordering(274) 00:15:09.072 fused_ordering(275) 00:15:09.072 fused_ordering(276) 00:15:09.072 fused_ordering(277) 00:15:09.072 fused_ordering(278) 00:15:09.072 fused_ordering(279) 00:15:09.072 fused_ordering(280) 00:15:09.072 fused_ordering(281) 00:15:09.072 fused_ordering(282) 00:15:09.072 fused_ordering(283) 00:15:09.072 fused_ordering(284) 00:15:09.072 fused_ordering(285) 00:15:09.072 fused_ordering(286) 00:15:09.072 fused_ordering(287) 00:15:09.072 fused_ordering(288) 00:15:09.072 fused_ordering(289) 00:15:09.072 fused_ordering(290) 00:15:09.072 fused_ordering(291) 00:15:09.072 fused_ordering(292) 00:15:09.072 fused_ordering(293) 00:15:09.072 fused_ordering(294) 00:15:09.072 fused_ordering(295) 00:15:09.072 fused_ordering(296) 00:15:09.072 fused_ordering(297) 00:15:09.072 fused_ordering(298) 00:15:09.072 fused_ordering(299) 00:15:09.072 fused_ordering(300) 00:15:09.072 fused_ordering(301) 00:15:09.072 fused_ordering(302) 00:15:09.072 fused_ordering(303) 00:15:09.072 fused_ordering(304) 00:15:09.072 fused_ordering(305) 00:15:09.072 fused_ordering(306) 00:15:09.072 fused_ordering(307) 00:15:09.072 fused_ordering(308) 00:15:09.072 fused_ordering(309) 00:15:09.072 fused_ordering(310) 00:15:09.072 fused_ordering(311) 00:15:09.072 fused_ordering(312) 00:15:09.072 fused_ordering(313) 00:15:09.072 fused_ordering(314) 00:15:09.072 fused_ordering(315) 00:15:09.072 fused_ordering(316) 00:15:09.072 fused_ordering(317) 00:15:09.072 fused_ordering(318) 00:15:09.072 fused_ordering(319) 00:15:09.072 fused_ordering(320) 00:15:09.072 fused_ordering(321) 00:15:09.072 fused_ordering(322) 00:15:09.072 fused_ordering(323) 00:15:09.072 fused_ordering(324) 00:15:09.072 fused_ordering(325) 00:15:09.072 fused_ordering(326) 00:15:09.072 fused_ordering(327) 00:15:09.072 fused_ordering(328) 00:15:09.072 fused_ordering(329) 00:15:09.072 fused_ordering(330) 00:15:09.072 fused_ordering(331) 00:15:09.072 fused_ordering(332) 00:15:09.072 fused_ordering(333) 00:15:09.072 fused_ordering(334) 00:15:09.072 fused_ordering(335) 00:15:09.072 fused_ordering(336) 00:15:09.072 fused_ordering(337) 00:15:09.072 fused_ordering(338) 00:15:09.072 fused_ordering(339) 00:15:09.072 fused_ordering(340) 00:15:09.072 fused_ordering(341) 00:15:09.072 fused_ordering(342) 00:15:09.072 fused_ordering(343) 00:15:09.072 fused_ordering(344) 00:15:09.072 fused_ordering(345) 00:15:09.072 fused_ordering(346) 00:15:09.072 fused_ordering(347) 00:15:09.072 fused_ordering(348) 00:15:09.072 fused_ordering(349) 00:15:09.072 fused_ordering(350) 00:15:09.072 fused_ordering(351) 00:15:09.072 fused_ordering(352) 00:15:09.072 fused_ordering(353) 00:15:09.072 fused_ordering(354) 00:15:09.072 fused_ordering(355) 00:15:09.072 fused_ordering(356) 00:15:09.072 fused_ordering(357) 00:15:09.072 fused_ordering(358) 00:15:09.072 fused_ordering(359) 00:15:09.072 fused_ordering(360) 00:15:09.072 fused_ordering(361) 00:15:09.072 fused_ordering(362) 00:15:09.072 fused_ordering(363) 00:15:09.072 fused_ordering(364) 00:15:09.072 fused_ordering(365) 00:15:09.072 fused_ordering(366) 00:15:09.072 fused_ordering(367) 00:15:09.072 fused_ordering(368) 00:15:09.072 fused_ordering(369) 00:15:09.072 fused_ordering(370) 00:15:09.072 fused_ordering(371) 00:15:09.072 fused_ordering(372) 00:15:09.072 fused_ordering(373) 00:15:09.072 fused_ordering(374) 00:15:09.072 fused_ordering(375) 00:15:09.072 fused_ordering(376) 00:15:09.072 fused_ordering(377) 00:15:09.072 fused_ordering(378) 00:15:09.072 fused_ordering(379) 00:15:09.072 fused_ordering(380) 00:15:09.072 fused_ordering(381) 00:15:09.072 fused_ordering(382) 00:15:09.072 fused_ordering(383) 00:15:09.072 fused_ordering(384) 00:15:09.072 fused_ordering(385) 00:15:09.072 fused_ordering(386) 00:15:09.072 fused_ordering(387) 00:15:09.072 fused_ordering(388) 00:15:09.072 fused_ordering(389) 00:15:09.072 fused_ordering(390) 00:15:09.072 fused_ordering(391) 00:15:09.072 fused_ordering(392) 00:15:09.072 fused_ordering(393) 00:15:09.072 fused_ordering(394) 00:15:09.072 fused_ordering(395) 00:15:09.072 fused_ordering(396) 00:15:09.072 fused_ordering(397) 00:15:09.072 fused_ordering(398) 00:15:09.072 fused_ordering(399) 00:15:09.072 fused_ordering(400) 00:15:09.073 fused_ordering(401) 00:15:09.073 fused_ordering(402) 00:15:09.073 fused_ordering(403) 00:15:09.073 fused_ordering(404) 00:15:09.073 fused_ordering(405) 00:15:09.073 fused_ordering(406) 00:15:09.073 fused_ordering(407) 00:15:09.073 fused_ordering(408) 00:15:09.073 fused_ordering(409) 00:15:09.073 fused_ordering(410) 00:15:09.331 fused_ordering(411) 00:15:09.331 fused_ordering(412) 00:15:09.331 fused_ordering(413) 00:15:09.331 fused_ordering(414) 00:15:09.331 fused_ordering(415) 00:15:09.331 fused_ordering(416) 00:15:09.331 fused_ordering(417) 00:15:09.331 fused_ordering(418) 00:15:09.331 fused_ordering(419) 00:15:09.331 fused_ordering(420) 00:15:09.331 fused_ordering(421) 00:15:09.331 fused_ordering(422) 00:15:09.331 fused_ordering(423) 00:15:09.331 fused_ordering(424) 00:15:09.331 fused_ordering(425) 00:15:09.331 fused_ordering(426) 00:15:09.331 fused_ordering(427) 00:15:09.331 fused_ordering(428) 00:15:09.331 fused_ordering(429) 00:15:09.331 fused_ordering(430) 00:15:09.331 fused_ordering(431) 00:15:09.331 fused_ordering(432) 00:15:09.331 fused_ordering(433) 00:15:09.331 fused_ordering(434) 00:15:09.331 fused_ordering(435) 00:15:09.331 fused_ordering(436) 00:15:09.331 fused_ordering(437) 00:15:09.331 fused_ordering(438) 00:15:09.331 fused_ordering(439) 00:15:09.331 fused_ordering(440) 00:15:09.331 fused_ordering(441) 00:15:09.331 fused_ordering(442) 00:15:09.331 fused_ordering(443) 00:15:09.331 fused_ordering(444) 00:15:09.331 fused_ordering(445) 00:15:09.331 fused_ordering(446) 00:15:09.331 fused_ordering(447) 00:15:09.331 fused_ordering(448) 00:15:09.331 fused_ordering(449) 00:15:09.331 fused_ordering(450) 00:15:09.331 fused_ordering(451) 00:15:09.331 fused_ordering(452) 00:15:09.331 fused_ordering(453) 00:15:09.331 fused_ordering(454) 00:15:09.331 fused_ordering(455) 00:15:09.331 fused_ordering(456) 00:15:09.331 fused_ordering(457) 00:15:09.331 fused_ordering(458) 00:15:09.331 fused_ordering(459) 00:15:09.331 fused_ordering(460) 00:15:09.331 fused_ordering(461) 00:15:09.331 fused_ordering(462) 00:15:09.331 fused_ordering(463) 00:15:09.331 fused_ordering(464) 00:15:09.331 fused_ordering(465) 00:15:09.331 fused_ordering(466) 00:15:09.331 fused_ordering(467) 00:15:09.331 fused_ordering(468) 00:15:09.331 fused_ordering(469) 00:15:09.331 fused_ordering(470) 00:15:09.331 fused_ordering(471) 00:15:09.331 fused_ordering(472) 00:15:09.331 fused_ordering(473) 00:15:09.331 fused_ordering(474) 00:15:09.331 fused_ordering(475) 00:15:09.331 fused_ordering(476) 00:15:09.331 fused_ordering(477) 00:15:09.331 fused_ordering(478) 00:15:09.331 fused_ordering(479) 00:15:09.331 fused_ordering(480) 00:15:09.331 fused_ordering(481) 00:15:09.331 fused_ordering(482) 00:15:09.331 fused_ordering(483) 00:15:09.331 fused_ordering(484) 00:15:09.331 fused_ordering(485) 00:15:09.331 fused_ordering(486) 00:15:09.331 fused_ordering(487) 00:15:09.331 fused_ordering(488) 00:15:09.332 fused_ordering(489) 00:15:09.332 fused_ordering(490) 00:15:09.332 fused_ordering(491) 00:15:09.332 fused_ordering(492) 00:15:09.332 fused_ordering(493) 00:15:09.332 fused_ordering(494) 00:15:09.332 fused_ordering(495) 00:15:09.332 fused_ordering(496) 00:15:09.332 fused_ordering(497) 00:15:09.332 fused_ordering(498) 00:15:09.332 fused_ordering(499) 00:15:09.332 fused_ordering(500) 00:15:09.332 fused_ordering(501) 00:15:09.332 fused_ordering(502) 00:15:09.332 fused_ordering(503) 00:15:09.332 fused_ordering(504) 00:15:09.332 fused_ordering(505) 00:15:09.332 fused_ordering(506) 00:15:09.332 fused_ordering(507) 00:15:09.332 fused_ordering(508) 00:15:09.332 fused_ordering(509) 00:15:09.332 fused_ordering(510) 00:15:09.332 fused_ordering(511) 00:15:09.332 fused_ordering(512) 00:15:09.332 fused_ordering(513) 00:15:09.332 fused_ordering(514) 00:15:09.332 fused_ordering(515) 00:15:09.332 fused_ordering(516) 00:15:09.332 fused_ordering(517) 00:15:09.332 fused_ordering(518) 00:15:09.332 fused_ordering(519) 00:15:09.332 fused_ordering(520) 00:15:09.332 fused_ordering(521) 00:15:09.332 fused_ordering(522) 00:15:09.332 fused_ordering(523) 00:15:09.332 fused_ordering(524) 00:15:09.332 fused_ordering(525) 00:15:09.332 fused_ordering(526) 00:15:09.332 fused_ordering(527) 00:15:09.332 fused_ordering(528) 00:15:09.332 fused_ordering(529) 00:15:09.332 fused_ordering(530) 00:15:09.332 fused_ordering(531) 00:15:09.332 fused_ordering(532) 00:15:09.332 fused_ordering(533) 00:15:09.332 fused_ordering(534) 00:15:09.332 fused_ordering(535) 00:15:09.332 fused_ordering(536) 00:15:09.332 fused_ordering(537) 00:15:09.332 fused_ordering(538) 00:15:09.332 fused_ordering(539) 00:15:09.332 fused_ordering(540) 00:15:09.332 fused_ordering(541) 00:15:09.332 fused_ordering(542) 00:15:09.332 fused_ordering(543) 00:15:09.332 fused_ordering(544) 00:15:09.332 fused_ordering(545) 00:15:09.332 fused_ordering(546) 00:15:09.332 fused_ordering(547) 00:15:09.332 fused_ordering(548) 00:15:09.332 fused_ordering(549) 00:15:09.332 fused_ordering(550) 00:15:09.332 fused_ordering(551) 00:15:09.332 fused_ordering(552) 00:15:09.332 fused_ordering(553) 00:15:09.332 fused_ordering(554) 00:15:09.332 fused_ordering(555) 00:15:09.332 fused_ordering(556) 00:15:09.332 fused_ordering(557) 00:15:09.332 fused_ordering(558) 00:15:09.332 fused_ordering(559) 00:15:09.332 fused_ordering(560) 00:15:09.332 fused_ordering(561) 00:15:09.332 fused_ordering(562) 00:15:09.332 fused_ordering(563) 00:15:09.332 fused_ordering(564) 00:15:09.332 fused_ordering(565) 00:15:09.332 fused_ordering(566) 00:15:09.332 fused_ordering(567) 00:15:09.332 fused_ordering(568) 00:15:09.332 fused_ordering(569) 00:15:09.332 fused_ordering(570) 00:15:09.332 fused_ordering(571) 00:15:09.332 fused_ordering(572) 00:15:09.332 fused_ordering(573) 00:15:09.332 fused_ordering(574) 00:15:09.332 fused_ordering(575) 00:15:09.332 fused_ordering(576) 00:15:09.332 fused_ordering(577) 00:15:09.332 fused_ordering(578) 00:15:09.332 fused_ordering(579) 00:15:09.332 fused_ordering(580) 00:15:09.332 fused_ordering(581) 00:15:09.332 fused_ordering(582) 00:15:09.332 fused_ordering(583) 00:15:09.332 fused_ordering(584) 00:15:09.332 fused_ordering(585) 00:15:09.332 fused_ordering(586) 00:15:09.332 fused_ordering(587) 00:15:09.332 fused_ordering(588) 00:15:09.332 fused_ordering(589) 00:15:09.332 fused_ordering(590) 00:15:09.332 fused_ordering(591) 00:15:09.332 fused_ordering(592) 00:15:09.332 fused_ordering(593) 00:15:09.332 fused_ordering(594) 00:15:09.332 fused_ordering(595) 00:15:09.332 fused_ordering(596) 00:15:09.332 fused_ordering(597) 00:15:09.332 fused_ordering(598) 00:15:09.332 fused_ordering(599) 00:15:09.332 fused_ordering(600) 00:15:09.332 fused_ordering(601) 00:15:09.332 fused_ordering(602) 00:15:09.332 fused_ordering(603) 00:15:09.332 fused_ordering(604) 00:15:09.332 fused_ordering(605) 00:15:09.332 fused_ordering(606) 00:15:09.332 fused_ordering(607) 00:15:09.332 fused_ordering(608) 00:15:09.332 fused_ordering(609) 00:15:09.332 fused_ordering(610) 00:15:09.332 fused_ordering(611) 00:15:09.332 fused_ordering(612) 00:15:09.332 fused_ordering(613) 00:15:09.332 fused_ordering(614) 00:15:09.332 fused_ordering(615) 00:15:09.898 fused_ordering(616) 00:15:09.898 fused_ordering(617) 00:15:09.898 fused_ordering(618) 00:15:09.898 fused_ordering(619) 00:15:09.898 fused_ordering(620) 00:15:09.898 fused_ordering(621) 00:15:09.898 fused_ordering(622) 00:15:09.898 fused_ordering(623) 00:15:09.898 fused_ordering(624) 00:15:09.898 fused_ordering(625) 00:15:09.898 fused_ordering(626) 00:15:09.898 fused_ordering(627) 00:15:09.898 fused_ordering(628) 00:15:09.898 fused_ordering(629) 00:15:09.898 fused_ordering(630) 00:15:09.898 fused_ordering(631) 00:15:09.898 fused_ordering(632) 00:15:09.898 fused_ordering(633) 00:15:09.898 fused_ordering(634) 00:15:09.898 fused_ordering(635) 00:15:09.898 fused_ordering(636) 00:15:09.898 fused_ordering(637) 00:15:09.898 fused_ordering(638) 00:15:09.898 fused_ordering(639) 00:15:09.898 fused_ordering(640) 00:15:09.898 fused_ordering(641) 00:15:09.898 fused_ordering(642) 00:15:09.898 fused_ordering(643) 00:15:09.898 fused_ordering(644) 00:15:09.898 fused_ordering(645) 00:15:09.898 fused_ordering(646) 00:15:09.898 fused_ordering(647) 00:15:09.898 fused_ordering(648) 00:15:09.898 fused_ordering(649) 00:15:09.898 fused_ordering(650) 00:15:09.898 fused_ordering(651) 00:15:09.898 fused_ordering(652) 00:15:09.898 fused_ordering(653) 00:15:09.898 fused_ordering(654) 00:15:09.898 fused_ordering(655) 00:15:09.898 fused_ordering(656) 00:15:09.898 fused_ordering(657) 00:15:09.898 fused_ordering(658) 00:15:09.898 fused_ordering(659) 00:15:09.898 fused_ordering(660) 00:15:09.898 fused_ordering(661) 00:15:09.898 fused_ordering(662) 00:15:09.898 fused_ordering(663) 00:15:09.898 fused_ordering(664) 00:15:09.898 fused_ordering(665) 00:15:09.898 fused_ordering(666) 00:15:09.898 fused_ordering(667) 00:15:09.898 fused_ordering(668) 00:15:09.898 fused_ordering(669) 00:15:09.898 fused_ordering(670) 00:15:09.898 fused_ordering(671) 00:15:09.898 fused_ordering(672) 00:15:09.898 fused_ordering(673) 00:15:09.898 fused_ordering(674) 00:15:09.898 fused_ordering(675) 00:15:09.898 fused_ordering(676) 00:15:09.898 fused_ordering(677) 00:15:09.898 fused_ordering(678) 00:15:09.898 fused_ordering(679) 00:15:09.898 fused_ordering(680) 00:15:09.898 fused_ordering(681) 00:15:09.898 fused_ordering(682) 00:15:09.898 fused_ordering(683) 00:15:09.898 fused_ordering(684) 00:15:09.898 fused_ordering(685) 00:15:09.898 fused_ordering(686) 00:15:09.898 fused_ordering(687) 00:15:09.898 fused_ordering(688) 00:15:09.898 fused_ordering(689) 00:15:09.898 fused_ordering(690) 00:15:09.898 fused_ordering(691) 00:15:09.898 fused_ordering(692) 00:15:09.898 fused_ordering(693) 00:15:09.898 fused_ordering(694) 00:15:09.898 fused_ordering(695) 00:15:09.898 fused_ordering(696) 00:15:09.898 fused_ordering(697) 00:15:09.898 fused_ordering(698) 00:15:09.898 fused_ordering(699) 00:15:09.898 fused_ordering(700) 00:15:09.898 fused_ordering(701) 00:15:09.898 fused_ordering(702) 00:15:09.898 fused_ordering(703) 00:15:09.898 fused_ordering(704) 00:15:09.898 fused_ordering(705) 00:15:09.898 fused_ordering(706) 00:15:09.898 fused_ordering(707) 00:15:09.898 fused_ordering(708) 00:15:09.898 fused_ordering(709) 00:15:09.898 fused_ordering(710) 00:15:09.898 fused_ordering(711) 00:15:09.898 fused_ordering(712) 00:15:09.898 fused_ordering(713) 00:15:09.898 fused_ordering(714) 00:15:09.898 fused_ordering(715) 00:15:09.898 fused_ordering(716) 00:15:09.898 fused_ordering(717) 00:15:09.898 fused_ordering(718) 00:15:09.898 fused_ordering(719) 00:15:09.898 fused_ordering(720) 00:15:09.898 fused_ordering(721) 00:15:09.898 fused_ordering(722) 00:15:09.898 fused_ordering(723) 00:15:09.898 fused_ordering(724) 00:15:09.898 fused_ordering(725) 00:15:09.898 fused_ordering(726) 00:15:09.898 fused_ordering(727) 00:15:09.899 fused_ordering(728) 00:15:09.899 fused_ordering(729) 00:15:09.899 fused_ordering(730) 00:15:09.899 fused_ordering(731) 00:15:09.899 fused_ordering(732) 00:15:09.899 fused_ordering(733) 00:15:09.899 fused_ordering(734) 00:15:09.899 fused_ordering(735) 00:15:09.899 fused_ordering(736) 00:15:09.899 fused_ordering(737) 00:15:09.899 fused_ordering(738) 00:15:09.899 fused_ordering(739) 00:15:09.899 fused_ordering(740) 00:15:09.899 fused_ordering(741) 00:15:09.899 fused_ordering(742) 00:15:09.899 fused_ordering(743) 00:15:09.899 fused_ordering(744) 00:15:09.899 fused_ordering(745) 00:15:09.899 fused_ordering(746) 00:15:09.899 fused_ordering(747) 00:15:09.899 fused_ordering(748) 00:15:09.899 fused_ordering(749) 00:15:09.899 fused_ordering(750) 00:15:09.899 fused_ordering(751) 00:15:09.899 fused_ordering(752) 00:15:09.899 fused_ordering(753) 00:15:09.899 fused_ordering(754) 00:15:09.899 fused_ordering(755) 00:15:09.899 fused_ordering(756) 00:15:09.899 fused_ordering(757) 00:15:09.899 fused_ordering(758) 00:15:09.899 fused_ordering(759) 00:15:09.899 fused_ordering(760) 00:15:09.899 fused_ordering(761) 00:15:09.899 fused_ordering(762) 00:15:09.899 fused_ordering(763) 00:15:09.899 fused_ordering(764) 00:15:09.899 fused_ordering(765) 00:15:09.899 fused_ordering(766) 00:15:09.899 fused_ordering(767) 00:15:09.899 fused_ordering(768) 00:15:09.899 fused_ordering(769) 00:15:09.899 fused_ordering(770) 00:15:09.899 fused_ordering(771) 00:15:09.899 fused_ordering(772) 00:15:09.899 fused_ordering(773) 00:15:09.899 fused_ordering(774) 00:15:09.899 fused_ordering(775) 00:15:09.899 fused_ordering(776) 00:15:09.899 fused_ordering(777) 00:15:09.899 fused_ordering(778) 00:15:09.899 fused_ordering(779) 00:15:09.899 fused_ordering(780) 00:15:09.899 fused_ordering(781) 00:15:09.899 fused_ordering(782) 00:15:09.899 fused_ordering(783) 00:15:09.899 fused_ordering(784) 00:15:09.899 fused_ordering(785) 00:15:09.899 fused_ordering(786) 00:15:09.899 fused_ordering(787) 00:15:09.899 fused_ordering(788) 00:15:09.899 fused_ordering(789) 00:15:09.899 fused_ordering(790) 00:15:09.899 fused_ordering(791) 00:15:09.899 fused_ordering(792) 00:15:09.899 fused_ordering(793) 00:15:09.899 fused_ordering(794) 00:15:09.899 fused_ordering(795) 00:15:09.899 fused_ordering(796) 00:15:09.899 fused_ordering(797) 00:15:09.899 fused_ordering(798) 00:15:09.899 fused_ordering(799) 00:15:09.899 fused_ordering(800) 00:15:09.899 fused_ordering(801) 00:15:09.899 fused_ordering(802) 00:15:09.899 fused_ordering(803) 00:15:09.899 fused_ordering(804) 00:15:09.899 fused_ordering(805) 00:15:09.899 fused_ordering(806) 00:15:09.899 fused_ordering(807) 00:15:09.899 fused_ordering(808) 00:15:09.899 fused_ordering(809) 00:15:09.899 fused_ordering(810) 00:15:09.899 fused_ordering(811) 00:15:09.899 fused_ordering(812) 00:15:09.899 fused_ordering(813) 00:15:09.899 fused_ordering(814) 00:15:09.899 fused_ordering(815) 00:15:09.899 fused_ordering(816) 00:15:09.899 fused_ordering(817) 00:15:09.899 fused_ordering(818) 00:15:09.899 fused_ordering(819) 00:15:09.899 fused_ordering(820) 00:15:10.833 fused_ordering(821) 00:15:10.833 fused_ordering(822) 00:15:10.833 fused_ordering(823) 00:15:10.833 fused_ordering(824) 00:15:10.833 fused_ordering(825) 00:15:10.833 fused_ordering(826) 00:15:10.833 fused_ordering(827) 00:15:10.833 fused_ordering(828) 00:15:10.833 fused_ordering(829) 00:15:10.833 fused_ordering(830) 00:15:10.833 fused_ordering(831) 00:15:10.833 fused_ordering(832) 00:15:10.833 fused_ordering(833) 00:15:10.833 fused_ordering(834) 00:15:10.833 fused_ordering(835) 00:15:10.833 fused_ordering(836) 00:15:10.833 fused_ordering(837) 00:15:10.833 fused_ordering(838) 00:15:10.833 fused_ordering(839) 00:15:10.833 fused_ordering(840) 00:15:10.833 fused_ordering(841) 00:15:10.833 fused_ordering(842) 00:15:10.833 fused_ordering(843) 00:15:10.833 fused_ordering(844) 00:15:10.833 fused_ordering(845) 00:15:10.833 fused_ordering(846) 00:15:10.833 fused_ordering(847) 00:15:10.833 fused_ordering(848) 00:15:10.834 fused_ordering(849) 00:15:10.834 fused_ordering(850) 00:15:10.834 fused_ordering(851) 00:15:10.834 fused_ordering(852) 00:15:10.834 fused_ordering(853) 00:15:10.834 fused_ordering(854) 00:15:10.834 fused_ordering(855) 00:15:10.834 fused_ordering(856) 00:15:10.834 fused_ordering(857) 00:15:10.834 fused_ordering(858) 00:15:10.834 fused_ordering(859) 00:15:10.834 fused_ordering(860) 00:15:10.834 fused_ordering(861) 00:15:10.834 fused_ordering(862) 00:15:10.834 fused_ordering(863) 00:15:10.834 fused_ordering(864) 00:15:10.834 fused_ordering(865) 00:15:10.834 fused_ordering(866) 00:15:10.834 fused_ordering(867) 00:15:10.834 fused_ordering(868) 00:15:10.834 fused_ordering(869) 00:15:10.834 fused_ordering(870) 00:15:10.834 fused_ordering(871) 00:15:10.834 fused_ordering(872) 00:15:10.834 fused_ordering(873) 00:15:10.834 fused_ordering(874) 00:15:10.834 fused_ordering(875) 00:15:10.834 fused_ordering(876) 00:15:10.834 fused_ordering(877) 00:15:10.834 fused_ordering(878) 00:15:10.834 fused_ordering(879) 00:15:10.834 fused_ordering(880) 00:15:10.834 fused_ordering(881) 00:15:10.834 fused_ordering(882) 00:15:10.834 fused_ordering(883) 00:15:10.834 fused_ordering(884) 00:15:10.834 fused_ordering(885) 00:15:10.834 fused_ordering(886) 00:15:10.834 fused_ordering(887) 00:15:10.834 fused_ordering(888) 00:15:10.834 fused_ordering(889) 00:15:10.834 fused_ordering(890) 00:15:10.834 fused_ordering(891) 00:15:10.834 fused_ordering(892) 00:15:10.834 fused_ordering(893) 00:15:10.834 fused_ordering(894) 00:15:10.834 fused_ordering(895) 00:15:10.834 fused_ordering(896) 00:15:10.834 fused_ordering(897) 00:15:10.834 fused_ordering(898) 00:15:10.834 fused_ordering(899) 00:15:10.834 fused_ordering(900) 00:15:10.834 fused_ordering(901) 00:15:10.834 fused_ordering(902) 00:15:10.834 fused_ordering(903) 00:15:10.834 fused_ordering(904) 00:15:10.834 fused_ordering(905) 00:15:10.834 fused_ordering(906) 00:15:10.834 fused_ordering(907) 00:15:10.834 fused_ordering(908) 00:15:10.834 fused_ordering(909) 00:15:10.834 fused_ordering(910) 00:15:10.834 fused_ordering(911) 00:15:10.834 fused_ordering(912) 00:15:10.834 fused_ordering(913) 00:15:10.834 fused_ordering(914) 00:15:10.834 fused_ordering(915) 00:15:10.834 fused_ordering(916) 00:15:10.834 fused_ordering(917) 00:15:10.834 fused_ordering(918) 00:15:10.834 fused_ordering(919) 00:15:10.834 fused_ordering(920) 00:15:10.834 fused_ordering(921) 00:15:10.834 fused_ordering(922) 00:15:10.834 fused_ordering(923) 00:15:10.834 fused_ordering(924) 00:15:10.834 fused_ordering(925) 00:15:10.834 fused_ordering(926) 00:15:10.834 fused_ordering(927) 00:15:10.834 fused_ordering(928) 00:15:10.834 fused_ordering(929) 00:15:10.834 fused_ordering(930) 00:15:10.834 fused_ordering(931) 00:15:10.834 fused_ordering(932) 00:15:10.834 fused_ordering(933) 00:15:10.834 fused_ordering(934) 00:15:10.834 fused_ordering(935) 00:15:10.834 fused_ordering(936) 00:15:10.834 fused_ordering(937) 00:15:10.834 fused_ordering(938) 00:15:10.834 fused_ordering(939) 00:15:10.834 fused_ordering(940) 00:15:10.834 fused_ordering(941) 00:15:10.834 fused_ordering(942) 00:15:10.834 fused_ordering(943) 00:15:10.834 fused_ordering(944) 00:15:10.834 fused_ordering(945) 00:15:10.834 fused_ordering(946) 00:15:10.834 fused_ordering(947) 00:15:10.834 fused_ordering(948) 00:15:10.834 fused_ordering(949) 00:15:10.834 fused_ordering(950) 00:15:10.834 fused_ordering(951) 00:15:10.834 fused_ordering(952) 00:15:10.834 fused_ordering(953) 00:15:10.834 fused_ordering(954) 00:15:10.834 fused_ordering(955) 00:15:10.834 fused_ordering(956) 00:15:10.834 fused_ordering(957) 00:15:10.834 fused_ordering(958) 00:15:10.834 fused_ordering(959) 00:15:10.834 fused_ordering(960) 00:15:10.834 fused_ordering(961) 00:15:10.834 fused_ordering(962) 00:15:10.834 fused_ordering(963) 00:15:10.834 fused_ordering(964) 00:15:10.834 fused_ordering(965) 00:15:10.834 fused_ordering(966) 00:15:10.834 fused_ordering(967) 00:15:10.834 fused_ordering(968) 00:15:10.834 fused_ordering(969) 00:15:10.834 fused_ordering(970) 00:15:10.834 fused_ordering(971) 00:15:10.834 fused_ordering(972) 00:15:10.834 fused_ordering(973) 00:15:10.834 fused_ordering(974) 00:15:10.834 fused_ordering(975) 00:15:10.834 fused_ordering(976) 00:15:10.834 fused_ordering(977) 00:15:10.834 fused_ordering(978) 00:15:10.834 fused_ordering(979) 00:15:10.834 fused_ordering(980) 00:15:10.834 fused_ordering(981) 00:15:10.834 fused_ordering(982) 00:15:10.834 fused_ordering(983) 00:15:10.834 fused_ordering(984) 00:15:10.834 fused_ordering(985) 00:15:10.834 fused_ordering(986) 00:15:10.834 fused_ordering(987) 00:15:10.834 fused_ordering(988) 00:15:10.834 fused_ordering(989) 00:15:10.834 fused_ordering(990) 00:15:10.834 fused_ordering(991) 00:15:10.834 fused_ordering(992) 00:15:10.834 fused_ordering(993) 00:15:10.834 fused_ordering(994) 00:15:10.834 fused_ordering(995) 00:15:10.834 fused_ordering(996) 00:15:10.834 fused_ordering(997) 00:15:10.834 fused_ordering(998) 00:15:10.834 fused_ordering(999) 00:15:10.834 fused_ordering(1000) 00:15:10.834 fused_ordering(1001) 00:15:10.834 fused_ordering(1002) 00:15:10.834 fused_ordering(1003) 00:15:10.834 fused_ordering(1004) 00:15:10.834 fused_ordering(1005) 00:15:10.834 fused_ordering(1006) 00:15:10.834 fused_ordering(1007) 00:15:10.834 fused_ordering(1008) 00:15:10.834 fused_ordering(1009) 00:15:10.834 fused_ordering(1010) 00:15:10.834 fused_ordering(1011) 00:15:10.834 fused_ordering(1012) 00:15:10.834 fused_ordering(1013) 00:15:10.834 fused_ordering(1014) 00:15:10.834 fused_ordering(1015) 00:15:10.834 fused_ordering(1016) 00:15:10.834 fused_ordering(1017) 00:15:10.834 fused_ordering(1018) 00:15:10.834 fused_ordering(1019) 00:15:10.834 fused_ordering(1020) 00:15:10.834 fused_ordering(1021) 00:15:10.834 fused_ordering(1022) 00:15:10.834 fused_ordering(1023) 00:15:10.834 16:01:34 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:10.834 16:01:34 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:10.834 16:01:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:10.834 16:01:34 -- nvmf/common.sh@116 -- # sync 00:15:10.834 16:01:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:10.834 16:01:34 -- nvmf/common.sh@119 -- # set +e 00:15:10.834 16:01:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:10.834 16:01:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:10.834 rmmod nvme_tcp 00:15:10.834 rmmod nvme_fabrics 00:15:10.834 rmmod nvme_keyring 00:15:10.834 16:01:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:10.834 16:01:34 -- nvmf/common.sh@123 -- # set -e 00:15:10.834 16:01:34 -- nvmf/common.sh@124 -- # return 0 00:15:10.834 16:01:34 -- nvmf/common.sh@477 -- # '[' -n 1550742 ']' 00:15:10.834 16:01:34 -- nvmf/common.sh@478 -- # killprocess 1550742 00:15:10.834 16:01:34 -- common/autotest_common.sh@936 -- # '[' -z 1550742 ']' 00:15:10.834 16:01:34 -- common/autotest_common.sh@940 -- # kill -0 1550742 00:15:10.834 16:01:34 -- common/autotest_common.sh@941 -- # uname 00:15:10.834 16:01:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:10.834 16:01:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1550742 00:15:10.834 16:01:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:10.834 16:01:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:10.834 16:01:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1550742' 00:15:10.834 killing process with pid 1550742 00:15:10.834 16:01:34 -- common/autotest_common.sh@955 -- # kill 1550742 00:15:10.834 16:01:34 -- common/autotest_common.sh@960 -- # wait 1550742 00:15:11.093 16:01:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:11.093 16:01:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:11.093 16:01:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:11.093 16:01:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:11.093 16:01:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:11.093 16:01:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:11.093 16:01:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:11.093 16:01:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:13.011 16:01:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:13.011 00:15:13.011 real 0m8.284s 00:15:13.011 user 0m5.886s 00:15:13.011 sys 0m3.368s 00:15:13.011 16:01:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:13.011 16:01:36 -- common/autotest_common.sh@10 -- # set +x 00:15:13.011 ************************************ 00:15:13.011 END TEST nvmf_fused_ordering 00:15:13.011 ************************************ 00:15:13.011 16:01:36 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:13.011 16:01:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:13.011 16:01:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:13.011 16:01:36 -- common/autotest_common.sh@10 -- # set +x 00:15:13.011 ************************************ 00:15:13.011 START TEST nvmf_delete_subsystem 00:15:13.011 ************************************ 00:15:13.011 16:01:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:13.011 * Looking for test storage... 00:15:13.011 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:13.011 16:01:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:13.011 16:01:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:13.011 16:01:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:13.270 16:01:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:13.270 16:01:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:13.270 16:01:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:13.270 16:01:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:13.270 16:01:36 -- scripts/common.sh@335 -- # IFS=.-: 00:15:13.270 16:01:36 -- scripts/common.sh@335 -- # read -ra ver1 00:15:13.270 16:01:36 -- scripts/common.sh@336 -- # IFS=.-: 00:15:13.270 16:01:36 -- scripts/common.sh@336 -- # read -ra ver2 00:15:13.270 16:01:36 -- scripts/common.sh@337 -- # local 'op=<' 00:15:13.270 16:01:36 -- scripts/common.sh@339 -- # ver1_l=2 00:15:13.270 16:01:36 -- scripts/common.sh@340 -- # ver2_l=1 00:15:13.270 16:01:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:13.270 16:01:36 -- scripts/common.sh@343 -- # case "$op" in 00:15:13.270 16:01:36 -- scripts/common.sh@344 -- # : 1 00:15:13.270 16:01:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:13.270 16:01:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:13.270 16:01:36 -- scripts/common.sh@364 -- # decimal 1 00:15:13.270 16:01:36 -- scripts/common.sh@352 -- # local d=1 00:15:13.270 16:01:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:13.270 16:01:36 -- scripts/common.sh@354 -- # echo 1 00:15:13.270 16:01:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:13.270 16:01:36 -- scripts/common.sh@365 -- # decimal 2 00:15:13.270 16:01:36 -- scripts/common.sh@352 -- # local d=2 00:15:13.270 16:01:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:13.270 16:01:36 -- scripts/common.sh@354 -- # echo 2 00:15:13.270 16:01:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:13.270 16:01:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:13.270 16:01:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:13.270 16:01:36 -- scripts/common.sh@367 -- # return 0 00:15:13.270 16:01:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:13.270 16:01:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:13.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:13.270 --rc genhtml_branch_coverage=1 00:15:13.270 --rc genhtml_function_coverage=1 00:15:13.270 --rc genhtml_legend=1 00:15:13.270 --rc geninfo_all_blocks=1 00:15:13.270 --rc geninfo_unexecuted_blocks=1 00:15:13.270 00:15:13.270 ' 00:15:13.270 16:01:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:13.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:13.270 --rc genhtml_branch_coverage=1 00:15:13.270 --rc genhtml_function_coverage=1 00:15:13.270 --rc genhtml_legend=1 00:15:13.270 --rc geninfo_all_blocks=1 00:15:13.270 --rc geninfo_unexecuted_blocks=1 00:15:13.270 00:15:13.270 ' 00:15:13.270 16:01:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:13.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:13.270 --rc genhtml_branch_coverage=1 00:15:13.270 --rc genhtml_function_coverage=1 00:15:13.270 --rc genhtml_legend=1 00:15:13.270 --rc geninfo_all_blocks=1 00:15:13.270 --rc geninfo_unexecuted_blocks=1 00:15:13.270 00:15:13.270 ' 00:15:13.270 16:01:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:13.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:13.270 --rc genhtml_branch_coverage=1 00:15:13.270 --rc genhtml_function_coverage=1 00:15:13.270 --rc genhtml_legend=1 00:15:13.270 --rc geninfo_all_blocks=1 00:15:13.270 --rc geninfo_unexecuted_blocks=1 00:15:13.270 00:15:13.270 ' 00:15:13.270 16:01:36 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:13.270 16:01:36 -- nvmf/common.sh@7 -- # uname -s 00:15:13.270 16:01:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:13.270 16:01:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:13.270 16:01:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:13.270 16:01:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:13.270 16:01:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:13.270 16:01:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:13.270 16:01:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:13.270 16:01:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:13.270 16:01:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:13.270 16:01:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:13.270 16:01:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:13.270 16:01:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:13.270 16:01:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:13.270 16:01:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:13.270 16:01:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:13.270 16:01:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:13.270 16:01:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:13.270 16:01:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:13.270 16:01:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:13.270 16:01:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:13.270 16:01:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:13.271 16:01:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:13.271 16:01:36 -- paths/export.sh@5 -- # export PATH 00:15:13.271 16:01:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:13.271 16:01:36 -- nvmf/common.sh@46 -- # : 0 00:15:13.271 16:01:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:13.271 16:01:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:13.271 16:01:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:13.271 16:01:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:13.271 16:01:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:13.271 16:01:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:13.271 16:01:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:13.271 16:01:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:13.271 16:01:36 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:13.271 16:01:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:13.271 16:01:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:13.271 16:01:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:13.271 16:01:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:13.271 16:01:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:13.271 16:01:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:13.271 16:01:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:13.271 16:01:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:13.271 16:01:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:13.271 16:01:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:13.271 16:01:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:13.271 16:01:36 -- common/autotest_common.sh@10 -- # set +x 00:15:15.171 16:01:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:15.171 16:01:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:15.171 16:01:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:15.171 16:01:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:15.171 16:01:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:15.171 16:01:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:15.171 16:01:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:15.171 16:01:38 -- nvmf/common.sh@294 -- # net_devs=() 00:15:15.171 16:01:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:15.171 16:01:38 -- nvmf/common.sh@295 -- # e810=() 00:15:15.171 16:01:38 -- nvmf/common.sh@295 -- # local -ga e810 00:15:15.171 16:01:38 -- nvmf/common.sh@296 -- # x722=() 00:15:15.171 16:01:38 -- nvmf/common.sh@296 -- # local -ga x722 00:15:15.171 16:01:38 -- nvmf/common.sh@297 -- # mlx=() 00:15:15.171 16:01:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:15.171 16:01:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:15.171 16:01:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:15.171 16:01:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:15.171 16:01:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:15.171 16:01:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:15.171 16:01:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:15.171 16:01:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:15.171 16:01:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:15.171 16:01:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:15.171 16:01:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:15.171 16:01:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:15.172 16:01:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:15.172 16:01:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:15.172 16:01:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:15.172 16:01:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:15.172 16:01:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:15.172 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:15.172 16:01:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:15.172 16:01:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:15.172 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:15.172 16:01:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:15.172 16:01:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:15.172 16:01:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:15.172 16:01:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:15.172 16:01:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:15.172 16:01:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:15.172 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:15.172 16:01:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:15.172 16:01:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:15.172 16:01:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:15.172 16:01:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:15.172 16:01:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:15.172 16:01:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:15.172 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:15.172 16:01:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:15.172 16:01:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:15.172 16:01:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:15.172 16:01:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:15.172 16:01:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:15.172 16:01:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:15.172 16:01:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:15.172 16:01:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:15.172 16:01:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:15.172 16:01:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:15.172 16:01:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:15.172 16:01:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:15.172 16:01:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:15.172 16:01:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:15.172 16:01:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:15.172 16:01:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:15.172 16:01:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:15.172 16:01:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:15.172 16:01:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:15.172 16:01:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:15.172 16:01:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:15.172 16:01:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:15.172 16:01:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:15.172 16:01:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:15.172 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:15.172 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.299 ms 00:15:15.172 00:15:15.172 --- 10.0.0.2 ping statistics --- 00:15:15.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:15.172 rtt min/avg/max/mdev = 0.299/0.299/0.299/0.000 ms 00:15:15.172 16:01:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:15.172 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:15.172 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:15:15.172 00:15:15.172 --- 10.0.0.1 ping statistics --- 00:15:15.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:15.172 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:15:15.172 16:01:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:15.172 16:01:38 -- nvmf/common.sh@410 -- # return 0 00:15:15.172 16:01:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:15.172 16:01:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:15.172 16:01:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:15.172 16:01:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:15.172 16:01:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:15.172 16:01:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:15.172 16:01:38 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:15.172 16:01:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:15.172 16:01:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:15.172 16:01:38 -- common/autotest_common.sh@10 -- # set +x 00:15:15.172 16:01:38 -- nvmf/common.sh@469 -- # nvmfpid=1553131 00:15:15.172 16:01:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:15.172 16:01:38 -- nvmf/common.sh@470 -- # waitforlisten 1553131 00:15:15.172 16:01:38 -- common/autotest_common.sh@829 -- # '[' -z 1553131 ']' 00:15:15.172 16:01:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:15.172 16:01:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:15.172 16:01:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:15.172 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:15.172 16:01:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:15.172 16:01:38 -- common/autotest_common.sh@10 -- # set +x 00:15:15.172 [2024-11-18 16:01:38.728032] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:15.172 [2024-11-18 16:01:38.728102] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:15.172 EAL: No free 2048 kB hugepages reported on node 1 00:15:15.431 [2024-11-18 16:01:38.795059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:15.431 [2024-11-18 16:01:38.890487] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:15.431 [2024-11-18 16:01:38.890677] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:15.431 [2024-11-18 16:01:38.890696] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:15.431 [2024-11-18 16:01:38.890724] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:15.431 [2024-11-18 16:01:38.894631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:15.431 [2024-11-18 16:01:38.894644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:16.364 16:01:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:16.364 16:01:39 -- common/autotest_common.sh@862 -- # return 0 00:15:16.364 16:01:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:16.364 16:01:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:16.364 16:01:39 -- common/autotest_common.sh@10 -- # set +x 00:15:16.364 16:01:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:16.364 16:01:39 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:16.364 16:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.364 16:01:39 -- common/autotest_common.sh@10 -- # set +x 00:15:16.364 [2024-11-18 16:01:39.769316] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:16.364 16:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.364 16:01:39 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:16.364 16:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.364 16:01:39 -- common/autotest_common.sh@10 -- # set +x 00:15:16.364 16:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.364 16:01:39 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:16.364 16:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.364 16:01:39 -- common/autotest_common.sh@10 -- # set +x 00:15:16.364 [2024-11-18 16:01:39.785529] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:16.364 16:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.364 16:01:39 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:16.364 16:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.364 16:01:39 -- common/autotest_common.sh@10 -- # set +x 00:15:16.364 NULL1 00:15:16.364 16:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.364 16:01:39 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:16.364 16:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.364 16:01:39 -- common/autotest_common.sh@10 -- # set +x 00:15:16.364 Delay0 00:15:16.364 16:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.364 16:01:39 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:16.364 16:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.364 16:01:39 -- common/autotest_common.sh@10 -- # set +x 00:15:16.364 16:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.364 16:01:39 -- target/delete_subsystem.sh@28 -- # perf_pid=1553291 00:15:16.364 16:01:39 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:16.364 16:01:39 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:16.364 EAL: No free 2048 kB hugepages reported on node 1 00:15:16.364 [2024-11-18 16:01:39.860164] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:18.262 16:01:41 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:18.262 16:01:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.262 16:01:41 -- common/autotest_common.sh@10 -- # set +x 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 starting I/O failed: -6 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 starting I/O failed: -6 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 starting I/O failed: -6 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 starting I/O failed: -6 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 starting I/O failed: -6 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 starting I/O failed: -6 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 starting I/O failed: -6 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 starting I/O failed: -6 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 starting I/O failed: -6 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 [2024-11-18 16:01:41.941438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7efc10000c00 is same with the state(5) to be set 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 starting I/O failed: -6 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Write completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 starting I/O failed: -6 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.520 Read completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 Write completed with error (sct=0, sc=8) 00:15:18.521 Read completed with error (sct=0, sc=8) 00:15:18.521 starting I/O failed: -6 00:15:18.521 starting I/O failed: -6 00:15:18.521 starting I/O failed: -6 00:15:19.454 [2024-11-18 16:01:42.915625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1adfa40 is same with the state(5) to be set 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 [2024-11-18 16:01:42.939203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7efc1000c1d0 is same with the state(5) to be set 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 [2024-11-18 16:01:42.944803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ade690 is same with the state(5) to be set 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 [2024-11-18 16:01:42.945047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ade810 is same with the state(5) to be set 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 Write completed with error (sct=0, sc=8) 00:15:19.454 Read completed with error (sct=0, sc=8) 00:15:19.454 [2024-11-18 16:01:42.945266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1adfe10 is same with the state(5) to be set 00:15:19.454 [2024-11-18 16:01:42.946225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1adfa40 (9): Bad file descriptor 00:15:19.454 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:19.454 16:01:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:19.454 16:01:42 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:19.454 16:01:42 -- target/delete_subsystem.sh@35 -- # kill -0 1553291 00:15:19.454 16:01:42 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:19.454 Initializing NVMe Controllers 00:15:19.454 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:19.454 Controller IO queue size 128, less than required. 00:15:19.454 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:19.454 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:19.454 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:19.454 Initialization complete. Launching workers. 00:15:19.454 ======================================================== 00:15:19.454 Latency(us) 00:15:19.454 Device Information : IOPS MiB/s Average min max 00:15:19.454 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 190.51 0.09 953084.74 760.52 1012423.21 00:15:19.454 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 145.86 0.07 917848.28 367.70 1011793.88 00:15:19.454 ======================================================== 00:15:19.454 Total : 336.38 0.16 937805.21 367.70 1012423.21 00:15:19.454 00:15:20.020 16:01:43 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:20.020 16:01:43 -- target/delete_subsystem.sh@35 -- # kill -0 1553291 00:15:20.020 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1553291) - No such process 00:15:20.020 16:01:43 -- target/delete_subsystem.sh@45 -- # NOT wait 1553291 00:15:20.020 16:01:43 -- common/autotest_common.sh@650 -- # local es=0 00:15:20.020 16:01:43 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 1553291 00:15:20.020 16:01:43 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:20.020 16:01:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:20.020 16:01:43 -- common/autotest_common.sh@642 -- # type -t wait 00:15:20.020 16:01:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:20.020 16:01:43 -- common/autotest_common.sh@653 -- # wait 1553291 00:15:20.020 16:01:43 -- common/autotest_common.sh@653 -- # es=1 00:15:20.020 16:01:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:20.020 16:01:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:20.020 16:01:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:20.020 16:01:43 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:20.020 16:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.020 16:01:43 -- common/autotest_common.sh@10 -- # set +x 00:15:20.020 16:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.020 16:01:43 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:20.020 16:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.020 16:01:43 -- common/autotest_common.sh@10 -- # set +x 00:15:20.020 [2024-11-18 16:01:43.470131] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:20.020 16:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.020 16:01:43 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:20.020 16:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.020 16:01:43 -- common/autotest_common.sh@10 -- # set +x 00:15:20.020 16:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.020 16:01:43 -- target/delete_subsystem.sh@54 -- # perf_pid=1553702 00:15:20.020 16:01:43 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:20.020 16:01:43 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:20.020 16:01:43 -- target/delete_subsystem.sh@57 -- # kill -0 1553702 00:15:20.020 16:01:43 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:20.020 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.020 [2024-11-18 16:01:43.532239] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:20.585 16:01:43 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:20.585 16:01:43 -- target/delete_subsystem.sh@57 -- # kill -0 1553702 00:15:20.585 16:01:43 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:21.150 16:01:44 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:21.150 16:01:44 -- target/delete_subsystem.sh@57 -- # kill -0 1553702 00:15:21.150 16:01:44 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:21.408 16:01:44 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:21.408 16:01:44 -- target/delete_subsystem.sh@57 -- # kill -0 1553702 00:15:21.408 16:01:44 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:21.972 16:01:45 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:21.972 16:01:45 -- target/delete_subsystem.sh@57 -- # kill -0 1553702 00:15:21.972 16:01:45 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:22.537 16:01:45 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:22.537 16:01:45 -- target/delete_subsystem.sh@57 -- # kill -0 1553702 00:15:22.537 16:01:45 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:23.102 16:01:46 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:23.102 16:01:46 -- target/delete_subsystem.sh@57 -- # kill -0 1553702 00:15:23.102 16:01:46 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:23.359 Initializing NVMe Controllers 00:15:23.359 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:23.359 Controller IO queue size 128, less than required. 00:15:23.359 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:23.359 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:23.359 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:23.359 Initialization complete. Launching workers. 00:15:23.359 ======================================================== 00:15:23.359 Latency(us) 00:15:23.359 Device Information : IOPS MiB/s Average min max 00:15:23.359 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003330.16 1000137.83 1011192.79 00:15:23.359 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005940.81 1000220.23 1042742.47 00:15:23.359 ======================================================== 00:15:23.359 Total : 256.00 0.12 1004635.49 1000137.83 1042742.47 00:15:23.359 00:15:23.617 16:01:47 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:23.617 16:01:47 -- target/delete_subsystem.sh@57 -- # kill -0 1553702 00:15:23.617 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1553702) - No such process 00:15:23.617 16:01:47 -- target/delete_subsystem.sh@67 -- # wait 1553702 00:15:23.617 16:01:47 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:23.617 16:01:47 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:23.617 16:01:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:23.617 16:01:47 -- nvmf/common.sh@116 -- # sync 00:15:23.617 16:01:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:23.617 16:01:47 -- nvmf/common.sh@119 -- # set +e 00:15:23.617 16:01:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:23.617 16:01:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:23.617 rmmod nvme_tcp 00:15:23.617 rmmod nvme_fabrics 00:15:23.617 rmmod nvme_keyring 00:15:23.617 16:01:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:23.617 16:01:47 -- nvmf/common.sh@123 -- # set -e 00:15:23.617 16:01:47 -- nvmf/common.sh@124 -- # return 0 00:15:23.617 16:01:47 -- nvmf/common.sh@477 -- # '[' -n 1553131 ']' 00:15:23.617 16:01:47 -- nvmf/common.sh@478 -- # killprocess 1553131 00:15:23.617 16:01:47 -- common/autotest_common.sh@936 -- # '[' -z 1553131 ']' 00:15:23.617 16:01:47 -- common/autotest_common.sh@940 -- # kill -0 1553131 00:15:23.617 16:01:47 -- common/autotest_common.sh@941 -- # uname 00:15:23.617 16:01:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:23.617 16:01:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1553131 00:15:23.617 16:01:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:23.617 16:01:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:23.617 16:01:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1553131' 00:15:23.617 killing process with pid 1553131 00:15:23.617 16:01:47 -- common/autotest_common.sh@955 -- # kill 1553131 00:15:23.617 16:01:47 -- common/autotest_common.sh@960 -- # wait 1553131 00:15:23.875 16:01:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:23.875 16:01:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:23.875 16:01:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:23.875 16:01:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:23.875 16:01:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:23.875 16:01:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:23.875 16:01:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:23.875 16:01:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:26.403 16:01:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:26.403 00:15:26.403 real 0m12.878s 00:15:26.403 user 0m29.461s 00:15:26.403 sys 0m2.753s 00:15:26.403 16:01:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:26.403 16:01:49 -- common/autotest_common.sh@10 -- # set +x 00:15:26.403 ************************************ 00:15:26.403 END TEST nvmf_delete_subsystem 00:15:26.403 ************************************ 00:15:26.403 16:01:49 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:26.403 16:01:49 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:26.403 16:01:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:26.403 16:01:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:26.403 16:01:49 -- common/autotest_common.sh@10 -- # set +x 00:15:26.403 ************************************ 00:15:26.403 START TEST nvmf_nvme_cli 00:15:26.403 ************************************ 00:15:26.403 16:01:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:26.403 * Looking for test storage... 00:15:26.403 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:26.403 16:01:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:26.403 16:01:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:26.403 16:01:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:26.403 16:01:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:26.403 16:01:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:26.403 16:01:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:26.403 16:01:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:26.403 16:01:49 -- scripts/common.sh@335 -- # IFS=.-: 00:15:26.403 16:01:49 -- scripts/common.sh@335 -- # read -ra ver1 00:15:26.403 16:01:49 -- scripts/common.sh@336 -- # IFS=.-: 00:15:26.403 16:01:49 -- scripts/common.sh@336 -- # read -ra ver2 00:15:26.403 16:01:49 -- scripts/common.sh@337 -- # local 'op=<' 00:15:26.403 16:01:49 -- scripts/common.sh@339 -- # ver1_l=2 00:15:26.403 16:01:49 -- scripts/common.sh@340 -- # ver2_l=1 00:15:26.403 16:01:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:26.403 16:01:49 -- scripts/common.sh@343 -- # case "$op" in 00:15:26.403 16:01:49 -- scripts/common.sh@344 -- # : 1 00:15:26.403 16:01:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:26.403 16:01:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:26.403 16:01:49 -- scripts/common.sh@364 -- # decimal 1 00:15:26.403 16:01:49 -- scripts/common.sh@352 -- # local d=1 00:15:26.403 16:01:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:26.403 16:01:49 -- scripts/common.sh@354 -- # echo 1 00:15:26.403 16:01:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:26.403 16:01:49 -- scripts/common.sh@365 -- # decimal 2 00:15:26.403 16:01:49 -- scripts/common.sh@352 -- # local d=2 00:15:26.403 16:01:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:26.403 16:01:49 -- scripts/common.sh@354 -- # echo 2 00:15:26.403 16:01:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:26.403 16:01:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:26.403 16:01:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:26.403 16:01:49 -- scripts/common.sh@367 -- # return 0 00:15:26.403 16:01:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:26.403 16:01:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:26.403 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:26.403 --rc genhtml_branch_coverage=1 00:15:26.403 --rc genhtml_function_coverage=1 00:15:26.403 --rc genhtml_legend=1 00:15:26.403 --rc geninfo_all_blocks=1 00:15:26.403 --rc geninfo_unexecuted_blocks=1 00:15:26.403 00:15:26.403 ' 00:15:26.403 16:01:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:26.403 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:26.403 --rc genhtml_branch_coverage=1 00:15:26.403 --rc genhtml_function_coverage=1 00:15:26.403 --rc genhtml_legend=1 00:15:26.403 --rc geninfo_all_blocks=1 00:15:26.403 --rc geninfo_unexecuted_blocks=1 00:15:26.403 00:15:26.403 ' 00:15:26.403 16:01:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:26.403 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:26.403 --rc genhtml_branch_coverage=1 00:15:26.403 --rc genhtml_function_coverage=1 00:15:26.403 --rc genhtml_legend=1 00:15:26.403 --rc geninfo_all_blocks=1 00:15:26.403 --rc geninfo_unexecuted_blocks=1 00:15:26.403 00:15:26.403 ' 00:15:26.403 16:01:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:26.403 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:26.403 --rc genhtml_branch_coverage=1 00:15:26.403 --rc genhtml_function_coverage=1 00:15:26.403 --rc genhtml_legend=1 00:15:26.403 --rc geninfo_all_blocks=1 00:15:26.403 --rc geninfo_unexecuted_blocks=1 00:15:26.403 00:15:26.403 ' 00:15:26.403 16:01:49 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:26.403 16:01:49 -- nvmf/common.sh@7 -- # uname -s 00:15:26.403 16:01:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:26.403 16:01:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:26.403 16:01:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:26.403 16:01:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:26.403 16:01:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:26.403 16:01:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:26.403 16:01:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:26.403 16:01:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:26.403 16:01:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:26.403 16:01:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:26.403 16:01:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:26.403 16:01:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:26.403 16:01:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:26.403 16:01:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:26.403 16:01:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:26.403 16:01:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:26.403 16:01:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:26.403 16:01:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:26.403 16:01:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:26.403 16:01:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.404 16:01:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.404 16:01:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.404 16:01:49 -- paths/export.sh@5 -- # export PATH 00:15:26.404 16:01:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.404 16:01:49 -- nvmf/common.sh@46 -- # : 0 00:15:26.404 16:01:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:26.404 16:01:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:26.404 16:01:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:26.404 16:01:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:26.404 16:01:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:26.404 16:01:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:26.404 16:01:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:26.404 16:01:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:26.404 16:01:49 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:26.404 16:01:49 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:26.404 16:01:49 -- target/nvme_cli.sh@14 -- # devs=() 00:15:26.404 16:01:49 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:26.404 16:01:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:26.404 16:01:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:26.404 16:01:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:26.404 16:01:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:26.404 16:01:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:26.404 16:01:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:26.404 16:01:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:26.404 16:01:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:26.404 16:01:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:26.404 16:01:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:26.404 16:01:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:26.404 16:01:49 -- common/autotest_common.sh@10 -- # set +x 00:15:28.304 16:01:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:28.304 16:01:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:28.304 16:01:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:28.304 16:01:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:28.304 16:01:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:28.304 16:01:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:28.304 16:01:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:28.304 16:01:51 -- nvmf/common.sh@294 -- # net_devs=() 00:15:28.304 16:01:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:28.304 16:01:51 -- nvmf/common.sh@295 -- # e810=() 00:15:28.304 16:01:51 -- nvmf/common.sh@295 -- # local -ga e810 00:15:28.304 16:01:51 -- nvmf/common.sh@296 -- # x722=() 00:15:28.304 16:01:51 -- nvmf/common.sh@296 -- # local -ga x722 00:15:28.304 16:01:51 -- nvmf/common.sh@297 -- # mlx=() 00:15:28.304 16:01:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:28.304 16:01:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:28.304 16:01:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:28.304 16:01:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:28.304 16:01:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:28.304 16:01:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:28.304 16:01:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:28.304 16:01:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:28.304 16:01:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:28.304 16:01:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:28.304 16:01:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:28.304 16:01:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:28.304 16:01:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:28.304 16:01:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:28.304 16:01:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:28.304 16:01:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:28.304 16:01:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:28.304 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:28.304 16:01:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:28.304 16:01:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:28.304 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:28.304 16:01:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:28.304 16:01:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:28.304 16:01:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:28.304 16:01:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:28.304 16:01:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:28.304 16:01:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:28.304 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:28.304 16:01:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:28.304 16:01:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:28.304 16:01:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:28.304 16:01:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:28.304 16:01:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:28.304 16:01:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:28.304 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:28.304 16:01:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:28.304 16:01:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:28.304 16:01:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:28.304 16:01:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:28.304 16:01:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:28.304 16:01:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:28.304 16:01:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:28.304 16:01:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:28.304 16:01:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:28.305 16:01:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:28.305 16:01:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:28.305 16:01:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:28.305 16:01:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:28.305 16:01:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:28.305 16:01:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:28.305 16:01:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:28.305 16:01:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:28.305 16:01:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:28.305 16:01:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:28.305 16:01:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:28.305 16:01:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:28.305 16:01:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:28.305 16:01:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:28.305 16:01:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:28.305 16:01:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:28.305 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:28.305 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:15:28.305 00:15:28.305 --- 10.0.0.2 ping statistics --- 00:15:28.305 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:28.305 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:15:28.305 16:01:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:28.305 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:28.305 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.170 ms 00:15:28.305 00:15:28.305 --- 10.0.0.1 ping statistics --- 00:15:28.305 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:28.305 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:15:28.305 16:01:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:28.305 16:01:51 -- nvmf/common.sh@410 -- # return 0 00:15:28.305 16:01:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:28.305 16:01:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:28.305 16:01:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:28.305 16:01:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:28.305 16:01:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:28.305 16:01:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:28.305 16:01:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:28.305 16:01:51 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:28.305 16:01:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:28.305 16:01:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:28.305 16:01:51 -- common/autotest_common.sh@10 -- # set +x 00:15:28.305 16:01:51 -- nvmf/common.sh@469 -- # nvmfpid=1556078 00:15:28.305 16:01:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:28.305 16:01:51 -- nvmf/common.sh@470 -- # waitforlisten 1556078 00:15:28.305 16:01:51 -- common/autotest_common.sh@829 -- # '[' -z 1556078 ']' 00:15:28.305 16:01:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:28.305 16:01:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:28.305 16:01:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:28.305 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:28.305 16:01:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:28.305 16:01:51 -- common/autotest_common.sh@10 -- # set +x 00:15:28.305 [2024-11-18 16:01:51.794968] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:28.305 [2024-11-18 16:01:51.795063] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:28.305 EAL: No free 2048 kB hugepages reported on node 1 00:15:28.305 [2024-11-18 16:01:51.861108] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:28.563 [2024-11-18 16:01:51.950864] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:28.563 [2024-11-18 16:01:51.951019] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:28.563 [2024-11-18 16:01:51.951036] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:28.563 [2024-11-18 16:01:51.951048] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:28.563 [2024-11-18 16:01:51.951100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:28.563 [2024-11-18 16:01:51.951160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:28.563 [2024-11-18 16:01:51.951212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:28.563 [2024-11-18 16:01:51.951214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:29.496 16:01:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:29.496 16:01:52 -- common/autotest_common.sh@862 -- # return 0 00:15:29.496 16:01:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:29.496 16:01:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:29.496 16:01:52 -- common/autotest_common.sh@10 -- # set +x 00:15:29.496 16:01:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:29.496 16:01:52 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:29.496 16:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.496 16:01:52 -- common/autotest_common.sh@10 -- # set +x 00:15:29.496 [2024-11-18 16:01:52.792247] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:29.496 16:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.496 16:01:52 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:29.496 16:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.496 16:01:52 -- common/autotest_common.sh@10 -- # set +x 00:15:29.496 Malloc0 00:15:29.496 16:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.496 16:01:52 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:29.496 16:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.496 16:01:52 -- common/autotest_common.sh@10 -- # set +x 00:15:29.496 Malloc1 00:15:29.496 16:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.496 16:01:52 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:29.496 16:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.496 16:01:52 -- common/autotest_common.sh@10 -- # set +x 00:15:29.497 16:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.497 16:01:52 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:29.497 16:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.497 16:01:52 -- common/autotest_common.sh@10 -- # set +x 00:15:29.497 16:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.497 16:01:52 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:29.497 16:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.497 16:01:52 -- common/autotest_common.sh@10 -- # set +x 00:15:29.497 16:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.497 16:01:52 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:29.497 16:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.497 16:01:52 -- common/autotest_common.sh@10 -- # set +x 00:15:29.497 [2024-11-18 16:01:52.877755] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:29.497 16:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.497 16:01:52 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:29.497 16:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.497 16:01:52 -- common/autotest_common.sh@10 -- # set +x 00:15:29.497 16:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.497 16:01:52 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:29.497 00:15:29.497 Discovery Log Number of Records 2, Generation counter 2 00:15:29.497 =====Discovery Log Entry 0====== 00:15:29.497 trtype: tcp 00:15:29.497 adrfam: ipv4 00:15:29.497 subtype: current discovery subsystem 00:15:29.497 treq: not required 00:15:29.497 portid: 0 00:15:29.497 trsvcid: 4420 00:15:29.497 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:29.497 traddr: 10.0.0.2 00:15:29.497 eflags: explicit discovery connections, duplicate discovery information 00:15:29.497 sectype: none 00:15:29.497 =====Discovery Log Entry 1====== 00:15:29.497 trtype: tcp 00:15:29.497 adrfam: ipv4 00:15:29.497 subtype: nvme subsystem 00:15:29.497 treq: not required 00:15:29.497 portid: 0 00:15:29.497 trsvcid: 4420 00:15:29.497 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:29.497 traddr: 10.0.0.2 00:15:29.497 eflags: none 00:15:29.497 sectype: none 00:15:29.497 16:01:53 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:29.497 16:01:53 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:29.497 16:01:53 -- nvmf/common.sh@510 -- # local dev _ 00:15:29.497 16:01:53 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:29.497 16:01:53 -- nvmf/common.sh@509 -- # nvme list 00:15:29.497 16:01:53 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:29.497 16:01:53 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:29.497 16:01:53 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:29.497 16:01:53 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:29.497 16:01:53 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:29.497 16:01:53 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:30.430 16:01:53 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:30.430 16:01:53 -- common/autotest_common.sh@1187 -- # local i=0 00:15:30.430 16:01:53 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:30.430 16:01:53 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:30.430 16:01:53 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:30.430 16:01:53 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:32.328 16:01:55 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:32.329 16:01:55 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:32.329 16:01:55 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:32.329 16:01:55 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:32.329 16:01:55 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:32.329 16:01:55 -- common/autotest_common.sh@1197 -- # return 0 00:15:32.329 16:01:55 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:32.329 16:01:55 -- nvmf/common.sh@510 -- # local dev _ 00:15:32.329 16:01:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:32.329 16:01:55 -- nvmf/common.sh@509 -- # nvme list 00:15:32.329 16:01:55 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:32.329 16:01:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:32.329 16:01:55 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:32.329 16:01:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:32.329 16:01:55 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:32.329 16:01:55 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:32.329 16:01:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:32.329 16:01:55 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:32.329 16:01:55 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:32.329 16:01:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:32.329 16:01:55 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:32.329 /dev/nvme0n2 ]] 00:15:32.329 16:01:55 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:32.329 16:01:55 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:32.329 16:01:55 -- nvmf/common.sh@510 -- # local dev _ 00:15:32.329 16:01:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:32.329 16:01:55 -- nvmf/common.sh@509 -- # nvme list 00:15:32.586 16:01:55 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:32.586 16:01:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:32.586 16:01:55 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:32.586 16:01:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:32.586 16:01:55 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:32.586 16:01:55 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:32.586 16:01:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:32.586 16:01:55 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:32.586 16:01:55 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:32.586 16:01:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:32.586 16:01:55 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:32.586 16:01:55 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:32.844 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:32.844 16:01:56 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:32.844 16:01:56 -- common/autotest_common.sh@1208 -- # local i=0 00:15:32.844 16:01:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:32.844 16:01:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:32.844 16:01:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:32.844 16:01:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:32.844 16:01:56 -- common/autotest_common.sh@1220 -- # return 0 00:15:32.844 16:01:56 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:32.844 16:01:56 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:32.844 16:01:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:32.844 16:01:56 -- common/autotest_common.sh@10 -- # set +x 00:15:32.844 16:01:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:32.844 16:01:56 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:32.844 16:01:56 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:32.844 16:01:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:32.844 16:01:56 -- nvmf/common.sh@116 -- # sync 00:15:32.844 16:01:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:32.844 16:01:56 -- nvmf/common.sh@119 -- # set +e 00:15:32.844 16:01:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:32.844 16:01:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:32.844 rmmod nvme_tcp 00:15:32.844 rmmod nvme_fabrics 00:15:32.844 rmmod nvme_keyring 00:15:32.844 16:01:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:32.844 16:01:56 -- nvmf/common.sh@123 -- # set -e 00:15:32.844 16:01:56 -- nvmf/common.sh@124 -- # return 0 00:15:32.844 16:01:56 -- nvmf/common.sh@477 -- # '[' -n 1556078 ']' 00:15:32.844 16:01:56 -- nvmf/common.sh@478 -- # killprocess 1556078 00:15:32.844 16:01:56 -- common/autotest_common.sh@936 -- # '[' -z 1556078 ']' 00:15:32.844 16:01:56 -- common/autotest_common.sh@940 -- # kill -0 1556078 00:15:32.844 16:01:56 -- common/autotest_common.sh@941 -- # uname 00:15:32.844 16:01:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:32.844 16:01:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1556078 00:15:32.844 16:01:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:32.844 16:01:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:32.844 16:01:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1556078' 00:15:32.844 killing process with pid 1556078 00:15:32.844 16:01:56 -- common/autotest_common.sh@955 -- # kill 1556078 00:15:32.844 16:01:56 -- common/autotest_common.sh@960 -- # wait 1556078 00:15:33.102 16:01:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:33.102 16:01:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:33.102 16:01:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:33.102 16:01:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:33.102 16:01:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:33.102 16:01:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:33.102 16:01:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:33.102 16:01:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:35.635 16:01:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:35.635 00:15:35.635 real 0m9.284s 00:15:35.635 user 0m19.456s 00:15:35.635 sys 0m2.343s 00:15:35.635 16:01:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:35.635 16:01:58 -- common/autotest_common.sh@10 -- # set +x 00:15:35.636 ************************************ 00:15:35.636 END TEST nvmf_nvme_cli 00:15:35.636 ************************************ 00:15:35.636 16:01:58 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:35.636 16:01:58 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:35.636 16:01:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:35.636 16:01:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:35.636 16:01:58 -- common/autotest_common.sh@10 -- # set +x 00:15:35.636 ************************************ 00:15:35.636 START TEST nvmf_vfio_user 00:15:35.636 ************************************ 00:15:35.636 16:01:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:35.636 * Looking for test storage... 00:15:35.636 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:35.636 16:01:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:35.636 16:01:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:35.636 16:01:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:35.636 16:01:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:35.636 16:01:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:35.636 16:01:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:35.636 16:01:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:35.636 16:01:58 -- scripts/common.sh@335 -- # IFS=.-: 00:15:35.636 16:01:58 -- scripts/common.sh@335 -- # read -ra ver1 00:15:35.636 16:01:58 -- scripts/common.sh@336 -- # IFS=.-: 00:15:35.636 16:01:58 -- scripts/common.sh@336 -- # read -ra ver2 00:15:35.636 16:01:58 -- scripts/common.sh@337 -- # local 'op=<' 00:15:35.636 16:01:58 -- scripts/common.sh@339 -- # ver1_l=2 00:15:35.636 16:01:58 -- scripts/common.sh@340 -- # ver2_l=1 00:15:35.636 16:01:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:35.636 16:01:58 -- scripts/common.sh@343 -- # case "$op" in 00:15:35.636 16:01:58 -- scripts/common.sh@344 -- # : 1 00:15:35.636 16:01:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:35.636 16:01:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:35.636 16:01:58 -- scripts/common.sh@364 -- # decimal 1 00:15:35.636 16:01:58 -- scripts/common.sh@352 -- # local d=1 00:15:35.636 16:01:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:35.636 16:01:58 -- scripts/common.sh@354 -- # echo 1 00:15:35.636 16:01:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:35.636 16:01:58 -- scripts/common.sh@365 -- # decimal 2 00:15:35.636 16:01:58 -- scripts/common.sh@352 -- # local d=2 00:15:35.636 16:01:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:35.636 16:01:58 -- scripts/common.sh@354 -- # echo 2 00:15:35.636 16:01:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:35.636 16:01:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:35.636 16:01:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:35.636 16:01:58 -- scripts/common.sh@367 -- # return 0 00:15:35.636 16:01:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:35.636 16:01:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:35.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:35.636 --rc genhtml_branch_coverage=1 00:15:35.636 --rc genhtml_function_coverage=1 00:15:35.636 --rc genhtml_legend=1 00:15:35.636 --rc geninfo_all_blocks=1 00:15:35.636 --rc geninfo_unexecuted_blocks=1 00:15:35.636 00:15:35.636 ' 00:15:35.636 16:01:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:35.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:35.636 --rc genhtml_branch_coverage=1 00:15:35.636 --rc genhtml_function_coverage=1 00:15:35.636 --rc genhtml_legend=1 00:15:35.636 --rc geninfo_all_blocks=1 00:15:35.636 --rc geninfo_unexecuted_blocks=1 00:15:35.636 00:15:35.636 ' 00:15:35.636 16:01:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:35.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:35.636 --rc genhtml_branch_coverage=1 00:15:35.636 --rc genhtml_function_coverage=1 00:15:35.636 --rc genhtml_legend=1 00:15:35.636 --rc geninfo_all_blocks=1 00:15:35.636 --rc geninfo_unexecuted_blocks=1 00:15:35.636 00:15:35.636 ' 00:15:35.636 16:01:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:35.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:35.636 --rc genhtml_branch_coverage=1 00:15:35.636 --rc genhtml_function_coverage=1 00:15:35.636 --rc genhtml_legend=1 00:15:35.636 --rc geninfo_all_blocks=1 00:15:35.636 --rc geninfo_unexecuted_blocks=1 00:15:35.636 00:15:35.636 ' 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:35.636 16:01:58 -- nvmf/common.sh@7 -- # uname -s 00:15:35.636 16:01:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:35.636 16:01:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:35.636 16:01:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:35.636 16:01:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:35.636 16:01:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:35.636 16:01:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:35.636 16:01:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:35.636 16:01:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:35.636 16:01:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:35.636 16:01:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:35.636 16:01:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:35.636 16:01:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:35.636 16:01:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:35.636 16:01:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:35.636 16:01:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:35.636 16:01:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:35.636 16:01:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:35.636 16:01:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:35.636 16:01:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:35.636 16:01:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:35.636 16:01:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:35.636 16:01:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:35.636 16:01:58 -- paths/export.sh@5 -- # export PATH 00:15:35.636 16:01:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:35.636 16:01:58 -- nvmf/common.sh@46 -- # : 0 00:15:35.636 16:01:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:35.636 16:01:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:35.636 16:01:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:35.636 16:01:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:35.636 16:01:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:35.636 16:01:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:35.636 16:01:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:35.636 16:01:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:35.636 16:01:58 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1557159 00:15:35.637 16:01:58 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:35.637 16:01:58 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1557159' 00:15:35.637 Process pid: 1557159 00:15:35.637 16:01:58 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:35.637 16:01:58 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1557159 00:15:35.637 16:01:58 -- common/autotest_common.sh@829 -- # '[' -z 1557159 ']' 00:15:35.637 16:01:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:35.637 16:01:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:35.637 16:01:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:35.637 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:35.637 16:01:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:35.637 16:01:58 -- common/autotest_common.sh@10 -- # set +x 00:15:35.637 [2024-11-18 16:01:58.930352] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:35.637 [2024-11-18 16:01:58.930442] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:35.637 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.637 [2024-11-18 16:01:58.990059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:35.637 [2024-11-18 16:01:59.078104] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:35.637 [2024-11-18 16:01:59.078261] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:35.637 [2024-11-18 16:01:59.078281] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:35.637 [2024-11-18 16:01:59.078296] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:35.637 [2024-11-18 16:01:59.078376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:35.637 [2024-11-18 16:01:59.078432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:35.637 [2024-11-18 16:01:59.078551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:35.637 [2024-11-18 16:01:59.078554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:36.568 16:01:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:36.568 16:01:59 -- common/autotest_common.sh@862 -- # return 0 00:15:36.568 16:01:59 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:37.581 16:02:00 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:37.839 16:02:01 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:37.839 16:02:01 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:37.839 16:02:01 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:37.839 16:02:01 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:37.839 16:02:01 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:38.097 Malloc1 00:15:38.097 16:02:01 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:38.354 16:02:01 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:38.611 16:02:02 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:38.869 16:02:02 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:38.869 16:02:02 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:38.869 16:02:02 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:39.127 Malloc2 00:15:39.127 16:02:02 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:39.385 16:02:02 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:39.643 16:02:03 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:39.904 16:02:03 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:39.904 16:02:03 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:39.904 16:02:03 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:39.904 16:02:03 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:39.904 16:02:03 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:39.904 16:02:03 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:39.904 [2024-11-18 16:02:03.349044] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:39.904 [2024-11-18 16:02:03.349085] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1557728 ] 00:15:39.904 EAL: No free 2048 kB hugepages reported on node 1 00:15:39.904 [2024-11-18 16:02:03.383025] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:39.904 [2024-11-18 16:02:03.391975] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:39.904 [2024-11-18 16:02:03.392003] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f4056b8e000 00:15:39.904 [2024-11-18 16:02:03.392973] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:39.904 [2024-11-18 16:02:03.393984] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:39.904 [2024-11-18 16:02:03.394972] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:39.904 [2024-11-18 16:02:03.395977] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:39.904 [2024-11-18 16:02:03.396982] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:39.904 [2024-11-18 16:02:03.398000] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:39.904 [2024-11-18 16:02:03.398995] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:39.904 [2024-11-18 16:02:03.400006] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:39.904 [2024-11-18 16:02:03.401015] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:39.904 [2024-11-18 16:02:03.401035] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f4055886000 00:15:39.904 [2024-11-18 16:02:03.402204] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:39.904 [2024-11-18 16:02:03.421807] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:39.904 [2024-11-18 16:02:03.421846] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:39.904 [2024-11-18 16:02:03.424153] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:39.904 [2024-11-18 16:02:03.424219] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:39.904 [2024-11-18 16:02:03.424317] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:39.904 [2024-11-18 16:02:03.424355] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:39.904 [2024-11-18 16:02:03.424366] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:39.904 [2024-11-18 16:02:03.425155] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:39.904 [2024-11-18 16:02:03.425176] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:39.904 [2024-11-18 16:02:03.425188] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:39.904 [2024-11-18 16:02:03.426154] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:39.904 [2024-11-18 16:02:03.426173] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:39.904 [2024-11-18 16:02:03.426187] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:39.904 [2024-11-18 16:02:03.427162] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:39.904 [2024-11-18 16:02:03.427180] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:39.904 [2024-11-18 16:02:03.428165] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:39.904 [2024-11-18 16:02:03.428188] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:39.904 [2024-11-18 16:02:03.428198] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:39.904 [2024-11-18 16:02:03.428209] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:39.904 [2024-11-18 16:02:03.428319] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:39.904 [2024-11-18 16:02:03.428327] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:39.904 [2024-11-18 16:02:03.428335] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:39.904 [2024-11-18 16:02:03.429173] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:39.904 [2024-11-18 16:02:03.430181] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:39.904 [2024-11-18 16:02:03.431191] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:39.904 [2024-11-18 16:02:03.432231] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:39.904 [2024-11-18 16:02:03.433202] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:39.904 [2024-11-18 16:02:03.433219] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:39.904 [2024-11-18 16:02:03.433228] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:39.904 [2024-11-18 16:02:03.433252] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:39.904 [2024-11-18 16:02:03.433265] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:39.904 [2024-11-18 16:02:03.433291] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:39.904 [2024-11-18 16:02:03.433301] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:39.904 [2024-11-18 16:02:03.433324] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:39.904 [2024-11-18 16:02:03.433380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:39.904 [2024-11-18 16:02:03.433398] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:39.904 [2024-11-18 16:02:03.433406] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:39.905 [2024-11-18 16:02:03.433413] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:39.905 [2024-11-18 16:02:03.433420] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:39.905 [2024-11-18 16:02:03.433428] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:39.905 [2024-11-18 16:02:03.433435] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:39.905 [2024-11-18 16:02:03.433447] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.433465] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.433481] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.433493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.433515] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:39.905 [2024-11-18 16:02:03.433528] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:39.905 [2024-11-18 16:02:03.433540] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:39.905 [2024-11-18 16:02:03.433552] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:39.905 [2024-11-18 16:02:03.433560] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.433574] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.433603] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.433625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.433637] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:39.905 [2024-11-18 16:02:03.433645] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.433671] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.433687] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.433702] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.433717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.433783] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.433797] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.433811] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:39.905 [2024-11-18 16:02:03.433819] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:39.905 [2024-11-18 16:02:03.433829] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.433848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.433873] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:39.905 [2024-11-18 16:02:03.433893] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.433910] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.433937] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:39.905 [2024-11-18 16:02:03.433945] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:39.905 [2024-11-18 16:02:03.433956] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.433991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.434014] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.434029] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.434041] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:39.905 [2024-11-18 16:02:03.434049] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:39.905 [2024-11-18 16:02:03.434058] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.434069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.434083] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.434094] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.434108] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.434119] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.434128] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.434137] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:39.905 [2024-11-18 16:02:03.434144] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:39.905 [2024-11-18 16:02:03.434153] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:39.905 [2024-11-18 16:02:03.434180] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.434199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.434218] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.434233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.434248] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.434263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.434282] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.434294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.434313] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:39.905 [2024-11-18 16:02:03.434321] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:39.905 [2024-11-18 16:02:03.434327] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:39.905 [2024-11-18 16:02:03.434333] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:39.905 [2024-11-18 16:02:03.434342] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:39.905 [2024-11-18 16:02:03.434353] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:39.905 [2024-11-18 16:02:03.434361] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:39.905 [2024-11-18 16:02:03.434370] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.434380] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:39.905 [2024-11-18 16:02:03.434388] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:39.905 [2024-11-18 16:02:03.434397] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.434409] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:39.905 [2024-11-18 16:02:03.434416] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:39.905 [2024-11-18 16:02:03.434425] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:39.905 [2024-11-18 16:02:03.434436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.434456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.434472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:39.905 [2024-11-18 16:02:03.434483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:39.905 ===================================================== 00:15:39.905 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:39.905 ===================================================== 00:15:39.905 Controller Capabilities/Features 00:15:39.905 ================================ 00:15:39.905 Vendor ID: 4e58 00:15:39.905 Subsystem Vendor ID: 4e58 00:15:39.905 Serial Number: SPDK1 00:15:39.905 Model Number: SPDK bdev Controller 00:15:39.905 Firmware Version: 24.01.1 00:15:39.905 Recommended Arb Burst: 6 00:15:39.905 IEEE OUI Identifier: 8d 6b 50 00:15:39.905 Multi-path I/O 00:15:39.906 May have multiple subsystem ports: Yes 00:15:39.906 May have multiple controllers: Yes 00:15:39.906 Associated with SR-IOV VF: No 00:15:39.906 Max Data Transfer Size: 131072 00:15:39.906 Max Number of Namespaces: 32 00:15:39.906 Max Number of I/O Queues: 127 00:15:39.906 NVMe Specification Version (VS): 1.3 00:15:39.906 NVMe Specification Version (Identify): 1.3 00:15:39.906 Maximum Queue Entries: 256 00:15:39.906 Contiguous Queues Required: Yes 00:15:39.906 Arbitration Mechanisms Supported 00:15:39.906 Weighted Round Robin: Not Supported 00:15:39.906 Vendor Specific: Not Supported 00:15:39.906 Reset Timeout: 15000 ms 00:15:39.906 Doorbell Stride: 4 bytes 00:15:39.906 NVM Subsystem Reset: Not Supported 00:15:39.906 Command Sets Supported 00:15:39.906 NVM Command Set: Supported 00:15:39.906 Boot Partition: Not Supported 00:15:39.906 Memory Page Size Minimum: 4096 bytes 00:15:39.906 Memory Page Size Maximum: 4096 bytes 00:15:39.906 Persistent Memory Region: Not Supported 00:15:39.906 Optional Asynchronous Events Supported 00:15:39.906 Namespace Attribute Notices: Supported 00:15:39.906 Firmware Activation Notices: Not Supported 00:15:39.906 ANA Change Notices: Not Supported 00:15:39.906 PLE Aggregate Log Change Notices: Not Supported 00:15:39.906 LBA Status Info Alert Notices: Not Supported 00:15:39.906 EGE Aggregate Log Change Notices: Not Supported 00:15:39.906 Normal NVM Subsystem Shutdown event: Not Supported 00:15:39.906 Zone Descriptor Change Notices: Not Supported 00:15:39.906 Discovery Log Change Notices: Not Supported 00:15:39.906 Controller Attributes 00:15:39.906 128-bit Host Identifier: Supported 00:15:39.906 Non-Operational Permissive Mode: Not Supported 00:15:39.906 NVM Sets: Not Supported 00:15:39.906 Read Recovery Levels: Not Supported 00:15:39.906 Endurance Groups: Not Supported 00:15:39.906 Predictable Latency Mode: Not Supported 00:15:39.906 Traffic Based Keep ALive: Not Supported 00:15:39.906 Namespace Granularity: Not Supported 00:15:39.906 SQ Associations: Not Supported 00:15:39.906 UUID List: Not Supported 00:15:39.906 Multi-Domain Subsystem: Not Supported 00:15:39.906 Fixed Capacity Management: Not Supported 00:15:39.906 Variable Capacity Management: Not Supported 00:15:39.906 Delete Endurance Group: Not Supported 00:15:39.906 Delete NVM Set: Not Supported 00:15:39.906 Extended LBA Formats Supported: Not Supported 00:15:39.906 Flexible Data Placement Supported: Not Supported 00:15:39.906 00:15:39.906 Controller Memory Buffer Support 00:15:39.906 ================================ 00:15:39.906 Supported: No 00:15:39.906 00:15:39.906 Persistent Memory Region Support 00:15:39.906 ================================ 00:15:39.906 Supported: No 00:15:39.906 00:15:39.906 Admin Command Set Attributes 00:15:39.906 ============================ 00:15:39.906 Security Send/Receive: Not Supported 00:15:39.906 Format NVM: Not Supported 00:15:39.906 Firmware Activate/Download: Not Supported 00:15:39.906 Namespace Management: Not Supported 00:15:39.906 Device Self-Test: Not Supported 00:15:39.906 Directives: Not Supported 00:15:39.906 NVMe-MI: Not Supported 00:15:39.906 Virtualization Management: Not Supported 00:15:39.906 Doorbell Buffer Config: Not Supported 00:15:39.906 Get LBA Status Capability: Not Supported 00:15:39.906 Command & Feature Lockdown Capability: Not Supported 00:15:39.906 Abort Command Limit: 4 00:15:39.906 Async Event Request Limit: 4 00:15:39.906 Number of Firmware Slots: N/A 00:15:39.906 Firmware Slot 1 Read-Only: N/A 00:15:39.906 Firmware Activation Without Reset: N/A 00:15:39.906 Multiple Update Detection Support: N/A 00:15:39.906 Firmware Update Granularity: No Information Provided 00:15:39.906 Per-Namespace SMART Log: No 00:15:39.906 Asymmetric Namespace Access Log Page: Not Supported 00:15:39.906 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:39.906 Command Effects Log Page: Supported 00:15:39.906 Get Log Page Extended Data: Supported 00:15:39.906 Telemetry Log Pages: Not Supported 00:15:39.906 Persistent Event Log Pages: Not Supported 00:15:39.906 Supported Log Pages Log Page: May Support 00:15:39.906 Commands Supported & Effects Log Page: Not Supported 00:15:39.906 Feature Identifiers & Effects Log Page:May Support 00:15:39.906 NVMe-MI Commands & Effects Log Page: May Support 00:15:39.906 Data Area 4 for Telemetry Log: Not Supported 00:15:39.906 Error Log Page Entries Supported: 128 00:15:39.906 Keep Alive: Supported 00:15:39.906 Keep Alive Granularity: 10000 ms 00:15:39.906 00:15:39.906 NVM Command Set Attributes 00:15:39.906 ========================== 00:15:39.906 Submission Queue Entry Size 00:15:39.906 Max: 64 00:15:39.906 Min: 64 00:15:39.906 Completion Queue Entry Size 00:15:39.906 Max: 16 00:15:39.906 Min: 16 00:15:39.906 Number of Namespaces: 32 00:15:39.906 Compare Command: Supported 00:15:39.906 Write Uncorrectable Command: Not Supported 00:15:39.906 Dataset Management Command: Supported 00:15:39.906 Write Zeroes Command: Supported 00:15:39.906 Set Features Save Field: Not Supported 00:15:39.906 Reservations: Not Supported 00:15:39.906 Timestamp: Not Supported 00:15:39.906 Copy: Supported 00:15:39.906 Volatile Write Cache: Present 00:15:39.906 Atomic Write Unit (Normal): 1 00:15:39.906 Atomic Write Unit (PFail): 1 00:15:39.906 Atomic Compare & Write Unit: 1 00:15:39.906 Fused Compare & Write: Supported 00:15:39.906 Scatter-Gather List 00:15:39.906 SGL Command Set: Supported (Dword aligned) 00:15:39.906 SGL Keyed: Not Supported 00:15:39.906 SGL Bit Bucket Descriptor: Not Supported 00:15:39.906 SGL Metadata Pointer: Not Supported 00:15:39.906 Oversized SGL: Not Supported 00:15:39.906 SGL Metadata Address: Not Supported 00:15:39.906 SGL Offset: Not Supported 00:15:39.906 Transport SGL Data Block: Not Supported 00:15:39.906 Replay Protected Memory Block: Not Supported 00:15:39.906 00:15:39.906 Firmware Slot Information 00:15:39.906 ========================= 00:15:39.906 Active slot: 1 00:15:39.906 Slot 1 Firmware Revision: 24.01.1 00:15:39.906 00:15:39.906 00:15:39.906 Commands Supported and Effects 00:15:39.906 ============================== 00:15:39.906 Admin Commands 00:15:39.906 -------------- 00:15:39.906 Get Log Page (02h): Supported 00:15:39.906 Identify (06h): Supported 00:15:39.906 Abort (08h): Supported 00:15:39.906 Set Features (09h): Supported 00:15:39.906 Get Features (0Ah): Supported 00:15:39.906 Asynchronous Event Request (0Ch): Supported 00:15:39.906 Keep Alive (18h): Supported 00:15:39.906 I/O Commands 00:15:39.906 ------------ 00:15:39.906 Flush (00h): Supported LBA-Change 00:15:39.906 Write (01h): Supported LBA-Change 00:15:39.906 Read (02h): Supported 00:15:39.906 Compare (05h): Supported 00:15:39.906 Write Zeroes (08h): Supported LBA-Change 00:15:39.906 Dataset Management (09h): Supported LBA-Change 00:15:39.906 Copy (19h): Supported LBA-Change 00:15:39.906 Unknown (79h): Supported LBA-Change 00:15:39.906 Unknown (7Ah): Supported 00:15:39.906 00:15:39.906 Error Log 00:15:39.906 ========= 00:15:39.906 00:15:39.906 Arbitration 00:15:39.906 =========== 00:15:39.906 Arbitration Burst: 1 00:15:39.906 00:15:39.906 Power Management 00:15:39.906 ================ 00:15:39.906 Number of Power States: 1 00:15:39.906 Current Power State: Power State #0 00:15:39.906 Power State #0: 00:15:39.906 Max Power: 0.00 W 00:15:39.906 Non-Operational State: Operational 00:15:39.906 Entry Latency: Not Reported 00:15:39.906 Exit Latency: Not Reported 00:15:39.906 Relative Read Throughput: 0 00:15:39.906 Relative Read Latency: 0 00:15:39.906 Relative Write Throughput: 0 00:15:39.906 Relative Write Latency: 0 00:15:39.906 Idle Power: Not Reported 00:15:39.906 Active Power: Not Reported 00:15:39.906 Non-Operational Permissive Mode: Not Supported 00:15:39.906 00:15:39.906 Health Information 00:15:39.906 ================== 00:15:39.906 Critical Warnings: 00:15:39.906 Available Spare Space: OK 00:15:39.906 Temperature: OK 00:15:39.906 Device Reliability: OK 00:15:39.906 Read Only: No 00:15:39.906 Volatile Memory Backup: OK 00:15:39.906 Current Temperature: 0 Kelvin[2024-11-18 16:02:03.434643] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:39.906 [2024-11-18 16:02:03.434660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:39.906 [2024-11-18 16:02:03.434702] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:39.907 [2024-11-18 16:02:03.434720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:39.907 [2024-11-18 16:02:03.434731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:39.907 [2024-11-18 16:02:03.434741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:39.907 [2024-11-18 16:02:03.434751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:39.907 [2024-11-18 16:02:03.435220] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:39.907 [2024-11-18 16:02:03.435243] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:39.907 [2024-11-18 16:02:03.436267] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:39.907 [2024-11-18 16:02:03.436280] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:39.907 [2024-11-18 16:02:03.437230] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:39.907 [2024-11-18 16:02:03.437252] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:39.907 [2024-11-18 16:02:03.437307] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:39.907 [2024-11-18 16:02:03.442634] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:39.907 (-273 Celsius) 00:15:39.907 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:39.907 Available Spare: 0% 00:15:39.907 Available Spare Threshold: 0% 00:15:39.907 Life Percentage Used: 0% 00:15:39.907 Data Units Read: 0 00:15:39.907 Data Units Written: 0 00:15:39.907 Host Read Commands: 0 00:15:39.907 Host Write Commands: 0 00:15:39.907 Controller Busy Time: 0 minutes 00:15:39.907 Power Cycles: 0 00:15:39.907 Power On Hours: 0 hours 00:15:39.907 Unsafe Shutdowns: 0 00:15:39.907 Unrecoverable Media Errors: 0 00:15:39.907 Lifetime Error Log Entries: 0 00:15:39.907 Warning Temperature Time: 0 minutes 00:15:39.907 Critical Temperature Time: 0 minutes 00:15:39.907 00:15:39.907 Number of Queues 00:15:39.907 ================ 00:15:39.907 Number of I/O Submission Queues: 127 00:15:39.907 Number of I/O Completion Queues: 127 00:15:39.907 00:15:39.907 Active Namespaces 00:15:39.907 ================= 00:15:39.907 Namespace ID:1 00:15:39.907 Error Recovery Timeout: Unlimited 00:15:39.907 Command Set Identifier: NVM (00h) 00:15:39.907 Deallocate: Supported 00:15:39.907 Deallocated/Unwritten Error: Not Supported 00:15:39.907 Deallocated Read Value: Unknown 00:15:39.907 Deallocate in Write Zeroes: Not Supported 00:15:39.907 Deallocated Guard Field: 0xFFFF 00:15:39.907 Flush: Supported 00:15:39.907 Reservation: Supported 00:15:39.907 Namespace Sharing Capabilities: Multiple Controllers 00:15:39.907 Size (in LBAs): 131072 (0GiB) 00:15:39.907 Capacity (in LBAs): 131072 (0GiB) 00:15:39.907 Utilization (in LBAs): 131072 (0GiB) 00:15:39.907 NGUID: 2342FB00FB89410EACBEBCFB705F2E6B 00:15:39.907 UUID: 2342fb00-fb89-410e-acbe-bcfb705f2e6b 00:15:39.907 Thin Provisioning: Not Supported 00:15:39.907 Per-NS Atomic Units: Yes 00:15:39.907 Atomic Boundary Size (Normal): 0 00:15:39.907 Atomic Boundary Size (PFail): 0 00:15:39.907 Atomic Boundary Offset: 0 00:15:39.907 Maximum Single Source Range Length: 65535 00:15:39.907 Maximum Copy Length: 65535 00:15:39.907 Maximum Source Range Count: 1 00:15:39.907 NGUID/EUI64 Never Reused: No 00:15:39.907 Namespace Write Protected: No 00:15:39.907 Number of LBA Formats: 1 00:15:39.907 Current LBA Format: LBA Format #00 00:15:39.907 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:39.907 00:15:39.907 16:02:03 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:40.165 EAL: No free 2048 kB hugepages reported on node 1 00:15:45.430 Initializing NVMe Controllers 00:15:45.430 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:45.430 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:45.430 Initialization complete. Launching workers. 00:15:45.430 ======================================================== 00:15:45.430 Latency(us) 00:15:45.430 Device Information : IOPS MiB/s Average min max 00:15:45.430 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 36673.77 143.26 3491.19 1142.96 9694.36 00:15:45.430 ======================================================== 00:15:45.430 Total : 36673.77 143.26 3491.19 1142.96 9694.36 00:15:45.430 00:15:45.430 16:02:08 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:45.430 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.693 Initializing NVMe Controllers 00:15:50.693 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:50.693 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:50.693 Initialization complete. Launching workers. 00:15:50.693 ======================================================== 00:15:50.693 Latency(us) 00:15:50.693 Device Information : IOPS MiB/s Average min max 00:15:50.693 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16012.80 62.55 8002.01 4954.04 15946.03 00:15:50.693 ======================================================== 00:15:50.693 Total : 16012.80 62.55 8002.01 4954.04 15946.03 00:15:50.693 00:15:50.693 16:02:14 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:50.693 EAL: No free 2048 kB hugepages reported on node 1 00:15:55.956 Initializing NVMe Controllers 00:15:55.956 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:55.956 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:55.956 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:55.956 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:55.956 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:55.956 Initialization complete. Launching workers. 00:15:55.956 Starting thread on core 2 00:15:55.956 Starting thread on core 3 00:15:55.956 Starting thread on core 1 00:15:55.956 16:02:19 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:55.956 EAL: No free 2048 kB hugepages reported on node 1 00:15:59.241 Initializing NVMe Controllers 00:15:59.241 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:59.241 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:59.241 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:59.241 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:59.241 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:59.241 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:59.241 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:59.241 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:59.241 Initialization complete. Launching workers. 00:15:59.241 Starting thread on core 1 with urgent priority queue 00:15:59.241 Starting thread on core 2 with urgent priority queue 00:15:59.241 Starting thread on core 3 with urgent priority queue 00:15:59.241 Starting thread on core 0 with urgent priority queue 00:15:59.241 SPDK bdev Controller (SPDK1 ) core 0: 5606.67 IO/s 17.84 secs/100000 ios 00:15:59.242 SPDK bdev Controller (SPDK1 ) core 1: 5930.67 IO/s 16.86 secs/100000 ios 00:15:59.242 SPDK bdev Controller (SPDK1 ) core 2: 5456.00 IO/s 18.33 secs/100000 ios 00:15:59.242 SPDK bdev Controller (SPDK1 ) core 3: 5638.00 IO/s 17.74 secs/100000 ios 00:15:59.242 ======================================================== 00:15:59.242 00:15:59.242 16:02:22 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:59.242 EAL: No free 2048 kB hugepages reported on node 1 00:15:59.499 Initializing NVMe Controllers 00:15:59.499 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:59.499 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:59.499 Namespace ID: 1 size: 0GB 00:15:59.499 Initialization complete. 00:15:59.499 INFO: using host memory buffer for IO 00:15:59.499 Hello world! 00:15:59.499 16:02:23 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:59.499 EAL: No free 2048 kB hugepages reported on node 1 00:16:00.873 Initializing NVMe Controllers 00:16:00.873 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:00.873 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:00.873 Initialization complete. Launching workers. 00:16:00.873 submit (in ns) avg, min, max = 7119.2, 3443.3, 4017127.8 00:16:00.874 complete (in ns) avg, min, max = 25274.6, 2054.4, 6992077.8 00:16:00.874 00:16:00.874 Submit histogram 00:16:00.874 ================ 00:16:00.874 Range in us Cumulative Count 00:16:00.874 3.437 - 3.461: 0.1687% ( 23) 00:16:00.874 3.461 - 3.484: 1.0931% ( 126) 00:16:00.874 3.484 - 3.508: 3.3306% ( 305) 00:16:00.874 3.508 - 3.532: 8.4880% ( 703) 00:16:00.874 3.532 - 3.556: 16.6826% ( 1117) 00:16:00.874 3.556 - 3.579: 27.2614% ( 1442) 00:16:00.874 3.579 - 3.603: 35.2799% ( 1093) 00:16:00.874 3.603 - 3.627: 42.2053% ( 944) 00:16:00.874 3.627 - 3.650: 49.0280% ( 930) 00:16:00.874 3.650 - 3.674: 55.0363% ( 819) 00:16:00.874 3.674 - 3.698: 59.7242% ( 639) 00:16:00.874 3.698 - 3.721: 63.3042% ( 488) 00:16:00.874 3.721 - 3.745: 66.2607% ( 403) 00:16:00.874 3.745 - 3.769: 69.2612% ( 409) 00:16:00.874 3.769 - 3.793: 73.4722% ( 574) 00:16:00.874 3.793 - 3.816: 77.2797% ( 519) 00:16:00.874 3.816 - 3.840: 81.1092% ( 522) 00:16:00.874 3.840 - 3.864: 84.1831% ( 419) 00:16:00.874 3.864 - 3.887: 86.5454% ( 322) 00:16:00.874 3.887 - 3.911: 88.4968% ( 266) 00:16:00.874 3.911 - 3.935: 90.2282% ( 236) 00:16:00.874 3.935 - 3.959: 91.3066% ( 147) 00:16:00.874 3.959 - 3.982: 92.2970% ( 135) 00:16:00.874 3.982 - 4.006: 93.3020% ( 137) 00:16:00.874 4.006 - 4.030: 94.0723% ( 105) 00:16:00.874 4.030 - 4.053: 94.8206% ( 102) 00:16:00.874 4.053 - 4.077: 95.3342% ( 70) 00:16:00.874 4.077 - 4.101: 95.8110% ( 65) 00:16:00.874 4.101 - 4.124: 96.0605% ( 34) 00:16:00.874 4.124 - 4.148: 96.2659% ( 28) 00:16:00.874 4.148 - 4.172: 96.3832% ( 16) 00:16:00.874 4.172 - 4.196: 96.4860% ( 14) 00:16:00.874 4.196 - 4.219: 96.6180% ( 18) 00:16:00.874 4.219 - 4.243: 96.7867% ( 23) 00:16:00.874 4.243 - 4.267: 96.8968% ( 15) 00:16:00.874 4.267 - 4.290: 96.9922% ( 13) 00:16:00.874 4.290 - 4.314: 97.0875% ( 13) 00:16:00.874 4.314 - 4.338: 97.1535% ( 9) 00:16:00.874 4.338 - 4.361: 97.2122% ( 8) 00:16:00.874 4.361 - 4.385: 97.2416% ( 4) 00:16:00.874 4.385 - 4.409: 97.2636% ( 3) 00:16:00.874 4.409 - 4.433: 97.2709% ( 1) 00:16:00.874 4.433 - 4.456: 97.2856% ( 2) 00:16:00.874 4.456 - 4.480: 97.2929% ( 1) 00:16:00.874 4.480 - 4.504: 97.3003% ( 1) 00:16:00.874 4.504 - 4.527: 97.3370% ( 5) 00:16:00.874 4.551 - 4.575: 97.3443% ( 1) 00:16:00.874 4.575 - 4.599: 97.3736% ( 4) 00:16:00.874 4.599 - 4.622: 97.4103% ( 5) 00:16:00.874 4.622 - 4.646: 97.4397% ( 4) 00:16:00.874 4.646 - 4.670: 97.4617% ( 3) 00:16:00.874 4.670 - 4.693: 97.4910% ( 4) 00:16:00.874 4.693 - 4.717: 97.5277% ( 5) 00:16:00.874 4.717 - 4.741: 97.6011% ( 10) 00:16:00.874 4.741 - 4.764: 97.6377% ( 5) 00:16:00.874 4.764 - 4.788: 97.6891% ( 7) 00:16:00.874 4.788 - 4.812: 97.7478% ( 8) 00:16:00.874 4.812 - 4.836: 97.7625% ( 2) 00:16:00.874 4.836 - 4.859: 97.8065% ( 6) 00:16:00.874 4.859 - 4.883: 97.8358% ( 4) 00:16:00.874 4.883 - 4.907: 97.8578% ( 3) 00:16:00.874 4.907 - 4.930: 97.9018% ( 6) 00:16:00.874 4.930 - 4.954: 97.9239% ( 3) 00:16:00.874 4.954 - 4.978: 97.9385% ( 2) 00:16:00.874 4.978 - 5.001: 97.9532% ( 2) 00:16:00.874 5.001 - 5.025: 97.9679% ( 2) 00:16:00.874 5.025 - 5.049: 97.9825% ( 2) 00:16:00.874 5.049 - 5.073: 97.9899% ( 1) 00:16:00.874 5.073 - 5.096: 98.0045% ( 2) 00:16:00.874 5.096 - 5.120: 98.0266% ( 3) 00:16:00.874 5.120 - 5.144: 98.0412% ( 2) 00:16:00.874 5.144 - 5.167: 98.0559% ( 2) 00:16:00.874 5.167 - 5.191: 98.0706% ( 2) 00:16:00.874 5.191 - 5.215: 98.0779% ( 1) 00:16:00.874 5.286 - 5.310: 98.0852% ( 1) 00:16:00.874 5.310 - 5.333: 98.0926% ( 1) 00:16:00.874 5.357 - 5.381: 98.0999% ( 1) 00:16:00.874 5.428 - 5.452: 98.1073% ( 1) 00:16:00.874 5.547 - 5.570: 98.1146% ( 1) 00:16:00.874 5.665 - 5.689: 98.1219% ( 1) 00:16:00.874 5.689 - 5.713: 98.1293% ( 1) 00:16:00.874 5.807 - 5.831: 98.1366% ( 1) 00:16:00.874 5.831 - 5.855: 98.1439% ( 1) 00:16:00.874 5.879 - 5.902: 98.1586% ( 2) 00:16:00.874 5.902 - 5.926: 98.1733% ( 2) 00:16:00.874 5.950 - 5.973: 98.1806% ( 1) 00:16:00.874 6.068 - 6.116: 98.1953% ( 2) 00:16:00.874 6.210 - 6.258: 98.2026% ( 1) 00:16:00.874 6.400 - 6.447: 98.2100% ( 1) 00:16:00.874 6.969 - 7.016: 98.2173% ( 1) 00:16:00.874 7.016 - 7.064: 98.2246% ( 1) 00:16:00.874 7.064 - 7.111: 98.2393% ( 2) 00:16:00.874 7.159 - 7.206: 98.2466% ( 1) 00:16:00.874 7.206 - 7.253: 98.2760% ( 4) 00:16:00.874 7.348 - 7.396: 98.2833% ( 1) 00:16:00.874 7.822 - 7.870: 98.3053% ( 3) 00:16:00.874 7.870 - 7.917: 98.3127% ( 1) 00:16:00.874 7.917 - 7.964: 98.3273% ( 2) 00:16:00.874 7.964 - 8.012: 98.3494% ( 3) 00:16:00.874 8.012 - 8.059: 98.3567% ( 1) 00:16:00.874 8.059 - 8.107: 98.3714% ( 2) 00:16:00.874 8.107 - 8.154: 98.3860% ( 2) 00:16:00.874 8.201 - 8.249: 98.3934% ( 1) 00:16:00.874 8.249 - 8.296: 98.4007% ( 1) 00:16:00.874 8.296 - 8.344: 98.4227% ( 3) 00:16:00.874 8.344 - 8.391: 98.4300% ( 1) 00:16:00.874 8.391 - 8.439: 98.4374% ( 1) 00:16:00.874 8.486 - 8.533: 98.4447% ( 1) 00:16:00.874 8.628 - 8.676: 98.4594% ( 2) 00:16:00.874 8.676 - 8.723: 98.4741% ( 2) 00:16:00.874 8.723 - 8.770: 98.4814% ( 1) 00:16:00.874 8.770 - 8.818: 98.4887% ( 1) 00:16:00.874 8.865 - 8.913: 98.5107% ( 3) 00:16:00.874 8.913 - 8.960: 98.5254% ( 2) 00:16:00.874 8.960 - 9.007: 98.5328% ( 1) 00:16:00.874 9.007 - 9.055: 98.5474% ( 2) 00:16:00.874 9.055 - 9.102: 98.5548% ( 1) 00:16:00.874 9.102 - 9.150: 98.5621% ( 1) 00:16:00.874 9.197 - 9.244: 98.5841% ( 3) 00:16:00.874 9.434 - 9.481: 98.5914% ( 1) 00:16:00.874 9.529 - 9.576: 98.5988% ( 1) 00:16:00.874 9.624 - 9.671: 98.6061% ( 1) 00:16:00.874 9.671 - 9.719: 98.6135% ( 1) 00:16:00.874 9.813 - 9.861: 98.6281% ( 2) 00:16:00.874 9.861 - 9.908: 98.6428% ( 2) 00:16:00.874 9.908 - 9.956: 98.6501% ( 1) 00:16:00.874 9.956 - 10.003: 98.6575% ( 1) 00:16:00.874 10.050 - 10.098: 98.6648% ( 1) 00:16:00.874 10.145 - 10.193: 98.6721% ( 1) 00:16:00.874 10.240 - 10.287: 98.6795% ( 1) 00:16:00.874 10.335 - 10.382: 98.6942% ( 2) 00:16:00.874 10.382 - 10.430: 98.7015% ( 1) 00:16:00.874 10.430 - 10.477: 98.7088% ( 1) 00:16:00.874 10.572 - 10.619: 98.7162% ( 1) 00:16:00.874 10.667 - 10.714: 98.7308% ( 2) 00:16:00.874 10.761 - 10.809: 98.7455% ( 2) 00:16:00.874 11.046 - 11.093: 98.7528% ( 1) 00:16:00.874 11.188 - 11.236: 98.7602% ( 1) 00:16:00.874 11.330 - 11.378: 98.7749% ( 2) 00:16:00.874 11.425 - 11.473: 98.7822% ( 1) 00:16:00.874 11.520 - 11.567: 98.7895% ( 1) 00:16:00.874 11.567 - 11.615: 98.8042% ( 2) 00:16:00.874 11.615 - 11.662: 98.8115% ( 1) 00:16:00.874 11.710 - 11.757: 98.8335% ( 3) 00:16:00.874 11.947 - 11.994: 98.8409% ( 1) 00:16:00.874 12.136 - 12.231: 98.8629% ( 3) 00:16:00.874 12.231 - 12.326: 98.8776% ( 2) 00:16:00.874 12.326 - 12.421: 98.8849% ( 1) 00:16:00.874 12.421 - 12.516: 98.8922% ( 1) 00:16:00.874 12.705 - 12.800: 98.8996% ( 1) 00:16:00.874 12.800 - 12.895: 98.9069% ( 1) 00:16:00.874 13.274 - 13.369: 98.9142% ( 1) 00:16:00.874 13.369 - 13.464: 98.9216% ( 1) 00:16:00.874 13.464 - 13.559: 98.9289% ( 1) 00:16:00.874 13.938 - 14.033: 98.9362% ( 1) 00:16:00.874 14.127 - 14.222: 98.9509% ( 2) 00:16:00.874 14.222 - 14.317: 98.9656% ( 2) 00:16:00.874 14.507 - 14.601: 98.9729% ( 1) 00:16:00.874 14.601 - 14.696: 98.9803% ( 1) 00:16:00.874 14.696 - 14.791: 98.9949% ( 2) 00:16:00.874 14.791 - 14.886: 99.0096% ( 2) 00:16:00.874 14.981 - 15.076: 99.0169% ( 1) 00:16:00.874 15.739 - 15.834: 99.0243% ( 1) 00:16:00.874 17.067 - 17.161: 99.0463% ( 3) 00:16:00.874 17.161 - 17.256: 99.0536% ( 1) 00:16:00.874 17.256 - 17.351: 99.0976% ( 6) 00:16:00.874 17.351 - 17.446: 99.1050% ( 1) 00:16:00.874 17.446 - 17.541: 99.1270% ( 3) 00:16:00.874 17.541 - 17.636: 99.1637% ( 5) 00:16:00.874 17.636 - 17.730: 99.2297% ( 9) 00:16:00.874 17.730 - 17.825: 99.2664% ( 5) 00:16:00.874 17.825 - 17.920: 99.2957% ( 4) 00:16:00.874 17.920 - 18.015: 99.3324% ( 5) 00:16:00.874 18.015 - 18.110: 99.3911% ( 8) 00:16:00.874 18.110 - 18.204: 99.4645% ( 10) 00:16:00.874 18.204 - 18.299: 99.5598% ( 13) 00:16:00.874 18.299 - 18.394: 99.6185% ( 8) 00:16:00.874 18.394 - 18.489: 99.6699% ( 7) 00:16:00.874 18.489 - 18.584: 99.6772% ( 1) 00:16:00.874 18.584 - 18.679: 99.7139% ( 5) 00:16:00.875 18.679 - 18.773: 99.7286% ( 2) 00:16:00.875 18.773 - 18.868: 99.7726% ( 6) 00:16:00.875 18.868 - 18.963: 99.7872% ( 2) 00:16:00.875 18.963 - 19.058: 99.7946% ( 1) 00:16:00.875 19.058 - 19.153: 99.8166% ( 3) 00:16:00.875 19.153 - 19.247: 99.8239% ( 1) 00:16:00.875 19.437 - 19.532: 99.8313% ( 1) 00:16:00.875 19.627 - 19.721: 99.8386% ( 1) 00:16:00.875 19.721 - 19.816: 99.8459% ( 1) 00:16:00.875 20.101 - 20.196: 99.8533% ( 1) 00:16:00.875 21.144 - 21.239: 99.8606% ( 1) 00:16:00.875 21.239 - 21.333: 99.8679% ( 1) 00:16:00.875 22.566 - 22.661: 99.8753% ( 1) 00:16:00.875 23.230 - 23.324: 99.8900% ( 2) 00:16:00.875 23.988 - 24.083: 99.8973% ( 1) 00:16:00.875 24.083 - 24.178: 99.9046% ( 1) 00:16:00.875 27.496 - 27.686: 99.9120% ( 1) 00:16:00.875 28.255 - 28.444: 99.9193% ( 1) 00:16:00.875 3980.705 - 4004.978: 99.9780% ( 8) 00:16:00.875 4004.978 - 4029.250: 100.0000% ( 3) 00:16:00.875 00:16:00.875 Complete histogram 00:16:00.875 ================== 00:16:00.875 Range in us Cumulative Count 00:16:00.875 2.050 - 2.062: 0.3962% ( 54) 00:16:00.875 2.062 - 2.074: 11.2171% ( 1475) 00:16:00.875 2.074 - 2.086: 17.9297% ( 915) 00:16:00.875 2.086 - 2.098: 22.8450% ( 670) 00:16:00.875 2.098 - 2.110: 52.5420% ( 4048) 00:16:00.875 2.110 - 2.121: 62.1158% ( 1305) 00:16:00.875 2.121 - 2.133: 63.9938% ( 256) 00:16:00.875 2.133 - 2.145: 67.2805% ( 448) 00:16:00.875 2.145 - 2.157: 68.5716% ( 176) 00:16:00.875 2.157 - 2.169: 72.2764% ( 505) 00:16:00.875 2.169 - 2.181: 80.6691% ( 1144) 00:16:00.875 2.181 - 2.193: 83.5375% ( 391) 00:16:00.875 2.193 - 2.204: 85.1148% ( 215) 00:16:00.875 2.204 - 2.216: 86.7508% ( 223) 00:16:00.875 2.216 - 2.228: 87.6018% ( 116) 00:16:00.875 2.228 - 2.240: 89.6486% ( 279) 00:16:00.875 2.240 - 2.252: 92.9792% ( 454) 00:16:00.875 2.252 - 2.264: 94.1237% ( 156) 00:16:00.875 2.264 - 2.276: 94.6299% ( 69) 00:16:00.875 2.276 - 2.287: 95.0040% ( 51) 00:16:00.875 2.287 - 2.299: 95.2168% ( 29) 00:16:00.875 2.299 - 2.311: 95.5616% ( 47) 00:16:00.875 2.311 - 2.323: 95.8184% ( 35) 00:16:00.875 2.323 - 2.335: 95.8844% ( 9) 00:16:00.875 2.335 - 2.347: 95.9944% ( 15) 00:16:00.875 2.347 - 2.359: 96.2218% ( 31) 00:16:00.875 2.359 - 2.370: 96.5226% ( 41) 00:16:00.875 2.370 - 2.382: 96.7721% ( 34) 00:16:00.875 2.382 - 2.394: 97.0875% ( 43) 00:16:00.875 2.394 - 2.406: 97.4470% ( 49) 00:16:00.875 2.406 - 2.418: 97.6157% ( 23) 00:16:00.875 2.418 - 2.430: 97.7918% ( 24) 00:16:00.875 2.430 - 2.441: 98.0119% ( 30) 00:16:00.875 2.441 - 2.453: 98.1219% ( 15) 00:16:00.875 2.453 - 2.465: 98.1953% ( 10) 00:16:00.875 2.465 - 2.477: 98.2540% ( 8) 00:16:00.875 2.477 - 2.489: 98.3347% ( 11) 00:16:00.875 2.489 - 2.501: 98.3787% ( 6) 00:16:00.875 2.501 - 2.513: 98.4300% ( 7) 00:16:00.875 2.513 - 2.524: 98.4667% ( 5) 00:16:00.875 2.524 - 2.536: 98.4741% ( 1) 00:16:00.875 2.548 - 2.560: 98.4887% ( 2) 00:16:00.875 2.607 - 2.619: 98.4961% ( 1) 00:16:00.875 2.619 - 2.631: 98.5034% ( 1) 00:16:00.875 2.643 - 2.655: 98.5107% ( 1) 00:16:00.875 2.667 - 2.679: 98.5181% ( 1) 00:16:00.875 2.702 - 2.714: 98.5254% ( 1) 00:16:00.875 2.761 - 2.773: 98.5328% ( 1) 00:16:00.875 2.773 - 2.785: 98.5401% ( 1) 00:16:00.875 2.785 - 2.797: 98.5474% ( 1) 00:16:00.875 2.916 - 2.927: 98.5548% ( 1) 00:16:00.875 3.247 - 3.271: 98.5621% ( 1) 00:16:00.875 3.295 - 3.319: 98.5694% ( 1) 00:16:00.875 3.319 - 3.342: 98.5768% ( 1) 00:16:00.875 3.342 - 3.366: 98.5841% ( 1) 00:16:00.875 3.366 - 3.390: 98.6208% ( 5) 00:16:00.875 3.413 - 3.437: 98.6281% ( 1) 00:16:00.875 3.437 - 3.461: 98.6355% ( 1) 00:16:00.875 3.461 - 3.484: 98.6575% ( 3) 00:16:00.875 3.484 - 3.508: 98.6721% ( 2) 00:16:00.875 3.508 - 3.532: 98.6868% ( 2) 00:16:00.875 3.556 - 3.579: 98.6942% ( 1) 00:16:00.875 3.579 - 3.603: 98.7088% ( 2) 00:16:00.875 3.603 - 3.627: 98.7162% ( 1) 00:16:00.875 3.627 - 3.650: 98.7235% ( 1) 00:16:00.875 3.650 - 3.674: 98.7308% ( 1) 00:16:00.875 3.674 - 3.698: 98.7455% ( 2) 00:16:00.875 3.745 - 3.769: 98.7528% ( 1) 00:16:00.875 3.887 - 3.911: 98.7602% ( 1) 00:16:00.875 4.219 - 4.243: 98.7675% ( 1) 00:16:00.875 5.120 - 5.144: 98.7749% ( 1) 00:16:00.875 5.831 - 5.855: 98.7822% ( 1) 00:16:00.875 6.116 - 6.163: 98.7895% ( 1) 00:16:00.875 6.353 - 6.400: 98.8042% ( 2) 00:16:00.875 6.447 - 6.495: 98.8115% ( 1) 00:16:00.875 6.495 - 6.542: 98.8189% ( 1) 00:16:00.875 6.779 - 6.827: 98.8262% ( 1) 00:16:00.875 6.969 - 7.016: 98.8335% ( 1) 00:16:00.875 7.016 - 7.064: 98.8409% ( 1) 00:16:00.875 7.159 - 7.206: 98.8482% ( 1) 00:16:00.875 7.301 - 7.348: 98.8555% ( 1) 00:16:00.875 7.443 - 7.490: 98.8629% ( 1) 00:16:00.875 7.490 - 7.538: 98.8702% ( 1) 00:16:00.875 7.585 - 7.633: 98.8776% ( 1) 00:16:00.875 7.964 - 8.012: 98.8849% ( 1) 00:16:00.875 9.434 - 9.481: 98.8922% ( 1) 00:16:00.875 15.170 - 15.265: 98.8996% ( 1) 00:16:00.875 15.550 - 15.644: 98.9069% ( 1) 00:16:00.875 15.644 - 15.739: 98.9216% ( 2) 00:16:00.875 15.739 - 15.834: 98.9509% ( 4) 00:16:00.875 15.834 - 15.929: 98.9803% ( 4) 00:16:00.875 15.929 - 16.024: 99.0023% ( 3) 00:16:00.875 16.024 - 16.119: 99.0169% ( 2) 00:16:00.875 16.119 - 16.213: 99.0390% ( 3) 00:16:00.875 16.213 - 16.308: 99.0536% ( 2) 00:16:00.875 16.308 - 16.403: 99.0610% ( 1) 00:16:00.875 16.403 - 16.498: 99.0830% ( 3) 00:16:00.875 16.498 - 16.593: 99.1343% ( 7) 00:16:00.875 16.593 - 16.687: 99.2150% ( 11) 00:16:00.875 16.687 - 16.782: 99.2664% ( 7) 00:16:00.875 16.782 - 16.877: 99.2957% ( 4) 00:16:00.875 16.877 - 16.972: 99.3251% ( 4) 00:16:00.875 17.067 - 17.161: 99.3471% ( 3) 00:16:00.875 17.161 - 17.256: 99.3617% ( 2) 00:16:00.875 17.446 - 17.541: 99.3764% ( 2) 00:16:00.875 17.541 - 17.636: 99.3838% ( 1) 00:16:00.875 17.636 - 17.730: 99.3911% ( 1) 00:16:00.875 18.015 - 18.110: 99.3984% ( 1) 00:16:00.875 18.584 - 18.679: 99.4058% ( 1) 00:16:00.875 21.239 - 21.333: 99.4131% ( 1) 00:16:00.875 23.135 - 23.230: 99.4204% ( 1) 00:16:00.875 1159.016 - 1165.084: 99.4278% ( 1) 00:16:00.875 2014.625 - 2026.761: 99.4351% ( 1) 00:16:00.875 3980.705 - 4004.978: 99.8679% ( 59) 00:16:00.875 4004.978 - 4029.250: 99.9927% ( 17) 00:16:00.875 6990.507 - 7039.052: 100.0000% ( 1) 00:16:00.875 00:16:00.875 16:02:24 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:16:00.875 16:02:24 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:16:00.875 16:02:24 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:16:00.875 16:02:24 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:16:00.875 16:02:24 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:01.134 [2024-11-18 16:02:24.587639] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:16:01.134 [ 00:16:01.134 { 00:16:01.134 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:01.134 "subtype": "Discovery", 00:16:01.134 "listen_addresses": [], 00:16:01.134 "allow_any_host": true, 00:16:01.134 "hosts": [] 00:16:01.134 }, 00:16:01.134 { 00:16:01.134 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:01.134 "subtype": "NVMe", 00:16:01.134 "listen_addresses": [ 00:16:01.134 { 00:16:01.134 "transport": "VFIOUSER", 00:16:01.134 "trtype": "VFIOUSER", 00:16:01.134 "adrfam": "IPv4", 00:16:01.134 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:01.134 "trsvcid": "0" 00:16:01.134 } 00:16:01.134 ], 00:16:01.134 "allow_any_host": true, 00:16:01.134 "hosts": [], 00:16:01.134 "serial_number": "SPDK1", 00:16:01.134 "model_number": "SPDK bdev Controller", 00:16:01.134 "max_namespaces": 32, 00:16:01.134 "min_cntlid": 1, 00:16:01.134 "max_cntlid": 65519, 00:16:01.134 "namespaces": [ 00:16:01.134 { 00:16:01.134 "nsid": 1, 00:16:01.134 "bdev_name": "Malloc1", 00:16:01.134 "name": "Malloc1", 00:16:01.134 "nguid": "2342FB00FB89410EACBEBCFB705F2E6B", 00:16:01.134 "uuid": "2342fb00-fb89-410e-acbe-bcfb705f2e6b" 00:16:01.134 } 00:16:01.134 ] 00:16:01.134 }, 00:16:01.134 { 00:16:01.134 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:01.134 "subtype": "NVMe", 00:16:01.134 "listen_addresses": [ 00:16:01.134 { 00:16:01.134 "transport": "VFIOUSER", 00:16:01.134 "trtype": "VFIOUSER", 00:16:01.134 "adrfam": "IPv4", 00:16:01.134 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:01.134 "trsvcid": "0" 00:16:01.134 } 00:16:01.134 ], 00:16:01.134 "allow_any_host": true, 00:16:01.134 "hosts": [], 00:16:01.134 "serial_number": "SPDK2", 00:16:01.134 "model_number": "SPDK bdev Controller", 00:16:01.134 "max_namespaces": 32, 00:16:01.134 "min_cntlid": 1, 00:16:01.134 "max_cntlid": 65519, 00:16:01.134 "namespaces": [ 00:16:01.134 { 00:16:01.134 "nsid": 1, 00:16:01.134 "bdev_name": "Malloc2", 00:16:01.134 "name": "Malloc2", 00:16:01.134 "nguid": "D05424EB26DD4B0D895D7DACC1D896E4", 00:16:01.134 "uuid": "d05424eb-26dd-4b0d-895d-7dacc1d896e4" 00:16:01.134 } 00:16:01.134 ] 00:16:01.134 } 00:16:01.134 ] 00:16:01.134 16:02:24 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:01.134 16:02:24 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1560219 00:16:01.134 16:02:24 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:16:01.134 16:02:24 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:01.134 16:02:24 -- common/autotest_common.sh@1254 -- # local i=0 00:16:01.134 16:02:24 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:01.134 16:02:24 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:01.134 16:02:24 -- common/autotest_common.sh@1265 -- # return 0 00:16:01.134 16:02:24 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:01.134 16:02:24 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:16:01.134 EAL: No free 2048 kB hugepages reported on node 1 00:16:01.392 Malloc3 00:16:01.392 16:02:24 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:16:01.650 16:02:25 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:01.650 Asynchronous Event Request test 00:16:01.650 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:16:01.650 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:16:01.650 Registering asynchronous event callbacks... 00:16:01.650 Starting namespace attribute notice tests for all controllers... 00:16:01.650 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:01.650 aer_cb - Changed Namespace 00:16:01.650 Cleaning up... 00:16:01.908 [ 00:16:01.908 { 00:16:01.908 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:01.908 "subtype": "Discovery", 00:16:01.908 "listen_addresses": [], 00:16:01.908 "allow_any_host": true, 00:16:01.908 "hosts": [] 00:16:01.908 }, 00:16:01.908 { 00:16:01.908 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:01.908 "subtype": "NVMe", 00:16:01.908 "listen_addresses": [ 00:16:01.908 { 00:16:01.908 "transport": "VFIOUSER", 00:16:01.908 "trtype": "VFIOUSER", 00:16:01.908 "adrfam": "IPv4", 00:16:01.908 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:01.908 "trsvcid": "0" 00:16:01.908 } 00:16:01.908 ], 00:16:01.908 "allow_any_host": true, 00:16:01.908 "hosts": [], 00:16:01.908 "serial_number": "SPDK1", 00:16:01.908 "model_number": "SPDK bdev Controller", 00:16:01.908 "max_namespaces": 32, 00:16:01.908 "min_cntlid": 1, 00:16:01.908 "max_cntlid": 65519, 00:16:01.908 "namespaces": [ 00:16:01.908 { 00:16:01.908 "nsid": 1, 00:16:01.908 "bdev_name": "Malloc1", 00:16:01.908 "name": "Malloc1", 00:16:01.908 "nguid": "2342FB00FB89410EACBEBCFB705F2E6B", 00:16:01.908 "uuid": "2342fb00-fb89-410e-acbe-bcfb705f2e6b" 00:16:01.908 }, 00:16:01.908 { 00:16:01.908 "nsid": 2, 00:16:01.908 "bdev_name": "Malloc3", 00:16:01.908 "name": "Malloc3", 00:16:01.908 "nguid": "3CA6E58956864B569BEC44ABA8961B1F", 00:16:01.908 "uuid": "3ca6e589-5686-4b56-9bec-44aba8961b1f" 00:16:01.908 } 00:16:01.908 ] 00:16:01.908 }, 00:16:01.908 { 00:16:01.908 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:01.908 "subtype": "NVMe", 00:16:01.908 "listen_addresses": [ 00:16:01.908 { 00:16:01.908 "transport": "VFIOUSER", 00:16:01.908 "trtype": "VFIOUSER", 00:16:01.908 "adrfam": "IPv4", 00:16:01.908 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:01.908 "trsvcid": "0" 00:16:01.908 } 00:16:01.908 ], 00:16:01.908 "allow_any_host": true, 00:16:01.908 "hosts": [], 00:16:01.908 "serial_number": "SPDK2", 00:16:01.908 "model_number": "SPDK bdev Controller", 00:16:01.908 "max_namespaces": 32, 00:16:01.908 "min_cntlid": 1, 00:16:01.908 "max_cntlid": 65519, 00:16:01.908 "namespaces": [ 00:16:01.908 { 00:16:01.908 "nsid": 1, 00:16:01.908 "bdev_name": "Malloc2", 00:16:01.908 "name": "Malloc2", 00:16:01.908 "nguid": "D05424EB26DD4B0D895D7DACC1D896E4", 00:16:01.908 "uuid": "d05424eb-26dd-4b0d-895d-7dacc1d896e4" 00:16:01.908 } 00:16:01.908 ] 00:16:01.908 } 00:16:01.908 ] 00:16:01.908 16:02:25 -- target/nvmf_vfio_user.sh@44 -- # wait 1560219 00:16:01.908 16:02:25 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:01.908 16:02:25 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:01.908 16:02:25 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:16:01.908 16:02:25 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:16:01.908 [2024-11-18 16:02:25.451848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:01.908 [2024-11-18 16:02:25.451901] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1560354 ] 00:16:01.908 EAL: No free 2048 kB hugepages reported on node 1 00:16:01.908 [2024-11-18 16:02:25.485741] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:16:01.908 [2024-11-18 16:02:25.494760] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:01.908 [2024-11-18 16:02:25.494791] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f40fff18000 00:16:01.908 [2024-11-18 16:02:25.495763] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:01.908 [2024-11-18 16:02:25.496772] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:01.908 [2024-11-18 16:02:25.497779] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:02.167 [2024-11-18 16:02:25.498793] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:02.167 [2024-11-18 16:02:25.499807] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:02.167 [2024-11-18 16:02:25.500812] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:02.167 [2024-11-18 16:02:25.501820] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:16:02.167 [2024-11-18 16:02:25.502830] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:16:02.168 [2024-11-18 16:02:25.503834] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:16:02.168 [2024-11-18 16:02:25.503856] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f40fec10000 00:16:02.168 [2024-11-18 16:02:25.505036] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:02.168 [2024-11-18 16:02:25.520310] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:16:02.168 [2024-11-18 16:02:25.520345] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:16:02.168 [2024-11-18 16:02:25.525462] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:02.168 [2024-11-18 16:02:25.525517] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:16:02.168 [2024-11-18 16:02:25.525638] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:16:02.168 [2024-11-18 16:02:25.525678] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:16:02.168 [2024-11-18 16:02:25.525689] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:16:02.168 [2024-11-18 16:02:25.526465] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:16:02.168 [2024-11-18 16:02:25.526486] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:16:02.168 [2024-11-18 16:02:25.526498] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:16:02.168 [2024-11-18 16:02:25.527471] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:16:02.168 [2024-11-18 16:02:25.527490] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:16:02.168 [2024-11-18 16:02:25.527504] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:16:02.168 [2024-11-18 16:02:25.528475] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:16:02.168 [2024-11-18 16:02:25.528496] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:16:02.168 [2024-11-18 16:02:25.529478] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:16:02.168 [2024-11-18 16:02:25.529498] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:16:02.168 [2024-11-18 16:02:25.529507] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:16:02.168 [2024-11-18 16:02:25.529519] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:16:02.168 [2024-11-18 16:02:25.529629] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:16:02.168 [2024-11-18 16:02:25.529640] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:16:02.168 [2024-11-18 16:02:25.529654] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:16:02.168 [2024-11-18 16:02:25.530484] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:16:02.168 [2024-11-18 16:02:25.531488] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:16:02.168 [2024-11-18 16:02:25.532494] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:02.168 [2024-11-18 16:02:25.533531] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:16:02.168 [2024-11-18 16:02:25.534508] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:16:02.168 [2024-11-18 16:02:25.534527] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:16:02.168 [2024-11-18 16:02:25.534537] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.534560] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:16:02.168 [2024-11-18 16:02:25.534574] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.534619] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:02.168 [2024-11-18 16:02:25.534632] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:02.168 [2024-11-18 16:02:25.534653] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:02.168 [2024-11-18 16:02:25.542626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:16:02.168 [2024-11-18 16:02:25.542649] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:16:02.168 [2024-11-18 16:02:25.542659] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:16:02.168 [2024-11-18 16:02:25.542667] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:16:02.168 [2024-11-18 16:02:25.542675] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:16:02.168 [2024-11-18 16:02:25.542684] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:16:02.168 [2024-11-18 16:02:25.542691] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:16:02.168 [2024-11-18 16:02:25.542699] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.542717] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.542735] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:16:02.168 [2024-11-18 16:02:25.550636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:16:02.168 [2024-11-18 16:02:25.550665] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:16:02.168 [2024-11-18 16:02:25.550684] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:16:02.168 [2024-11-18 16:02:25.550697] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:16:02.168 [2024-11-18 16:02:25.550709] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:16:02.168 [2024-11-18 16:02:25.550718] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.550733] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.550748] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:16:02.168 [2024-11-18 16:02:25.558633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:16:02.168 [2024-11-18 16:02:25.558651] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:16:02.168 [2024-11-18 16:02:25.558660] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.558672] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.558686] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.558701] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:02.168 [2024-11-18 16:02:25.566636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:16:02.168 [2024-11-18 16:02:25.566706] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.566721] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.566733] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:16:02.168 [2024-11-18 16:02:25.566742] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:16:02.168 [2024-11-18 16:02:25.566751] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:16:02.168 [2024-11-18 16:02:25.574619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:16:02.168 [2024-11-18 16:02:25.574648] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:16:02.168 [2024-11-18 16:02:25.574676] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.574691] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.574704] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:02.168 [2024-11-18 16:02:25.574712] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:02.168 [2024-11-18 16:02:25.574722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:02.168 [2024-11-18 16:02:25.582619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:16:02.168 [2024-11-18 16:02:25.582657] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.582675] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:16:02.168 [2024-11-18 16:02:25.582688] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:16:02.169 [2024-11-18 16:02:25.582697] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:02.169 [2024-11-18 16:02:25.582707] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:02.169 [2024-11-18 16:02:25.590634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:16:02.169 [2024-11-18 16:02:25.590656] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:16:02.169 [2024-11-18 16:02:25.590669] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:16:02.169 [2024-11-18 16:02:25.590684] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:16:02.169 [2024-11-18 16:02:25.590696] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:16:02.169 [2024-11-18 16:02:25.590704] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:16:02.169 [2024-11-18 16:02:25.590713] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:16:02.169 [2024-11-18 16:02:25.590720] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:16:02.169 [2024-11-18 16:02:25.590729] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:16:02.169 [2024-11-18 16:02:25.590754] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:16:02.169 [2024-11-18 16:02:25.598636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:16:02.169 [2024-11-18 16:02:25.598661] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:16:02.169 [2024-11-18 16:02:25.606618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:16:02.169 [2024-11-18 16:02:25.606643] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:16:02.169 [2024-11-18 16:02:25.614616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:16:02.169 [2024-11-18 16:02:25.614642] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:16:02.169 [2024-11-18 16:02:25.622620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:16:02.169 [2024-11-18 16:02:25.622650] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:16:02.169 [2024-11-18 16:02:25.622660] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:16:02.169 [2024-11-18 16:02:25.622666] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:16:02.169 [2024-11-18 16:02:25.622676] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:16:02.169 [2024-11-18 16:02:25.622687] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:16:02.169 [2024-11-18 16:02:25.622701] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:16:02.169 [2024-11-18 16:02:25.622709] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:16:02.169 [2024-11-18 16:02:25.622718] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:16:02.169 [2024-11-18 16:02:25.622729] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:16:02.169 [2024-11-18 16:02:25.622737] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:16:02.169 [2024-11-18 16:02:25.622746] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:16:02.169 [2024-11-18 16:02:25.622758] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:16:02.169 [2024-11-18 16:02:25.622766] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:16:02.169 [2024-11-18 16:02:25.622774] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:16:02.169 [2024-11-18 16:02:25.627384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:16:02.169 [2024-11-18 16:02:25.627416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:16:02.169 [2024-11-18 16:02:25.627433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:16:02.169 [2024-11-18 16:02:25.627444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:16:02.169 ===================================================== 00:16:02.169 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:02.169 ===================================================== 00:16:02.169 Controller Capabilities/Features 00:16:02.169 ================================ 00:16:02.169 Vendor ID: 4e58 00:16:02.169 Subsystem Vendor ID: 4e58 00:16:02.169 Serial Number: SPDK2 00:16:02.169 Model Number: SPDK bdev Controller 00:16:02.169 Firmware Version: 24.01.1 00:16:02.169 Recommended Arb Burst: 6 00:16:02.169 IEEE OUI Identifier: 8d 6b 50 00:16:02.169 Multi-path I/O 00:16:02.169 May have multiple subsystem ports: Yes 00:16:02.169 May have multiple controllers: Yes 00:16:02.169 Associated with SR-IOV VF: No 00:16:02.169 Max Data Transfer Size: 131072 00:16:02.169 Max Number of Namespaces: 32 00:16:02.169 Max Number of I/O Queues: 127 00:16:02.169 NVMe Specification Version (VS): 1.3 00:16:02.169 NVMe Specification Version (Identify): 1.3 00:16:02.169 Maximum Queue Entries: 256 00:16:02.169 Contiguous Queues Required: Yes 00:16:02.169 Arbitration Mechanisms Supported 00:16:02.169 Weighted Round Robin: Not Supported 00:16:02.169 Vendor Specific: Not Supported 00:16:02.169 Reset Timeout: 15000 ms 00:16:02.169 Doorbell Stride: 4 bytes 00:16:02.169 NVM Subsystem Reset: Not Supported 00:16:02.169 Command Sets Supported 00:16:02.169 NVM Command Set: Supported 00:16:02.169 Boot Partition: Not Supported 00:16:02.169 Memory Page Size Minimum: 4096 bytes 00:16:02.169 Memory Page Size Maximum: 4096 bytes 00:16:02.169 Persistent Memory Region: Not Supported 00:16:02.169 Optional Asynchronous Events Supported 00:16:02.169 Namespace Attribute Notices: Supported 00:16:02.169 Firmware Activation Notices: Not Supported 00:16:02.169 ANA Change Notices: Not Supported 00:16:02.169 PLE Aggregate Log Change Notices: Not Supported 00:16:02.169 LBA Status Info Alert Notices: Not Supported 00:16:02.169 EGE Aggregate Log Change Notices: Not Supported 00:16:02.169 Normal NVM Subsystem Shutdown event: Not Supported 00:16:02.169 Zone Descriptor Change Notices: Not Supported 00:16:02.169 Discovery Log Change Notices: Not Supported 00:16:02.169 Controller Attributes 00:16:02.169 128-bit Host Identifier: Supported 00:16:02.169 Non-Operational Permissive Mode: Not Supported 00:16:02.169 NVM Sets: Not Supported 00:16:02.169 Read Recovery Levels: Not Supported 00:16:02.169 Endurance Groups: Not Supported 00:16:02.169 Predictable Latency Mode: Not Supported 00:16:02.169 Traffic Based Keep ALive: Not Supported 00:16:02.169 Namespace Granularity: Not Supported 00:16:02.169 SQ Associations: Not Supported 00:16:02.169 UUID List: Not Supported 00:16:02.169 Multi-Domain Subsystem: Not Supported 00:16:02.169 Fixed Capacity Management: Not Supported 00:16:02.169 Variable Capacity Management: Not Supported 00:16:02.169 Delete Endurance Group: Not Supported 00:16:02.169 Delete NVM Set: Not Supported 00:16:02.169 Extended LBA Formats Supported: Not Supported 00:16:02.169 Flexible Data Placement Supported: Not Supported 00:16:02.169 00:16:02.169 Controller Memory Buffer Support 00:16:02.169 ================================ 00:16:02.169 Supported: No 00:16:02.169 00:16:02.169 Persistent Memory Region Support 00:16:02.169 ================================ 00:16:02.169 Supported: No 00:16:02.169 00:16:02.169 Admin Command Set Attributes 00:16:02.169 ============================ 00:16:02.169 Security Send/Receive: Not Supported 00:16:02.169 Format NVM: Not Supported 00:16:02.169 Firmware Activate/Download: Not Supported 00:16:02.169 Namespace Management: Not Supported 00:16:02.169 Device Self-Test: Not Supported 00:16:02.169 Directives: Not Supported 00:16:02.169 NVMe-MI: Not Supported 00:16:02.169 Virtualization Management: Not Supported 00:16:02.169 Doorbell Buffer Config: Not Supported 00:16:02.169 Get LBA Status Capability: Not Supported 00:16:02.169 Command & Feature Lockdown Capability: Not Supported 00:16:02.169 Abort Command Limit: 4 00:16:02.169 Async Event Request Limit: 4 00:16:02.169 Number of Firmware Slots: N/A 00:16:02.169 Firmware Slot 1 Read-Only: N/A 00:16:02.169 Firmware Activation Without Reset: N/A 00:16:02.169 Multiple Update Detection Support: N/A 00:16:02.169 Firmware Update Granularity: No Information Provided 00:16:02.169 Per-Namespace SMART Log: No 00:16:02.169 Asymmetric Namespace Access Log Page: Not Supported 00:16:02.169 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:16:02.169 Command Effects Log Page: Supported 00:16:02.169 Get Log Page Extended Data: Supported 00:16:02.169 Telemetry Log Pages: Not Supported 00:16:02.169 Persistent Event Log Pages: Not Supported 00:16:02.169 Supported Log Pages Log Page: May Support 00:16:02.169 Commands Supported & Effects Log Page: Not Supported 00:16:02.169 Feature Identifiers & Effects Log Page:May Support 00:16:02.169 NVMe-MI Commands & Effects Log Page: May Support 00:16:02.170 Data Area 4 for Telemetry Log: Not Supported 00:16:02.170 Error Log Page Entries Supported: 128 00:16:02.170 Keep Alive: Supported 00:16:02.170 Keep Alive Granularity: 10000 ms 00:16:02.170 00:16:02.170 NVM Command Set Attributes 00:16:02.170 ========================== 00:16:02.170 Submission Queue Entry Size 00:16:02.170 Max: 64 00:16:02.170 Min: 64 00:16:02.170 Completion Queue Entry Size 00:16:02.170 Max: 16 00:16:02.170 Min: 16 00:16:02.170 Number of Namespaces: 32 00:16:02.170 Compare Command: Supported 00:16:02.170 Write Uncorrectable Command: Not Supported 00:16:02.170 Dataset Management Command: Supported 00:16:02.170 Write Zeroes Command: Supported 00:16:02.170 Set Features Save Field: Not Supported 00:16:02.170 Reservations: Not Supported 00:16:02.170 Timestamp: Not Supported 00:16:02.170 Copy: Supported 00:16:02.170 Volatile Write Cache: Present 00:16:02.170 Atomic Write Unit (Normal): 1 00:16:02.170 Atomic Write Unit (PFail): 1 00:16:02.170 Atomic Compare & Write Unit: 1 00:16:02.170 Fused Compare & Write: Supported 00:16:02.170 Scatter-Gather List 00:16:02.170 SGL Command Set: Supported (Dword aligned) 00:16:02.170 SGL Keyed: Not Supported 00:16:02.170 SGL Bit Bucket Descriptor: Not Supported 00:16:02.170 SGL Metadata Pointer: Not Supported 00:16:02.170 Oversized SGL: Not Supported 00:16:02.170 SGL Metadata Address: Not Supported 00:16:02.170 SGL Offset: Not Supported 00:16:02.170 Transport SGL Data Block: Not Supported 00:16:02.170 Replay Protected Memory Block: Not Supported 00:16:02.170 00:16:02.170 Firmware Slot Information 00:16:02.170 ========================= 00:16:02.170 Active slot: 1 00:16:02.170 Slot 1 Firmware Revision: 24.01.1 00:16:02.170 00:16:02.170 00:16:02.170 Commands Supported and Effects 00:16:02.170 ============================== 00:16:02.170 Admin Commands 00:16:02.170 -------------- 00:16:02.170 Get Log Page (02h): Supported 00:16:02.170 Identify (06h): Supported 00:16:02.170 Abort (08h): Supported 00:16:02.170 Set Features (09h): Supported 00:16:02.170 Get Features (0Ah): Supported 00:16:02.170 Asynchronous Event Request (0Ch): Supported 00:16:02.170 Keep Alive (18h): Supported 00:16:02.170 I/O Commands 00:16:02.170 ------------ 00:16:02.170 Flush (00h): Supported LBA-Change 00:16:02.170 Write (01h): Supported LBA-Change 00:16:02.170 Read (02h): Supported 00:16:02.170 Compare (05h): Supported 00:16:02.170 Write Zeroes (08h): Supported LBA-Change 00:16:02.170 Dataset Management (09h): Supported LBA-Change 00:16:02.170 Copy (19h): Supported LBA-Change 00:16:02.170 Unknown (79h): Supported LBA-Change 00:16:02.170 Unknown (7Ah): Supported 00:16:02.170 00:16:02.170 Error Log 00:16:02.170 ========= 00:16:02.170 00:16:02.170 Arbitration 00:16:02.170 =========== 00:16:02.170 Arbitration Burst: 1 00:16:02.170 00:16:02.170 Power Management 00:16:02.170 ================ 00:16:02.170 Number of Power States: 1 00:16:02.170 Current Power State: Power State #0 00:16:02.170 Power State #0: 00:16:02.170 Max Power: 0.00 W 00:16:02.170 Non-Operational State: Operational 00:16:02.170 Entry Latency: Not Reported 00:16:02.170 Exit Latency: Not Reported 00:16:02.170 Relative Read Throughput: 0 00:16:02.170 Relative Read Latency: 0 00:16:02.170 Relative Write Throughput: 0 00:16:02.170 Relative Write Latency: 0 00:16:02.170 Idle Power: Not Reported 00:16:02.170 Active Power: Not Reported 00:16:02.170 Non-Operational Permissive Mode: Not Supported 00:16:02.170 00:16:02.170 Health Information 00:16:02.170 ================== 00:16:02.170 Critical Warnings: 00:16:02.170 Available Spare Space: OK 00:16:02.170 Temperature: OK 00:16:02.170 Device Reliability: OK 00:16:02.170 Read Only: No 00:16:02.170 Volatile Memory Backup: OK 00:16:02.170 Current Temperature: 0 Kelvin[2024-11-18 16:02:25.627565] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:16:02.170 [2024-11-18 16:02:25.633623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:16:02.170 [2024-11-18 16:02:25.633668] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:16:02.170 [2024-11-18 16:02:25.633686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:02.170 [2024-11-18 16:02:25.633697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:02.170 [2024-11-18 16:02:25.633706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:02.170 [2024-11-18 16:02:25.633716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:02.170 [2024-11-18 16:02:25.637621] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:16:02.170 [2024-11-18 16:02:25.637643] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:16:02.170 [2024-11-18 16:02:25.637834] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:16:02.170 [2024-11-18 16:02:25.637849] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:16:02.170 [2024-11-18 16:02:25.638800] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:16:02.170 [2024-11-18 16:02:25.638828] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:16:02.170 [2024-11-18 16:02:25.638881] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:16:02.170 [2024-11-18 16:02:25.640069] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:16:02.170 (-273 Celsius) 00:16:02.170 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:16:02.170 Available Spare: 0% 00:16:02.170 Available Spare Threshold: 0% 00:16:02.170 Life Percentage Used: 0% 00:16:02.170 Data Units Read: 0 00:16:02.170 Data Units Written: 0 00:16:02.170 Host Read Commands: 0 00:16:02.170 Host Write Commands: 0 00:16:02.170 Controller Busy Time: 0 minutes 00:16:02.170 Power Cycles: 0 00:16:02.170 Power On Hours: 0 hours 00:16:02.170 Unsafe Shutdowns: 0 00:16:02.170 Unrecoverable Media Errors: 0 00:16:02.170 Lifetime Error Log Entries: 0 00:16:02.170 Warning Temperature Time: 0 minutes 00:16:02.170 Critical Temperature Time: 0 minutes 00:16:02.170 00:16:02.170 Number of Queues 00:16:02.170 ================ 00:16:02.170 Number of I/O Submission Queues: 127 00:16:02.170 Number of I/O Completion Queues: 127 00:16:02.170 00:16:02.170 Active Namespaces 00:16:02.170 ================= 00:16:02.170 Namespace ID:1 00:16:02.170 Error Recovery Timeout: Unlimited 00:16:02.170 Command Set Identifier: NVM (00h) 00:16:02.170 Deallocate: Supported 00:16:02.170 Deallocated/Unwritten Error: Not Supported 00:16:02.170 Deallocated Read Value: Unknown 00:16:02.170 Deallocate in Write Zeroes: Not Supported 00:16:02.170 Deallocated Guard Field: 0xFFFF 00:16:02.170 Flush: Supported 00:16:02.170 Reservation: Supported 00:16:02.170 Namespace Sharing Capabilities: Multiple Controllers 00:16:02.170 Size (in LBAs): 131072 (0GiB) 00:16:02.170 Capacity (in LBAs): 131072 (0GiB) 00:16:02.170 Utilization (in LBAs): 131072 (0GiB) 00:16:02.170 NGUID: D05424EB26DD4B0D895D7DACC1D896E4 00:16:02.170 UUID: d05424eb-26dd-4b0d-895d-7dacc1d896e4 00:16:02.170 Thin Provisioning: Not Supported 00:16:02.170 Per-NS Atomic Units: Yes 00:16:02.170 Atomic Boundary Size (Normal): 0 00:16:02.170 Atomic Boundary Size (PFail): 0 00:16:02.170 Atomic Boundary Offset: 0 00:16:02.170 Maximum Single Source Range Length: 65535 00:16:02.170 Maximum Copy Length: 65535 00:16:02.170 Maximum Source Range Count: 1 00:16:02.170 NGUID/EUI64 Never Reused: No 00:16:02.170 Namespace Write Protected: No 00:16:02.170 Number of LBA Formats: 1 00:16:02.170 Current LBA Format: LBA Format #00 00:16:02.170 LBA Format #00: Data Size: 512 Metadata Size: 0 00:16:02.170 00:16:02.170 16:02:25 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:16:02.170 EAL: No free 2048 kB hugepages reported on node 1 00:16:07.435 Initializing NVMe Controllers 00:16:07.435 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:07.435 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:07.435 Initialization complete. Launching workers. 00:16:07.435 ======================================================== 00:16:07.435 Latency(us) 00:16:07.435 Device Information : IOPS MiB/s Average min max 00:16:07.435 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36831.77 143.87 3474.72 1135.70 8469.14 00:16:07.435 ======================================================== 00:16:07.435 Total : 36831.77 143.87 3474.72 1135.70 8469.14 00:16:07.435 00:16:07.435 16:02:31 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:16:07.693 EAL: No free 2048 kB hugepages reported on node 1 00:16:12.955 Initializing NVMe Controllers 00:16:12.955 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:12.955 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:12.955 Initialization complete. Launching workers. 00:16:12.955 ======================================================== 00:16:12.955 Latency(us) 00:16:12.955 Device Information : IOPS MiB/s Average min max 00:16:12.955 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 35632.40 139.19 3592.90 1152.74 10310.49 00:16:12.955 ======================================================== 00:16:12.955 Total : 35632.40 139.19 3592.90 1152.74 10310.49 00:16:12.955 00:16:12.955 16:02:36 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:12.955 EAL: No free 2048 kB hugepages reported on node 1 00:16:18.220 Initializing NVMe Controllers 00:16:18.220 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:18.220 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:18.220 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:18.220 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:18.220 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:18.220 Initialization complete. Launching workers. 00:16:18.220 Starting thread on core 2 00:16:18.220 Starting thread on core 3 00:16:18.220 Starting thread on core 1 00:16:18.220 16:02:41 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:18.220 EAL: No free 2048 kB hugepages reported on node 1 00:16:21.502 Initializing NVMe Controllers 00:16:21.502 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:21.502 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:21.502 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:21.502 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:21.502 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:21.502 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:21.502 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:21.502 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:21.502 Initialization complete. Launching workers. 00:16:21.502 Starting thread on core 1 with urgent priority queue 00:16:21.502 Starting thread on core 2 with urgent priority queue 00:16:21.502 Starting thread on core 3 with urgent priority queue 00:16:21.502 Starting thread on core 0 with urgent priority queue 00:16:21.502 SPDK bdev Controller (SPDK2 ) core 0: 4940.00 IO/s 20.24 secs/100000 ios 00:16:21.502 SPDK bdev Controller (SPDK2 ) core 1: 4692.00 IO/s 21.31 secs/100000 ios 00:16:21.502 SPDK bdev Controller (SPDK2 ) core 2: 5170.67 IO/s 19.34 secs/100000 ios 00:16:21.502 SPDK bdev Controller (SPDK2 ) core 3: 3474.33 IO/s 28.78 secs/100000 ios 00:16:21.502 ======================================================== 00:16:21.502 00:16:21.502 16:02:45 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:21.502 EAL: No free 2048 kB hugepages reported on node 1 00:16:21.760 Initializing NVMe Controllers 00:16:21.760 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:21.760 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:21.760 Namespace ID: 1 size: 0GB 00:16:21.760 Initialization complete. 00:16:21.760 INFO: using host memory buffer for IO 00:16:21.760 Hello world! 00:16:21.760 16:02:45 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:22.017 EAL: No free 2048 kB hugepages reported on node 1 00:16:23.390 Initializing NVMe Controllers 00:16:23.390 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:23.390 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:23.390 Initialization complete. Launching workers. 00:16:23.390 submit (in ns) avg, min, max = 8584.6, 3452.2, 4019002.2 00:16:23.390 complete (in ns) avg, min, max = 25756.4, 2034.4, 4016898.9 00:16:23.390 00:16:23.390 Submit histogram 00:16:23.390 ================ 00:16:23.390 Range in us Cumulative Count 00:16:23.390 3.437 - 3.461: 0.1031% ( 14) 00:16:23.390 3.461 - 3.484: 0.7512% ( 88) 00:16:23.390 3.484 - 3.508: 2.8868% ( 290) 00:16:23.390 3.508 - 3.532: 6.9151% ( 547) 00:16:23.390 3.532 - 3.556: 14.4120% ( 1018) 00:16:23.390 3.556 - 3.579: 24.5011% ( 1370) 00:16:23.390 3.579 - 3.603: 35.5402% ( 1499) 00:16:23.390 3.603 - 3.627: 44.0018% ( 1149) 00:16:23.390 3.627 - 3.650: 51.0273% ( 954) 00:16:23.390 3.650 - 3.674: 55.9540% ( 669) 00:16:23.390 3.674 - 3.698: 59.9013% ( 536) 00:16:23.390 3.698 - 3.721: 64.1211% ( 573) 00:16:23.391 3.721 - 3.745: 66.8827% ( 375) 00:16:23.391 3.745 - 3.769: 70.0567% ( 431) 00:16:23.391 3.769 - 3.793: 73.6799% ( 492) 00:16:23.391 3.793 - 3.816: 77.8629% ( 568) 00:16:23.391 3.816 - 3.840: 82.2594% ( 597) 00:16:23.391 3.840 - 3.864: 85.1830% ( 397) 00:16:23.391 3.864 - 3.887: 87.3113% ( 289) 00:16:23.391 3.887 - 3.911: 88.8136% ( 204) 00:16:23.391 3.911 - 3.935: 90.3822% ( 213) 00:16:23.391 3.935 - 3.959: 91.5752% ( 162) 00:16:23.391 3.959 - 3.982: 92.5179% ( 128) 00:16:23.391 3.982 - 4.006: 93.4973% ( 133) 00:16:23.391 4.006 - 4.030: 94.2117% ( 97) 00:16:23.391 4.030 - 4.053: 94.9849% ( 105) 00:16:23.391 4.053 - 4.077: 95.6182% ( 86) 00:16:23.391 4.077 - 4.101: 96.0601% ( 60) 00:16:23.391 4.101 - 4.124: 96.3694% ( 42) 00:16:23.391 4.124 - 4.148: 96.5903% ( 30) 00:16:23.391 4.148 - 4.172: 96.7155% ( 17) 00:16:23.391 4.172 - 4.196: 96.8260% ( 15) 00:16:23.391 4.196 - 4.219: 96.9364% ( 15) 00:16:23.391 4.219 - 4.243: 97.0027% ( 9) 00:16:23.391 4.243 - 4.267: 97.0690% ( 9) 00:16:23.391 4.267 - 4.290: 97.1353% ( 9) 00:16:23.391 4.290 - 4.314: 97.2457% ( 15) 00:16:23.391 4.314 - 4.338: 97.2899% ( 6) 00:16:23.391 4.338 - 4.361: 97.3341% ( 6) 00:16:23.391 4.361 - 4.385: 97.3636% ( 4) 00:16:23.391 4.385 - 4.409: 97.3930% ( 4) 00:16:23.391 4.409 - 4.433: 97.4151% ( 3) 00:16:23.391 4.433 - 4.456: 97.4372% ( 3) 00:16:23.391 4.456 - 4.480: 97.4519% ( 2) 00:16:23.391 4.504 - 4.527: 97.4667% ( 2) 00:16:23.391 4.599 - 4.622: 97.4814% ( 2) 00:16:23.391 4.646 - 4.670: 97.4888% ( 1) 00:16:23.391 4.670 - 4.693: 97.4961% ( 1) 00:16:23.391 4.693 - 4.717: 97.5035% ( 1) 00:16:23.391 4.741 - 4.764: 97.5256% ( 3) 00:16:23.391 4.764 - 4.788: 97.5550% ( 4) 00:16:23.391 4.788 - 4.812: 97.5919% ( 5) 00:16:23.391 4.812 - 4.836: 97.6434% ( 7) 00:16:23.391 4.836 - 4.859: 97.6802% ( 5) 00:16:23.391 4.859 - 4.883: 97.7023% ( 3) 00:16:23.391 4.883 - 4.907: 97.7981% ( 13) 00:16:23.391 4.907 - 4.930: 97.8570% ( 8) 00:16:23.391 4.930 - 4.954: 97.8791% ( 3) 00:16:23.391 4.954 - 4.978: 97.9306% ( 7) 00:16:23.391 4.978 - 5.001: 97.9895% ( 8) 00:16:23.391 5.001 - 5.025: 98.0116% ( 3) 00:16:23.391 5.025 - 5.049: 98.0190% ( 1) 00:16:23.391 5.049 - 5.073: 98.0706% ( 7) 00:16:23.391 5.073 - 5.096: 98.1000% ( 4) 00:16:23.391 5.096 - 5.120: 98.1147% ( 2) 00:16:23.391 5.120 - 5.144: 98.1295% ( 2) 00:16:23.391 5.144 - 5.167: 98.1516% ( 3) 00:16:23.391 5.167 - 5.191: 98.1737% ( 3) 00:16:23.391 5.191 - 5.215: 98.1884% ( 2) 00:16:23.391 5.239 - 5.262: 98.2031% ( 2) 00:16:23.391 5.262 - 5.286: 98.2178% ( 2) 00:16:23.391 5.286 - 5.310: 98.2252% ( 1) 00:16:23.391 5.333 - 5.357: 98.2326% ( 1) 00:16:23.391 5.381 - 5.404: 98.2620% ( 4) 00:16:23.391 5.452 - 5.476: 98.2694% ( 1) 00:16:23.391 5.499 - 5.523: 98.2915% ( 3) 00:16:23.391 5.523 - 5.547: 98.2988% ( 1) 00:16:23.391 5.594 - 5.618: 98.3062% ( 1) 00:16:23.391 5.618 - 5.641: 98.3136% ( 1) 00:16:23.391 5.689 - 5.713: 98.3209% ( 1) 00:16:23.391 5.784 - 5.807: 98.3283% ( 1) 00:16:23.391 5.855 - 5.879: 98.3357% ( 1) 00:16:23.391 5.879 - 5.902: 98.3430% ( 1) 00:16:23.391 5.926 - 5.950: 98.3578% ( 2) 00:16:23.391 6.116 - 6.163: 98.3725% ( 2) 00:16:23.391 6.305 - 6.353: 98.3799% ( 1) 00:16:23.391 6.400 - 6.447: 98.3872% ( 1) 00:16:23.391 6.447 - 6.495: 98.3946% ( 1) 00:16:23.391 6.732 - 6.779: 98.4019% ( 1) 00:16:23.391 6.779 - 6.827: 98.4093% ( 1) 00:16:23.391 6.827 - 6.874: 98.4240% ( 2) 00:16:23.391 6.874 - 6.921: 98.4314% ( 1) 00:16:23.391 6.921 - 6.969: 98.4388% ( 1) 00:16:23.391 7.064 - 7.111: 98.4461% ( 1) 00:16:23.391 7.111 - 7.159: 98.4535% ( 1) 00:16:23.391 7.301 - 7.348: 98.4609% ( 1) 00:16:23.391 7.490 - 7.538: 98.4682% ( 1) 00:16:23.391 7.538 - 7.585: 98.4756% ( 1) 00:16:23.391 7.585 - 7.633: 98.4830% ( 1) 00:16:23.391 7.727 - 7.775: 98.4903% ( 1) 00:16:23.391 7.775 - 7.822: 98.5050% ( 2) 00:16:23.391 7.822 - 7.870: 98.5124% ( 1) 00:16:23.391 7.870 - 7.917: 98.5198% ( 1) 00:16:23.391 7.917 - 7.964: 98.5271% ( 1) 00:16:23.391 7.964 - 8.012: 98.5345% ( 1) 00:16:23.391 8.201 - 8.249: 98.5419% ( 1) 00:16:23.391 8.296 - 8.344: 98.5492% ( 1) 00:16:23.391 8.344 - 8.391: 98.5566% ( 1) 00:16:23.391 8.391 - 8.439: 98.5640% ( 1) 00:16:23.391 8.439 - 8.486: 98.5713% ( 1) 00:16:23.391 8.486 - 8.533: 98.5787% ( 1) 00:16:23.391 8.533 - 8.581: 98.5861% ( 1) 00:16:23.391 8.581 - 8.628: 98.5934% ( 1) 00:16:23.391 8.628 - 8.676: 98.6081% ( 2) 00:16:23.391 8.676 - 8.723: 98.6302% ( 3) 00:16:23.391 8.865 - 8.913: 98.6450% ( 2) 00:16:23.391 8.960 - 9.007: 98.6523% ( 1) 00:16:23.391 9.055 - 9.102: 98.6597% ( 1) 00:16:23.391 9.150 - 9.197: 98.6744% ( 2) 00:16:23.391 9.197 - 9.244: 98.6818% ( 1) 00:16:23.391 9.244 - 9.292: 98.6965% ( 2) 00:16:23.391 9.292 - 9.339: 98.7112% ( 2) 00:16:23.391 9.339 - 9.387: 98.7260% ( 2) 00:16:23.391 9.387 - 9.434: 98.7333% ( 1) 00:16:23.391 9.481 - 9.529: 98.7407% ( 1) 00:16:23.391 9.529 - 9.576: 98.7554% ( 2) 00:16:23.391 9.671 - 9.719: 98.7628% ( 1) 00:16:23.391 9.861 - 9.908: 98.7702% ( 1) 00:16:23.391 9.908 - 9.956: 98.7775% ( 1) 00:16:23.391 10.003 - 10.050: 98.8070% ( 4) 00:16:23.391 10.098 - 10.145: 98.8143% ( 1) 00:16:23.391 10.193 - 10.240: 98.8217% ( 1) 00:16:23.391 10.287 - 10.335: 98.8291% ( 1) 00:16:23.391 10.335 - 10.382: 98.8364% ( 1) 00:16:23.391 10.382 - 10.430: 98.8438% ( 1) 00:16:23.391 10.524 - 10.572: 98.8512% ( 1) 00:16:23.391 10.714 - 10.761: 98.8585% ( 1) 00:16:23.391 10.856 - 10.904: 98.8659% ( 1) 00:16:23.391 10.999 - 11.046: 98.8733% ( 1) 00:16:23.391 11.046 - 11.093: 98.8806% ( 1) 00:16:23.391 11.188 - 11.236: 98.8880% ( 1) 00:16:23.391 11.330 - 11.378: 98.8954% ( 1) 00:16:23.391 11.567 - 11.615: 98.9027% ( 1) 00:16:23.391 11.615 - 11.662: 98.9101% ( 1) 00:16:23.391 11.662 - 11.710: 98.9174% ( 1) 00:16:23.391 11.757 - 11.804: 98.9248% ( 1) 00:16:23.391 12.136 - 12.231: 98.9322% ( 1) 00:16:23.391 12.231 - 12.326: 98.9395% ( 1) 00:16:23.391 12.516 - 12.610: 98.9543% ( 2) 00:16:23.391 12.610 - 12.705: 98.9690% ( 2) 00:16:23.391 12.705 - 12.800: 98.9911% ( 3) 00:16:23.391 12.895 - 12.990: 98.9985% ( 1) 00:16:23.391 13.084 - 13.179: 99.0058% ( 1) 00:16:23.391 13.179 - 13.274: 99.0132% ( 1) 00:16:23.391 13.274 - 13.369: 99.0205% ( 1) 00:16:23.391 13.464 - 13.559: 99.0279% ( 1) 00:16:23.391 14.317 - 14.412: 99.0353% ( 1) 00:16:23.391 14.886 - 14.981: 99.0426% ( 1) 00:16:23.391 15.455 - 15.550: 99.0500% ( 1) 00:16:23.391 17.067 - 17.161: 99.0574% ( 1) 00:16:23.391 17.161 - 17.256: 99.0868% ( 4) 00:16:23.391 17.256 - 17.351: 99.0942% ( 1) 00:16:23.391 17.351 - 17.446: 99.1089% ( 2) 00:16:23.391 17.446 - 17.541: 99.1310% ( 3) 00:16:23.391 17.541 - 17.636: 99.1531% ( 3) 00:16:23.391 17.636 - 17.730: 99.2194% ( 9) 00:16:23.391 17.730 - 17.825: 99.2709% ( 7) 00:16:23.391 17.825 - 17.920: 99.3225% ( 7) 00:16:23.391 17.920 - 18.015: 99.3888% ( 9) 00:16:23.391 18.015 - 18.110: 99.4256% ( 5) 00:16:23.391 18.110 - 18.204: 99.4845% ( 8) 00:16:23.391 18.204 - 18.299: 99.5508% ( 9) 00:16:23.391 18.299 - 18.394: 99.6171% ( 9) 00:16:23.391 18.394 - 18.489: 99.6539% ( 5) 00:16:23.391 18.489 - 18.584: 99.7128% ( 8) 00:16:23.391 18.584 - 18.679: 99.7422% ( 4) 00:16:23.391 18.679 - 18.773: 99.7643% ( 3) 00:16:23.391 18.773 - 18.868: 99.7864% ( 3) 00:16:23.391 18.868 - 18.963: 99.7938% ( 1) 00:16:23.391 18.963 - 19.058: 99.8012% ( 1) 00:16:23.391 19.153 - 19.247: 99.8159% ( 2) 00:16:23.391 19.247 - 19.342: 99.8233% ( 1) 00:16:23.391 21.523 - 21.618: 99.8306% ( 1) 00:16:23.391 21.807 - 21.902: 99.8453% ( 2) 00:16:23.391 21.997 - 22.092: 99.8527% ( 1) 00:16:23.391 22.187 - 22.281: 99.8601% ( 1) 00:16:23.391 23.230 - 23.324: 99.8674% ( 1) 00:16:23.391 23.988 - 24.083: 99.8822% ( 2) 00:16:23.391 3980.705 - 4004.978: 99.9484% ( 9) 00:16:23.392 4004.978 - 4029.250: 100.0000% ( 7) 00:16:23.392 00:16:23.392 Complete histogram 00:16:23.392 ================== 00:16:23.392 Range in us Cumulative Count 00:16:23.392 2.027 - 2.039: 0.0663% ( 9) 00:16:23.392 2.039 - 2.050: 8.9992% ( 1213) 00:16:23.392 2.050 - 2.062: 15.6565% ( 904) 00:16:23.392 2.062 - 2.074: 19.2724% ( 491) 00:16:23.392 2.074 - 2.086: 49.7312% ( 4136) 00:16:23.392 2.086 - 2.098: 61.4920% ( 1597) 00:16:23.392 2.098 - 2.110: 63.3331% ( 250) 00:16:23.392 2.110 - 2.121: 67.1036% ( 512) 00:16:23.392 2.121 - 2.133: 67.8916% ( 107) 00:16:23.392 2.133 - 2.145: 71.3749% ( 473) 00:16:23.392 2.145 - 2.157: 80.7129% ( 1268) 00:16:23.392 2.157 - 2.169: 83.3198% ( 354) 00:16:23.392 2.169 - 2.181: 84.9032% ( 215) 00:16:23.392 2.181 - 2.193: 86.6485% ( 237) 00:16:23.392 2.193 - 2.204: 87.3187% ( 91) 00:16:23.392 2.204 - 2.216: 89.3659% ( 278) 00:16:23.392 2.216 - 2.228: 93.1659% ( 516) 00:16:23.392 2.228 - 2.240: 94.1380% ( 132) 00:16:23.392 2.240 - 2.252: 94.6167% ( 65) 00:16:23.392 2.252 - 2.264: 94.9407% ( 44) 00:16:23.392 2.264 - 2.276: 95.1543% ( 29) 00:16:23.392 2.276 - 2.287: 95.5520% ( 54) 00:16:23.392 2.287 - 2.299: 95.7434% ( 26) 00:16:23.392 2.299 - 2.311: 95.7950% ( 7) 00:16:23.392 2.311 - 2.323: 95.8981% ( 14) 00:16:23.392 2.323 - 2.335: 96.0380% ( 19) 00:16:23.392 2.335 - 2.347: 96.1632% ( 17) 00:16:23.392 2.347 - 2.359: 96.3105% ( 20) 00:16:23.392 2.359 - 2.370: 96.5388% ( 31) 00:16:23.392 2.370 - 2.382: 96.6787% ( 19) 00:16:23.392 2.382 - 2.394: 96.9070% ( 31) 00:16:23.392 2.394 - 2.406: 97.2089% ( 41) 00:16:23.392 2.406 - 2.418: 97.4519% ( 33) 00:16:23.392 2.418 - 2.430: 97.6287% ( 24) 00:16:23.392 2.430 - 2.441: 97.7981% ( 23) 00:16:23.392 2.441 - 2.453: 97.9012% ( 14) 00:16:23.392 2.453 - 2.465: 97.9895% ( 12) 00:16:23.392 2.465 - 2.477: 98.1074% ( 16) 00:16:23.392 2.477 - 2.489: 98.2399% ( 18) 00:16:23.392 2.489 - 2.501: 98.2841% ( 6) 00:16:23.392 2.501 - 2.513: 98.3504% ( 9) 00:16:23.392 2.513 - 2.524: 98.3872% ( 5) 00:16:23.392 2.524 - 2.536: 98.4019% ( 2) 00:16:23.392 2.560 - 2.572: 98.4167% ( 2) 00:16:23.392 2.596 - 2.607: 98.4240% ( 1) 00:16:23.392 2.655 - 2.667: 98.4314% ( 1) 00:16:23.392 2.702 - 2.714: 98.4388% ( 1) 00:16:23.392 2.868 - 2.880: 98.4461% ( 1) 00:16:23.392 2.880 - 2.892: 98.4535% ( 1) 00:16:23.392 3.390 - 3.413: 98.4609% ( 1) 00:16:23.392 3.437 - 3.461: 98.4756% ( 2) 00:16:23.392 3.484 - 3.508: 98.4903% ( 2) 00:16:23.392 3.508 - 3.532: 98.4977% ( 1) 00:16:23.392 3.532 - 3.556: 98.5050% ( 1) 00:16:23.392 3.556 - 3.579: 98.5124% ( 1) 00:16:23.392 3.674 - 3.698: 98.5198% ( 1) 00:16:23.392 3.745 - 3.769: 98.5271% ( 1) 00:16:23.392 3.769 - 3.793: 98.5419% ( 2) 00:16:23.392 3.816 - 3.840: 98.5566% ( 2) 00:16:23.392 3.840 - 3.864: 98.5640% ( 1) 00:16:23.392 3.864 - 3.887: 98.5713% ( 1) 00:16:23.392 3.935 - 3.959: 98.5787% ( 1) 00:16:23.392 3.959 - 3.982: 98.5861% ( 1) 00:16:23.392 5.997 - 6.021: 98.5934% ( 1) 00:16:23.392 6.163 - 6.210: 98.6155% ( 3) 00:16:23.392 6.447 - 6.495: 98.6229% ( 1) 00:16:23.392 6.542 - 6.590: 98.6302% ( 1) 00:16:23.392 6.779 - 6.827: 98.6376% ( 1) 00:16:23.392 6.874 - 6.921: 98.6450% ( 1) 00:16:23.392 7.016 - 7.064: 98.6523% ( 1) 00:16:23.392 7.111 - 7.159: 98.6597% ( 1) 00:16:23.392 7.253 - 7.301: 98.6671% ( 1) 00:16:23.392 7.396 - 7.443: 98.6744% ( 1) 00:16:23.392 7.822 - 7.870: 98.6818% ( 1) 00:16:23.392 7.870 - 7.917: 98.6892% ( 1) 00:16:23.392 8.154 - 8.201: 98.6965% ( 1) 00:16:23.392 8.486 - 8.533: 98.7039% ( 1) 00:16:23.392 8.533 - 8.581: 98.7112% ( 1) 00:16:23.392 9.055 - 9.102: 98.7186% ( 1) 00:16:23.392 9.150 - 9.197: 98.7260% ( 1) 00:16:23.392 9.387 - 9.434: 98.7333% ( 1) 00:16:23.392 10.287 - 10.335: 98.7407% ( 1) 00:16:23.392 13.274 - 13.369: 98.7481% ( 1) 00:16:23.392 15.455 - 15.550: 98.7554% ( 1) 00:16:23.392 15.550 - 15.644: 98.7702% ( 2) 00:16:23.392 15.644 - 15.739: 98.7849% ( 2) 00:16:23.392 15.739 - 15.834: 98.7923% ( 1) 00:16:23.392 15.834 - 15.929: 98.8070% ( 2) 00:16:23.392 15.929 - 16.024: 98.8364% ( 4) 00:16:23.392 16.024 - 16.119: 98.8512% ( 2) 00:16:23.392 16.119 - 16.213: 98.8659% ( 2) 00:16:23.392 16.213 - 16.308: 98.8806% ( 2) 00:16:23.392 16.308 - 16.403: 98.9248% ( 6) 00:16:23.392 16.403 - 16.498: 98.9616% ( 5) 00:16:23.392 16.498 - 16.593: 99.0205% ( 8) 00:16:23.392 16.593 - 16.687: 99.0868% ( 9) 00:16:23.392 16.687 - 16.782: 99.1163% ( 4) 00:16:23.392 16.782 - 16.877: 99.1605% ( 6) 00:16:23.392 16.877 - 16.972: 99.1826% ( 3) 00:16:23.392 16.972 - 17.067: 99.1973% ( 2) 00:16:23.392 17.067 - 17.161: 99.2267% ( 4) 00:16:23.392 17.161 - 17.256: 99.2415% ( 2) 00:16:23.392 17.256 - 17.351: 99.2636% ( 3) 00:16:23.392 17.446 - 17.541: 99.2857% ( 3) 00:16:23.392 17.541 - 17.636: 99.3004% ( 2) 00:16:23.392 17.730 - 17.825: 99.3078% ( 1) 00:16:23.392 17.825 - 17.920: 99.3225% ( 2) 00:16:23.392 18.015 - 18.110: 99.3298% ( 1) 00:16:23.392 18.110 - 18.204: 99.3372% ( 1) 00:16:23.392 18.204 - 18.299: 99.3519% ( 2) 00:16:23.392 18.489 - 18.584: 99.3667% ( 2) 00:16:23.392 19.721 - 19.816: 99.3740% ( 1) 00:16:23.392 21.144 - 21.239: 99.3814% ( 1) 00:16:23.392 21.902 - 21.997: 99.3888% ( 1) 00:16:23.392 25.600 - 25.790: 99.4035% ( 2) 00:16:23.392 29.013 - 29.203: 99.4109% ( 1) 00:16:23.392 3203.982 - 3228.255: 99.4182% ( 1) 00:16:23.392 3980.705 - 4004.978: 99.8085% ( 53) 00:16:23.392 4004.978 - 4029.250: 100.0000% ( 26) 00:16:23.392 00:16:23.392 16:02:46 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:23.392 16:02:46 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:23.392 16:02:46 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:23.392 16:02:46 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:23.392 16:02:46 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:23.673 [ 00:16:23.673 { 00:16:23.673 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:23.673 "subtype": "Discovery", 00:16:23.673 "listen_addresses": [], 00:16:23.673 "allow_any_host": true, 00:16:23.673 "hosts": [] 00:16:23.673 }, 00:16:23.673 { 00:16:23.673 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:23.673 "subtype": "NVMe", 00:16:23.673 "listen_addresses": [ 00:16:23.673 { 00:16:23.673 "transport": "VFIOUSER", 00:16:23.673 "trtype": "VFIOUSER", 00:16:23.673 "adrfam": "IPv4", 00:16:23.673 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:23.673 "trsvcid": "0" 00:16:23.673 } 00:16:23.673 ], 00:16:23.673 "allow_any_host": true, 00:16:23.673 "hosts": [], 00:16:23.673 "serial_number": "SPDK1", 00:16:23.673 "model_number": "SPDK bdev Controller", 00:16:23.673 "max_namespaces": 32, 00:16:23.673 "min_cntlid": 1, 00:16:23.673 "max_cntlid": 65519, 00:16:23.673 "namespaces": [ 00:16:23.673 { 00:16:23.673 "nsid": 1, 00:16:23.673 "bdev_name": "Malloc1", 00:16:23.673 "name": "Malloc1", 00:16:23.673 "nguid": "2342FB00FB89410EACBEBCFB705F2E6B", 00:16:23.673 "uuid": "2342fb00-fb89-410e-acbe-bcfb705f2e6b" 00:16:23.673 }, 00:16:23.673 { 00:16:23.673 "nsid": 2, 00:16:23.673 "bdev_name": "Malloc3", 00:16:23.673 "name": "Malloc3", 00:16:23.673 "nguid": "3CA6E58956864B569BEC44ABA8961B1F", 00:16:23.673 "uuid": "3ca6e589-5686-4b56-9bec-44aba8961b1f" 00:16:23.673 } 00:16:23.673 ] 00:16:23.673 }, 00:16:23.673 { 00:16:23.673 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:23.673 "subtype": "NVMe", 00:16:23.673 "listen_addresses": [ 00:16:23.673 { 00:16:23.673 "transport": "VFIOUSER", 00:16:23.673 "trtype": "VFIOUSER", 00:16:23.673 "adrfam": "IPv4", 00:16:23.673 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:23.673 "trsvcid": "0" 00:16:23.673 } 00:16:23.673 ], 00:16:23.673 "allow_any_host": true, 00:16:23.673 "hosts": [], 00:16:23.673 "serial_number": "SPDK2", 00:16:23.673 "model_number": "SPDK bdev Controller", 00:16:23.673 "max_namespaces": 32, 00:16:23.673 "min_cntlid": 1, 00:16:23.673 "max_cntlid": 65519, 00:16:23.673 "namespaces": [ 00:16:23.673 { 00:16:23.673 "nsid": 1, 00:16:23.673 "bdev_name": "Malloc2", 00:16:23.673 "name": "Malloc2", 00:16:23.673 "nguid": "D05424EB26DD4B0D895D7DACC1D896E4", 00:16:23.673 "uuid": "d05424eb-26dd-4b0d-895d-7dacc1d896e4" 00:16:23.673 } 00:16:23.673 ] 00:16:23.673 } 00:16:23.673 ] 00:16:23.673 16:02:47 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:23.673 16:02:47 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1562946 00:16:23.673 16:02:47 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:23.673 16:02:47 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:23.673 16:02:47 -- common/autotest_common.sh@1254 -- # local i=0 00:16:23.673 16:02:47 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:23.673 16:02:47 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:23.673 16:02:47 -- common/autotest_common.sh@1265 -- # return 0 00:16:23.673 16:02:47 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:23.673 16:02:47 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:23.673 EAL: No free 2048 kB hugepages reported on node 1 00:16:23.930 Malloc4 00:16:23.930 16:02:47 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:24.188 16:02:47 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:24.188 Asynchronous Event Request test 00:16:24.188 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:24.188 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:24.188 Registering asynchronous event callbacks... 00:16:24.188 Starting namespace attribute notice tests for all controllers... 00:16:24.188 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:24.188 aer_cb - Changed Namespace 00:16:24.188 Cleaning up... 00:16:24.446 [ 00:16:24.446 { 00:16:24.446 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:24.446 "subtype": "Discovery", 00:16:24.446 "listen_addresses": [], 00:16:24.446 "allow_any_host": true, 00:16:24.446 "hosts": [] 00:16:24.446 }, 00:16:24.446 { 00:16:24.446 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:24.446 "subtype": "NVMe", 00:16:24.446 "listen_addresses": [ 00:16:24.446 { 00:16:24.446 "transport": "VFIOUSER", 00:16:24.446 "trtype": "VFIOUSER", 00:16:24.446 "adrfam": "IPv4", 00:16:24.446 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:24.446 "trsvcid": "0" 00:16:24.446 } 00:16:24.446 ], 00:16:24.446 "allow_any_host": true, 00:16:24.446 "hosts": [], 00:16:24.446 "serial_number": "SPDK1", 00:16:24.446 "model_number": "SPDK bdev Controller", 00:16:24.446 "max_namespaces": 32, 00:16:24.446 "min_cntlid": 1, 00:16:24.446 "max_cntlid": 65519, 00:16:24.446 "namespaces": [ 00:16:24.446 { 00:16:24.446 "nsid": 1, 00:16:24.446 "bdev_name": "Malloc1", 00:16:24.446 "name": "Malloc1", 00:16:24.446 "nguid": "2342FB00FB89410EACBEBCFB705F2E6B", 00:16:24.446 "uuid": "2342fb00-fb89-410e-acbe-bcfb705f2e6b" 00:16:24.446 }, 00:16:24.446 { 00:16:24.446 "nsid": 2, 00:16:24.446 "bdev_name": "Malloc3", 00:16:24.446 "name": "Malloc3", 00:16:24.446 "nguid": "3CA6E58956864B569BEC44ABA8961B1F", 00:16:24.446 "uuid": "3ca6e589-5686-4b56-9bec-44aba8961b1f" 00:16:24.446 } 00:16:24.446 ] 00:16:24.446 }, 00:16:24.446 { 00:16:24.446 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:24.446 "subtype": "NVMe", 00:16:24.446 "listen_addresses": [ 00:16:24.446 { 00:16:24.446 "transport": "VFIOUSER", 00:16:24.446 "trtype": "VFIOUSER", 00:16:24.446 "adrfam": "IPv4", 00:16:24.446 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:24.446 "trsvcid": "0" 00:16:24.446 } 00:16:24.446 ], 00:16:24.446 "allow_any_host": true, 00:16:24.446 "hosts": [], 00:16:24.446 "serial_number": "SPDK2", 00:16:24.446 "model_number": "SPDK bdev Controller", 00:16:24.446 "max_namespaces": 32, 00:16:24.446 "min_cntlid": 1, 00:16:24.446 "max_cntlid": 65519, 00:16:24.446 "namespaces": [ 00:16:24.446 { 00:16:24.446 "nsid": 1, 00:16:24.446 "bdev_name": "Malloc2", 00:16:24.446 "name": "Malloc2", 00:16:24.446 "nguid": "D05424EB26DD4B0D895D7DACC1D896E4", 00:16:24.446 "uuid": "d05424eb-26dd-4b0d-895d-7dacc1d896e4" 00:16:24.446 }, 00:16:24.446 { 00:16:24.446 "nsid": 2, 00:16:24.446 "bdev_name": "Malloc4", 00:16:24.446 "name": "Malloc4", 00:16:24.446 "nguid": "D04E223B68F848EFA97E8EEEDA1D51D4", 00:16:24.446 "uuid": "d04e223b-68f8-48ef-a97e-8eeeda1d51d4" 00:16:24.446 } 00:16:24.446 ] 00:16:24.446 } 00:16:24.446 ] 00:16:24.446 16:02:47 -- target/nvmf_vfio_user.sh@44 -- # wait 1562946 00:16:24.446 16:02:47 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:24.446 16:02:47 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1557159 00:16:24.446 16:02:47 -- common/autotest_common.sh@936 -- # '[' -z 1557159 ']' 00:16:24.446 16:02:47 -- common/autotest_common.sh@940 -- # kill -0 1557159 00:16:24.446 16:02:47 -- common/autotest_common.sh@941 -- # uname 00:16:24.446 16:02:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:24.446 16:02:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1557159 00:16:24.446 16:02:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:24.446 16:02:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:24.446 16:02:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1557159' 00:16:24.446 killing process with pid 1557159 00:16:24.446 16:02:47 -- common/autotest_common.sh@955 -- # kill 1557159 00:16:24.447 [2024-11-18 16:02:47.886128] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:24.447 16:02:47 -- common/autotest_common.sh@960 -- # wait 1557159 00:16:24.704 16:02:48 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:24.704 16:02:48 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:24.704 16:02:48 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:24.704 16:02:48 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:24.704 16:02:48 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:24.704 16:02:48 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1563095 00:16:24.704 16:02:48 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:24.704 16:02:48 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1563095' 00:16:24.704 Process pid: 1563095 00:16:24.704 16:02:48 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:24.704 16:02:48 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1563095 00:16:24.704 16:02:48 -- common/autotest_common.sh@829 -- # '[' -z 1563095 ']' 00:16:24.704 16:02:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:24.704 16:02:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:24.704 16:02:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:24.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:24.704 16:02:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:24.704 16:02:48 -- common/autotest_common.sh@10 -- # set +x 00:16:24.704 [2024-11-18 16:02:48.275942] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:24.704 [2024-11-18 16:02:48.276956] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:24.704 [2024-11-18 16:02:48.277015] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:24.962 EAL: No free 2048 kB hugepages reported on node 1 00:16:24.962 [2024-11-18 16:02:48.340711] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:24.962 [2024-11-18 16:02:48.429857] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:24.962 [2024-11-18 16:02:48.430042] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:24.962 [2024-11-18 16:02:48.430070] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:24.962 [2024-11-18 16:02:48.430086] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:24.962 [2024-11-18 16:02:48.430151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:24.962 [2024-11-18 16:02:48.430220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:24.962 [2024-11-18 16:02:48.430310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:24.962 [2024-11-18 16:02:48.430312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:24.962 [2024-11-18 16:02:48.542924] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:24.962 [2024-11-18 16:02:48.543193] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:24.962 [2024-11-18 16:02:48.543463] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:24.962 [2024-11-18 16:02:48.544218] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:24.962 [2024-11-18 16:02:48.544312] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:25.894 16:02:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:25.894 16:02:49 -- common/autotest_common.sh@862 -- # return 0 00:16:25.894 16:02:49 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:26.827 16:02:50 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:27.085 16:02:50 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:27.085 16:02:50 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:27.085 16:02:50 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:27.085 16:02:50 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:27.085 16:02:50 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:27.346 Malloc1 00:16:27.346 16:02:50 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:27.605 16:02:51 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:27.863 16:02:51 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:28.121 16:02:51 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:28.122 16:02:51 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:28.122 16:02:51 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:28.380 Malloc2 00:16:28.380 16:02:51 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:28.637 16:02:52 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:28.895 16:02:52 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:29.152 16:02:52 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:29.152 16:02:52 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1563095 00:16:29.152 16:02:52 -- common/autotest_common.sh@936 -- # '[' -z 1563095 ']' 00:16:29.152 16:02:52 -- common/autotest_common.sh@940 -- # kill -0 1563095 00:16:29.152 16:02:52 -- common/autotest_common.sh@941 -- # uname 00:16:29.152 16:02:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:29.152 16:02:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1563095 00:16:29.152 16:02:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:29.152 16:02:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:29.152 16:02:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1563095' 00:16:29.152 killing process with pid 1563095 00:16:29.152 16:02:52 -- common/autotest_common.sh@955 -- # kill 1563095 00:16:29.152 16:02:52 -- common/autotest_common.sh@960 -- # wait 1563095 00:16:29.409 16:02:52 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:29.409 16:02:52 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:29.409 00:16:29.409 real 0m54.195s 00:16:29.409 user 3m34.356s 00:16:29.409 sys 0m4.441s 00:16:29.409 16:02:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:29.409 16:02:52 -- common/autotest_common.sh@10 -- # set +x 00:16:29.409 ************************************ 00:16:29.409 END TEST nvmf_vfio_user 00:16:29.409 ************************************ 00:16:29.409 16:02:52 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:29.409 16:02:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:29.409 16:02:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:29.409 16:02:52 -- common/autotest_common.sh@10 -- # set +x 00:16:29.409 ************************************ 00:16:29.409 START TEST nvmf_vfio_user_nvme_compliance 00:16:29.409 ************************************ 00:16:29.409 16:02:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:29.409 * Looking for test storage... 00:16:29.409 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:29.409 16:02:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:29.409 16:02:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:29.409 16:02:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:29.667 16:02:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:29.667 16:02:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:29.667 16:02:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:29.667 16:02:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:29.667 16:02:53 -- scripts/common.sh@335 -- # IFS=.-: 00:16:29.667 16:02:53 -- scripts/common.sh@335 -- # read -ra ver1 00:16:29.667 16:02:53 -- scripts/common.sh@336 -- # IFS=.-: 00:16:29.667 16:02:53 -- scripts/common.sh@336 -- # read -ra ver2 00:16:29.667 16:02:53 -- scripts/common.sh@337 -- # local 'op=<' 00:16:29.667 16:02:53 -- scripts/common.sh@339 -- # ver1_l=2 00:16:29.667 16:02:53 -- scripts/common.sh@340 -- # ver2_l=1 00:16:29.667 16:02:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:29.667 16:02:53 -- scripts/common.sh@343 -- # case "$op" in 00:16:29.667 16:02:53 -- scripts/common.sh@344 -- # : 1 00:16:29.667 16:02:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:29.667 16:02:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:29.667 16:02:53 -- scripts/common.sh@364 -- # decimal 1 00:16:29.667 16:02:53 -- scripts/common.sh@352 -- # local d=1 00:16:29.667 16:02:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:29.667 16:02:53 -- scripts/common.sh@354 -- # echo 1 00:16:29.667 16:02:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:29.667 16:02:53 -- scripts/common.sh@365 -- # decimal 2 00:16:29.667 16:02:53 -- scripts/common.sh@352 -- # local d=2 00:16:29.667 16:02:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:29.667 16:02:53 -- scripts/common.sh@354 -- # echo 2 00:16:29.667 16:02:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:29.667 16:02:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:29.667 16:02:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:29.667 16:02:53 -- scripts/common.sh@367 -- # return 0 00:16:29.667 16:02:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:29.667 16:02:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:29.667 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.667 --rc genhtml_branch_coverage=1 00:16:29.667 --rc genhtml_function_coverage=1 00:16:29.667 --rc genhtml_legend=1 00:16:29.667 --rc geninfo_all_blocks=1 00:16:29.667 --rc geninfo_unexecuted_blocks=1 00:16:29.667 00:16:29.667 ' 00:16:29.667 16:02:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:29.667 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.667 --rc genhtml_branch_coverage=1 00:16:29.667 --rc genhtml_function_coverage=1 00:16:29.667 --rc genhtml_legend=1 00:16:29.667 --rc geninfo_all_blocks=1 00:16:29.667 --rc geninfo_unexecuted_blocks=1 00:16:29.667 00:16:29.667 ' 00:16:29.667 16:02:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:29.667 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.667 --rc genhtml_branch_coverage=1 00:16:29.667 --rc genhtml_function_coverage=1 00:16:29.667 --rc genhtml_legend=1 00:16:29.667 --rc geninfo_all_blocks=1 00:16:29.667 --rc geninfo_unexecuted_blocks=1 00:16:29.667 00:16:29.667 ' 00:16:29.667 16:02:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:29.667 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.667 --rc genhtml_branch_coverage=1 00:16:29.667 --rc genhtml_function_coverage=1 00:16:29.667 --rc genhtml_legend=1 00:16:29.667 --rc geninfo_all_blocks=1 00:16:29.668 --rc geninfo_unexecuted_blocks=1 00:16:29.668 00:16:29.668 ' 00:16:29.668 16:02:53 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:29.668 16:02:53 -- nvmf/common.sh@7 -- # uname -s 00:16:29.668 16:02:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:29.668 16:02:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:29.668 16:02:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:29.668 16:02:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:29.668 16:02:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:29.668 16:02:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:29.668 16:02:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:29.668 16:02:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:29.668 16:02:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:29.668 16:02:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:29.668 16:02:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.668 16:02:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.668 16:02:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:29.668 16:02:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:29.668 16:02:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:29.668 16:02:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:29.668 16:02:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:29.668 16:02:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:29.668 16:02:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:29.668 16:02:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.668 16:02:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.668 16:02:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.668 16:02:53 -- paths/export.sh@5 -- # export PATH 00:16:29.668 16:02:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.668 16:02:53 -- nvmf/common.sh@46 -- # : 0 00:16:29.668 16:02:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:29.668 16:02:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:29.668 16:02:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:29.668 16:02:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:29.668 16:02:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:29.668 16:02:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:29.668 16:02:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:29.668 16:02:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:29.668 16:02:53 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:29.668 16:02:53 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:29.668 16:02:53 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:29.668 16:02:53 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:29.668 16:02:53 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:29.668 16:02:53 -- compliance/compliance.sh@20 -- # nvmfpid=1563846 00:16:29.668 16:02:53 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:29.668 16:02:53 -- compliance/compliance.sh@21 -- # echo 'Process pid: 1563846' 00:16:29.668 Process pid: 1563846 00:16:29.668 16:02:53 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:29.668 16:02:53 -- compliance/compliance.sh@24 -- # waitforlisten 1563846 00:16:29.668 16:02:53 -- common/autotest_common.sh@829 -- # '[' -z 1563846 ']' 00:16:29.668 16:02:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:29.668 16:02:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:29.668 16:02:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:29.668 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:29.668 16:02:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:29.668 16:02:53 -- common/autotest_common.sh@10 -- # set +x 00:16:29.668 [2024-11-18 16:02:53.134295] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:29.668 [2024-11-18 16:02:53.134375] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:29.668 EAL: No free 2048 kB hugepages reported on node 1 00:16:29.668 [2024-11-18 16:02:53.195206] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:29.926 [2024-11-18 16:02:53.280427] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:29.926 [2024-11-18 16:02:53.280581] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:29.926 [2024-11-18 16:02:53.280598] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:29.926 [2024-11-18 16:02:53.280618] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:29.926 [2024-11-18 16:02:53.280670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:29.926 [2024-11-18 16:02:53.280701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:29.926 [2024-11-18 16:02:53.280704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:30.863 16:02:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:30.863 16:02:54 -- common/autotest_common.sh@862 -- # return 0 00:16:30.863 16:02:54 -- compliance/compliance.sh@26 -- # sleep 1 00:16:31.795 16:02:55 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:31.795 16:02:55 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:31.795 16:02:55 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:31.795 16:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.796 16:02:55 -- common/autotest_common.sh@10 -- # set +x 00:16:31.796 16:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.796 16:02:55 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:31.796 16:02:55 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:31.796 16:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.796 16:02:55 -- common/autotest_common.sh@10 -- # set +x 00:16:31.796 malloc0 00:16:31.796 16:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.796 16:02:55 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:31.796 16:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.796 16:02:55 -- common/autotest_common.sh@10 -- # set +x 00:16:31.796 16:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.796 16:02:55 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:31.796 16:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.796 16:02:55 -- common/autotest_common.sh@10 -- # set +x 00:16:31.796 16:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.796 16:02:55 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:31.796 16:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.796 16:02:55 -- common/autotest_common.sh@10 -- # set +x 00:16:31.796 16:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.796 16:02:55 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:31.796 EAL: No free 2048 kB hugepages reported on node 1 00:16:31.796 00:16:31.796 00:16:31.796 CUnit - A unit testing framework for C - Version 2.1-3 00:16:31.796 http://cunit.sourceforge.net/ 00:16:31.796 00:16:31.796 00:16:31.796 Suite: nvme_compliance 00:16:32.054 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-18 16:02:55.399564] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:32.054 [2024-11-18 16:02:55.399667] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:32.054 [2024-11-18 16:02:55.399698] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:32.054 passed 00:16:32.054 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:32.054 Test: admin_identify_ns ...[2024-11-18 16:02:55.637620] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:32.312 [2024-11-18 16:02:55.645622] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:32.312 passed 00:16:32.312 Test: admin_get_features_mandatory_features ...passed 00:16:32.312 Test: admin_get_features_optional_features ...passed 00:16:32.570 Test: admin_set_features_number_of_queues ...passed 00:16:32.570 Test: admin_get_log_page_mandatory_logs ...passed 00:16:32.828 Test: admin_get_log_page_with_lpo ...[2024-11-18 16:02:56.269625] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:32.828 passed 00:16:32.828 Test: fabric_property_get ...passed 00:16:33.086 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-18 16:02:56.451316] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:33.086 passed 00:16:33.086 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-18 16:02:56.622635] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:33.086 [2024-11-18 16:02:56.638635] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:33.086 passed 00:16:33.344 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-18 16:02:56.728751] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:33.344 passed 00:16:33.344 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-18 16:02:56.887633] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:33.344 [2024-11-18 16:02:56.911633] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:33.605 passed 00:16:33.605 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-18 16:02:57.001495] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:33.605 [2024-11-18 16:02:57.001552] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:33.605 passed 00:16:33.605 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-18 16:02:57.177634] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:33.605 [2024-11-18 16:02:57.185616] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:33.605 [2024-11-18 16:02:57.193618] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:33.863 [2024-11-18 16:02:57.201632] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:33.863 passed 00:16:33.863 Test: admin_create_io_sq_verify_pc ...[2024-11-18 16:02:57.330631] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:33.863 passed 00:16:35.235 Test: admin_create_io_qp_max_qps ...[2024-11-18 16:02:58.546624] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:35.493 passed 00:16:35.751 Test: admin_create_io_sq_shared_cq ...[2024-11-18 16:02:59.142631] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:35.751 passed 00:16:35.751 00:16:35.751 Run Summary: Type Total Ran Passed Failed Inactive 00:16:35.751 suites 1 1 n/a 0 0 00:16:35.751 tests 18 18 18 0 0 00:16:35.751 asserts 360 360 360 0 n/a 00:16:35.751 00:16:35.751 Elapsed time = 1.569 seconds 00:16:35.751 16:02:59 -- compliance/compliance.sh@42 -- # killprocess 1563846 00:16:35.751 16:02:59 -- common/autotest_common.sh@936 -- # '[' -z 1563846 ']' 00:16:35.751 16:02:59 -- common/autotest_common.sh@940 -- # kill -0 1563846 00:16:35.751 16:02:59 -- common/autotest_common.sh@941 -- # uname 00:16:35.751 16:02:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:35.751 16:02:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1563846 00:16:35.751 16:02:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:35.751 16:02:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:35.751 16:02:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1563846' 00:16:35.751 killing process with pid 1563846 00:16:35.751 16:02:59 -- common/autotest_common.sh@955 -- # kill 1563846 00:16:35.751 16:02:59 -- common/autotest_common.sh@960 -- # wait 1563846 00:16:36.030 16:02:59 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:36.030 16:02:59 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:36.030 00:16:36.030 real 0m6.588s 00:16:36.030 user 0m18.919s 00:16:36.030 sys 0m0.570s 00:16:36.030 16:02:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:36.030 16:02:59 -- common/autotest_common.sh@10 -- # set +x 00:16:36.030 ************************************ 00:16:36.030 END TEST nvmf_vfio_user_nvme_compliance 00:16:36.030 ************************************ 00:16:36.030 16:02:59 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:36.030 16:02:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:36.030 16:02:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:36.030 16:02:59 -- common/autotest_common.sh@10 -- # set +x 00:16:36.030 ************************************ 00:16:36.030 START TEST nvmf_vfio_user_fuzz 00:16:36.030 ************************************ 00:16:36.030 16:02:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:36.329 * Looking for test storage... 00:16:36.329 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:36.329 16:02:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:36.329 16:02:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:36.329 16:02:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:36.329 16:02:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:36.329 16:02:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:36.329 16:02:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:36.329 16:02:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:36.329 16:02:59 -- scripts/common.sh@335 -- # IFS=.-: 00:16:36.329 16:02:59 -- scripts/common.sh@335 -- # read -ra ver1 00:16:36.329 16:02:59 -- scripts/common.sh@336 -- # IFS=.-: 00:16:36.329 16:02:59 -- scripts/common.sh@336 -- # read -ra ver2 00:16:36.329 16:02:59 -- scripts/common.sh@337 -- # local 'op=<' 00:16:36.329 16:02:59 -- scripts/common.sh@339 -- # ver1_l=2 00:16:36.329 16:02:59 -- scripts/common.sh@340 -- # ver2_l=1 00:16:36.329 16:02:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:36.329 16:02:59 -- scripts/common.sh@343 -- # case "$op" in 00:16:36.329 16:02:59 -- scripts/common.sh@344 -- # : 1 00:16:36.329 16:02:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:36.329 16:02:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:36.329 16:02:59 -- scripts/common.sh@364 -- # decimal 1 00:16:36.329 16:02:59 -- scripts/common.sh@352 -- # local d=1 00:16:36.329 16:02:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:36.329 16:02:59 -- scripts/common.sh@354 -- # echo 1 00:16:36.329 16:02:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:36.329 16:02:59 -- scripts/common.sh@365 -- # decimal 2 00:16:36.329 16:02:59 -- scripts/common.sh@352 -- # local d=2 00:16:36.329 16:02:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:36.329 16:02:59 -- scripts/common.sh@354 -- # echo 2 00:16:36.329 16:02:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:36.329 16:02:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:36.329 16:02:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:36.329 16:02:59 -- scripts/common.sh@367 -- # return 0 00:16:36.329 16:02:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:36.329 16:02:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:36.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.329 --rc genhtml_branch_coverage=1 00:16:36.329 --rc genhtml_function_coverage=1 00:16:36.329 --rc genhtml_legend=1 00:16:36.329 --rc geninfo_all_blocks=1 00:16:36.329 --rc geninfo_unexecuted_blocks=1 00:16:36.329 00:16:36.329 ' 00:16:36.329 16:02:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:36.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.330 --rc genhtml_branch_coverage=1 00:16:36.330 --rc genhtml_function_coverage=1 00:16:36.330 --rc genhtml_legend=1 00:16:36.330 --rc geninfo_all_blocks=1 00:16:36.330 --rc geninfo_unexecuted_blocks=1 00:16:36.330 00:16:36.330 ' 00:16:36.330 16:02:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:36.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.330 --rc genhtml_branch_coverage=1 00:16:36.330 --rc genhtml_function_coverage=1 00:16:36.330 --rc genhtml_legend=1 00:16:36.330 --rc geninfo_all_blocks=1 00:16:36.330 --rc geninfo_unexecuted_blocks=1 00:16:36.330 00:16:36.330 ' 00:16:36.330 16:02:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:36.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.330 --rc genhtml_branch_coverage=1 00:16:36.330 --rc genhtml_function_coverage=1 00:16:36.330 --rc genhtml_legend=1 00:16:36.330 --rc geninfo_all_blocks=1 00:16:36.330 --rc geninfo_unexecuted_blocks=1 00:16:36.330 00:16:36.330 ' 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:36.330 16:02:59 -- nvmf/common.sh@7 -- # uname -s 00:16:36.330 16:02:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:36.330 16:02:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:36.330 16:02:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:36.330 16:02:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:36.330 16:02:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:36.330 16:02:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:36.330 16:02:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:36.330 16:02:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:36.330 16:02:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:36.330 16:02:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:36.330 16:02:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:36.330 16:02:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:36.330 16:02:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:36.330 16:02:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:36.330 16:02:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:36.330 16:02:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:36.330 16:02:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:36.330 16:02:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:36.330 16:02:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:36.330 16:02:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.330 16:02:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.330 16:02:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.330 16:02:59 -- paths/export.sh@5 -- # export PATH 00:16:36.330 16:02:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.330 16:02:59 -- nvmf/common.sh@46 -- # : 0 00:16:36.330 16:02:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:36.330 16:02:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:36.330 16:02:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:36.330 16:02:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:36.330 16:02:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:36.330 16:02:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:36.330 16:02:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:36.330 16:02:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=1564685 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 1564685' 00:16:36.330 Process pid: 1564685 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:36.330 16:02:59 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 1564685 00:16:36.330 16:02:59 -- common/autotest_common.sh@829 -- # '[' -z 1564685 ']' 00:16:36.330 16:02:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:36.330 16:02:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:36.330 16:02:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:36.330 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:36.330 16:02:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:36.330 16:02:59 -- common/autotest_common.sh@10 -- # set +x 00:16:37.285 16:03:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:37.285 16:03:00 -- common/autotest_common.sh@862 -- # return 0 00:16:37.285 16:03:00 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:38.218 16:03:01 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:38.218 16:03:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.218 16:03:01 -- common/autotest_common.sh@10 -- # set +x 00:16:38.218 16:03:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.218 16:03:01 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:38.218 16:03:01 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:38.218 16:03:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.218 16:03:01 -- common/autotest_common.sh@10 -- # set +x 00:16:38.218 malloc0 00:16:38.218 16:03:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.218 16:03:01 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:38.218 16:03:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.218 16:03:01 -- common/autotest_common.sh@10 -- # set +x 00:16:38.218 16:03:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.218 16:03:01 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:38.218 16:03:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.218 16:03:01 -- common/autotest_common.sh@10 -- # set +x 00:16:38.218 16:03:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.218 16:03:01 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:38.218 16:03:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.218 16:03:01 -- common/autotest_common.sh@10 -- # set +x 00:16:38.218 16:03:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.218 16:03:01 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:38.218 16:03:01 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:17:10.303 Fuzzing completed. Shutting down the fuzz application 00:17:10.303 00:17:10.303 Dumping successful admin opcodes: 00:17:10.303 8, 9, 10, 24, 00:17:10.303 Dumping successful io opcodes: 00:17:10.303 0, 00:17:10.303 NS: 0x200003a1ef00 I/O qp, Total commands completed: 662151, total successful commands: 2583, random_seed: 4126240256 00:17:10.303 NS: 0x200003a1ef00 admin qp, Total commands completed: 165160, total successful commands: 1333, random_seed: 3706051072 00:17:10.303 16:03:32 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:17:10.303 16:03:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:10.303 16:03:32 -- common/autotest_common.sh@10 -- # set +x 00:17:10.303 16:03:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:10.303 16:03:32 -- target/vfio_user_fuzz.sh@46 -- # killprocess 1564685 00:17:10.303 16:03:32 -- common/autotest_common.sh@936 -- # '[' -z 1564685 ']' 00:17:10.303 16:03:32 -- common/autotest_common.sh@940 -- # kill -0 1564685 00:17:10.303 16:03:32 -- common/autotest_common.sh@941 -- # uname 00:17:10.303 16:03:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:10.303 16:03:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1564685 00:17:10.303 16:03:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:10.303 16:03:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:10.303 16:03:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1564685' 00:17:10.303 killing process with pid 1564685 00:17:10.303 16:03:32 -- common/autotest_common.sh@955 -- # kill 1564685 00:17:10.303 16:03:32 -- common/autotest_common.sh@960 -- # wait 1564685 00:17:10.303 16:03:32 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:17:10.303 16:03:32 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:17:10.303 00:17:10.303 real 0m33.034s 00:17:10.303 user 0m35.622s 00:17:10.303 sys 0m23.912s 00:17:10.303 16:03:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:10.303 16:03:32 -- common/autotest_common.sh@10 -- # set +x 00:17:10.303 ************************************ 00:17:10.303 END TEST nvmf_vfio_user_fuzz 00:17:10.303 ************************************ 00:17:10.303 16:03:32 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:10.303 16:03:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:10.303 16:03:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:10.303 16:03:32 -- common/autotest_common.sh@10 -- # set +x 00:17:10.303 ************************************ 00:17:10.303 START TEST nvmf_host_management 00:17:10.303 ************************************ 00:17:10.303 16:03:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:10.303 * Looking for test storage... 00:17:10.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:10.303 16:03:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:10.303 16:03:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:10.303 16:03:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:10.303 16:03:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:10.303 16:03:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:10.303 16:03:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:10.303 16:03:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:10.303 16:03:32 -- scripts/common.sh@335 -- # IFS=.-: 00:17:10.303 16:03:32 -- scripts/common.sh@335 -- # read -ra ver1 00:17:10.303 16:03:32 -- scripts/common.sh@336 -- # IFS=.-: 00:17:10.303 16:03:32 -- scripts/common.sh@336 -- # read -ra ver2 00:17:10.303 16:03:32 -- scripts/common.sh@337 -- # local 'op=<' 00:17:10.303 16:03:32 -- scripts/common.sh@339 -- # ver1_l=2 00:17:10.303 16:03:32 -- scripts/common.sh@340 -- # ver2_l=1 00:17:10.303 16:03:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:10.303 16:03:32 -- scripts/common.sh@343 -- # case "$op" in 00:17:10.303 16:03:32 -- scripts/common.sh@344 -- # : 1 00:17:10.303 16:03:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:10.303 16:03:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:10.303 16:03:32 -- scripts/common.sh@364 -- # decimal 1 00:17:10.303 16:03:32 -- scripts/common.sh@352 -- # local d=1 00:17:10.304 16:03:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:10.304 16:03:32 -- scripts/common.sh@354 -- # echo 1 00:17:10.304 16:03:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:10.304 16:03:32 -- scripts/common.sh@365 -- # decimal 2 00:17:10.304 16:03:32 -- scripts/common.sh@352 -- # local d=2 00:17:10.304 16:03:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:10.304 16:03:32 -- scripts/common.sh@354 -- # echo 2 00:17:10.304 16:03:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:10.304 16:03:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:10.304 16:03:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:10.304 16:03:32 -- scripts/common.sh@367 -- # return 0 00:17:10.304 16:03:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:10.304 16:03:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:10.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.304 --rc genhtml_branch_coverage=1 00:17:10.304 --rc genhtml_function_coverage=1 00:17:10.304 --rc genhtml_legend=1 00:17:10.304 --rc geninfo_all_blocks=1 00:17:10.304 --rc geninfo_unexecuted_blocks=1 00:17:10.304 00:17:10.304 ' 00:17:10.304 16:03:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:10.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.304 --rc genhtml_branch_coverage=1 00:17:10.304 --rc genhtml_function_coverage=1 00:17:10.304 --rc genhtml_legend=1 00:17:10.304 --rc geninfo_all_blocks=1 00:17:10.304 --rc geninfo_unexecuted_blocks=1 00:17:10.304 00:17:10.304 ' 00:17:10.304 16:03:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:10.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.304 --rc genhtml_branch_coverage=1 00:17:10.304 --rc genhtml_function_coverage=1 00:17:10.304 --rc genhtml_legend=1 00:17:10.304 --rc geninfo_all_blocks=1 00:17:10.304 --rc geninfo_unexecuted_blocks=1 00:17:10.304 00:17:10.304 ' 00:17:10.304 16:03:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:10.304 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.304 --rc genhtml_branch_coverage=1 00:17:10.304 --rc genhtml_function_coverage=1 00:17:10.304 --rc genhtml_legend=1 00:17:10.304 --rc geninfo_all_blocks=1 00:17:10.304 --rc geninfo_unexecuted_blocks=1 00:17:10.304 00:17:10.304 ' 00:17:10.304 16:03:32 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:10.304 16:03:32 -- nvmf/common.sh@7 -- # uname -s 00:17:10.304 16:03:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:10.304 16:03:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:10.304 16:03:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:10.304 16:03:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:10.304 16:03:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:10.304 16:03:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:10.304 16:03:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:10.304 16:03:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:10.304 16:03:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:10.304 16:03:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:10.304 16:03:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:10.304 16:03:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:10.304 16:03:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:10.304 16:03:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:10.304 16:03:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:10.304 16:03:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:10.304 16:03:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:10.304 16:03:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:10.304 16:03:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:10.304 16:03:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.304 16:03:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.304 16:03:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.304 16:03:32 -- paths/export.sh@5 -- # export PATH 00:17:10.304 16:03:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.304 16:03:32 -- nvmf/common.sh@46 -- # : 0 00:17:10.304 16:03:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:10.304 16:03:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:10.304 16:03:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:10.304 16:03:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:10.304 16:03:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:10.304 16:03:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:10.304 16:03:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:10.304 16:03:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:10.304 16:03:32 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:10.304 16:03:32 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:10.304 16:03:32 -- target/host_management.sh@104 -- # nvmftestinit 00:17:10.304 16:03:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:10.304 16:03:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:10.304 16:03:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:10.304 16:03:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:10.304 16:03:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:10.304 16:03:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:10.304 16:03:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:10.304 16:03:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:10.304 16:03:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:10.304 16:03:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:10.304 16:03:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:10.304 16:03:32 -- common/autotest_common.sh@10 -- # set +x 00:17:11.239 16:03:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:11.239 16:03:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:11.239 16:03:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:11.239 16:03:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:11.239 16:03:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:11.239 16:03:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:11.239 16:03:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:11.239 16:03:34 -- nvmf/common.sh@294 -- # net_devs=() 00:17:11.239 16:03:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:11.239 16:03:34 -- nvmf/common.sh@295 -- # e810=() 00:17:11.239 16:03:34 -- nvmf/common.sh@295 -- # local -ga e810 00:17:11.239 16:03:34 -- nvmf/common.sh@296 -- # x722=() 00:17:11.239 16:03:34 -- nvmf/common.sh@296 -- # local -ga x722 00:17:11.239 16:03:34 -- nvmf/common.sh@297 -- # mlx=() 00:17:11.239 16:03:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:11.239 16:03:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:11.239 16:03:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:11.239 16:03:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:11.239 16:03:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:11.239 16:03:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:11.239 16:03:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:11.239 16:03:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:11.239 16:03:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:11.239 16:03:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:11.239 16:03:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:11.239 16:03:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:11.239 16:03:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:11.239 16:03:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:11.239 16:03:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:11.239 16:03:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:11.239 16:03:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:11.239 16:03:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:11.239 16:03:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:11.239 16:03:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:11.239 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:11.239 16:03:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:11.239 16:03:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:11.240 16:03:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:11.240 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:11.240 16:03:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:11.240 16:03:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:11.240 16:03:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:11.240 16:03:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:11.240 16:03:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:11.240 16:03:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:11.240 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:11.240 16:03:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:11.240 16:03:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:11.240 16:03:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:11.240 16:03:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:11.240 16:03:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:11.240 16:03:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:11.240 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:11.240 16:03:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:11.240 16:03:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:11.240 16:03:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:11.240 16:03:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:11.240 16:03:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:11.240 16:03:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:11.240 16:03:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:11.240 16:03:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:11.240 16:03:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:11.240 16:03:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:11.240 16:03:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:11.240 16:03:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:11.240 16:03:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:11.240 16:03:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:11.240 16:03:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:11.240 16:03:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:11.240 16:03:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:11.240 16:03:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:11.240 16:03:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:11.498 16:03:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:11.498 16:03:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:11.498 16:03:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:11.498 16:03:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:11.498 16:03:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:11.498 16:03:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:11.498 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:11.498 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.156 ms 00:17:11.498 00:17:11.498 --- 10.0.0.2 ping statistics --- 00:17:11.498 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:11.498 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:17:11.498 16:03:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:11.498 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:11.498 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.133 ms 00:17:11.498 00:17:11.498 --- 10.0.0.1 ping statistics --- 00:17:11.498 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:11.498 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:17:11.498 16:03:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:11.498 16:03:34 -- nvmf/common.sh@410 -- # return 0 00:17:11.498 16:03:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:11.498 16:03:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:11.498 16:03:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:11.498 16:03:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:11.498 16:03:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:11.498 16:03:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:11.499 16:03:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:11.499 16:03:34 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:17:11.499 16:03:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:11.499 16:03:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:11.499 16:03:34 -- common/autotest_common.sh@10 -- # set +x 00:17:11.499 ************************************ 00:17:11.499 START TEST nvmf_host_management 00:17:11.499 ************************************ 00:17:11.499 16:03:34 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:17:11.499 16:03:34 -- target/host_management.sh@69 -- # starttarget 00:17:11.499 16:03:34 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:11.499 16:03:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:11.499 16:03:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:11.499 16:03:34 -- common/autotest_common.sh@10 -- # set +x 00:17:11.499 16:03:34 -- nvmf/common.sh@469 -- # nvmfpid=1570934 00:17:11.499 16:03:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:11.499 16:03:34 -- nvmf/common.sh@470 -- # waitforlisten 1570934 00:17:11.499 16:03:34 -- common/autotest_common.sh@829 -- # '[' -z 1570934 ']' 00:17:11.499 16:03:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:11.499 16:03:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:11.499 16:03:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:11.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:11.499 16:03:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:11.499 16:03:34 -- common/autotest_common.sh@10 -- # set +x 00:17:11.499 [2024-11-18 16:03:34.967777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:11.499 [2024-11-18 16:03:34.967851] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:11.499 EAL: No free 2048 kB hugepages reported on node 1 00:17:11.499 [2024-11-18 16:03:35.037069] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:11.757 [2024-11-18 16:03:35.129631] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:11.757 [2024-11-18 16:03:35.129805] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:11.757 [2024-11-18 16:03:35.129825] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:11.757 [2024-11-18 16:03:35.129840] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:11.757 [2024-11-18 16:03:35.129943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:11.757 [2024-11-18 16:03:35.130037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:11.757 [2024-11-18 16:03:35.130062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:11.757 [2024-11-18 16:03:35.130065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:12.688 16:03:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:12.688 16:03:35 -- common/autotest_common.sh@862 -- # return 0 00:17:12.688 16:03:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:12.688 16:03:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:12.688 16:03:35 -- common/autotest_common.sh@10 -- # set +x 00:17:12.688 16:03:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:12.688 16:03:35 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:12.688 16:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:12.688 16:03:35 -- common/autotest_common.sh@10 -- # set +x 00:17:12.688 [2024-11-18 16:03:35.969286] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:12.688 16:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:12.688 16:03:35 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:12.688 16:03:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:12.688 16:03:35 -- common/autotest_common.sh@10 -- # set +x 00:17:12.688 16:03:35 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:12.688 16:03:35 -- target/host_management.sh@23 -- # cat 00:17:12.688 16:03:35 -- target/host_management.sh@30 -- # rpc_cmd 00:17:12.688 16:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:12.688 16:03:35 -- common/autotest_common.sh@10 -- # set +x 00:17:12.688 Malloc0 00:17:12.688 [2024-11-18 16:03:36.028809] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:12.688 16:03:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:12.688 16:03:36 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:12.688 16:03:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:12.688 16:03:36 -- common/autotest_common.sh@10 -- # set +x 00:17:12.688 16:03:36 -- target/host_management.sh@73 -- # perfpid=1571114 00:17:12.688 16:03:36 -- target/host_management.sh@74 -- # waitforlisten 1571114 /var/tmp/bdevperf.sock 00:17:12.688 16:03:36 -- common/autotest_common.sh@829 -- # '[' -z 1571114 ']' 00:17:12.688 16:03:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:12.688 16:03:36 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:12.688 16:03:36 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:12.688 16:03:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:12.688 16:03:36 -- nvmf/common.sh@520 -- # config=() 00:17:12.688 16:03:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:12.688 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:12.688 16:03:36 -- nvmf/common.sh@520 -- # local subsystem config 00:17:12.688 16:03:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:12.688 16:03:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:12.688 16:03:36 -- common/autotest_common.sh@10 -- # set +x 00:17:12.688 16:03:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:12.688 { 00:17:12.688 "params": { 00:17:12.688 "name": "Nvme$subsystem", 00:17:12.688 "trtype": "$TEST_TRANSPORT", 00:17:12.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:12.688 "adrfam": "ipv4", 00:17:12.688 "trsvcid": "$NVMF_PORT", 00:17:12.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:12.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:12.688 "hdgst": ${hdgst:-false}, 00:17:12.688 "ddgst": ${ddgst:-false} 00:17:12.688 }, 00:17:12.688 "method": "bdev_nvme_attach_controller" 00:17:12.688 } 00:17:12.688 EOF 00:17:12.688 )") 00:17:12.688 16:03:36 -- nvmf/common.sh@542 -- # cat 00:17:12.688 16:03:36 -- nvmf/common.sh@544 -- # jq . 00:17:12.688 16:03:36 -- nvmf/common.sh@545 -- # IFS=, 00:17:12.688 16:03:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:12.688 "params": { 00:17:12.688 "name": "Nvme0", 00:17:12.688 "trtype": "tcp", 00:17:12.688 "traddr": "10.0.0.2", 00:17:12.688 "adrfam": "ipv4", 00:17:12.688 "trsvcid": "4420", 00:17:12.688 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:12.688 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:12.688 "hdgst": false, 00:17:12.688 "ddgst": false 00:17:12.689 }, 00:17:12.689 "method": "bdev_nvme_attach_controller" 00:17:12.689 }' 00:17:12.689 [2024-11-18 16:03:36.097778] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:12.689 [2024-11-18 16:03:36.097856] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1571114 ] 00:17:12.689 EAL: No free 2048 kB hugepages reported on node 1 00:17:12.689 [2024-11-18 16:03:36.160259] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:12.689 [2024-11-18 16:03:36.244967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:13.254 Running I/O for 10 seconds... 00:17:13.511 16:03:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:13.511 16:03:37 -- common/autotest_common.sh@862 -- # return 0 00:17:13.511 16:03:37 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:13.511 16:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.511 16:03:37 -- common/autotest_common.sh@10 -- # set +x 00:17:13.511 16:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.511 16:03:37 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:13.511 16:03:37 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:13.511 16:03:37 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:13.511 16:03:37 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:13.511 16:03:37 -- target/host_management.sh@52 -- # local ret=1 00:17:13.511 16:03:37 -- target/host_management.sh@53 -- # local i 00:17:13.511 16:03:37 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:13.511 16:03:37 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:13.511 16:03:37 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:13.511 16:03:37 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:13.511 16:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.511 16:03:37 -- common/autotest_common.sh@10 -- # set +x 00:17:13.511 16:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.769 16:03:37 -- target/host_management.sh@55 -- # read_io_count=2082 00:17:13.769 16:03:37 -- target/host_management.sh@58 -- # '[' 2082 -ge 100 ']' 00:17:13.769 16:03:37 -- target/host_management.sh@59 -- # ret=0 00:17:13.769 16:03:37 -- target/host_management.sh@60 -- # break 00:17:13.769 16:03:37 -- target/host_management.sh@64 -- # return 0 00:17:13.769 16:03:37 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:13.769 16:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.769 16:03:37 -- common/autotest_common.sh@10 -- # set +x 00:17:13.769 [2024-11-18 16:03:37.113206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.113984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.114008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.114029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.114049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.769 [2024-11-18 16:03:37.114070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec3f40 is same with the state(5) to be set 00:17:13.770 [2024-11-18 16:03:37.114503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.114983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.114997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.770 [2024-11-18 16:03:37.115524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.770 [2024-11-18 16:03:37.115539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.115979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.115993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:13.771 [2024-11-18 16:03:37.116560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:13.771 [2024-11-18 16:03:37.116663] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a37f30 was disconnected and freed. reset controller. 00:17:13.771 16:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.771 16:03:37 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:13.771 16:03:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.771 16:03:37 -- common/autotest_common.sh@10 -- # set +x 00:17:13.771 [2024-11-18 16:03:37.117831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:13.771 task offset: 17792 on job bdev=Nvme0n1 fails 00:17:13.771 00:17:13.771 Latency(us) 00:17:13.771 [2024-11-18T15:03:37.362Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:13.771 [2024-11-18T15:03:37.362Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:13.771 [2024-11-18T15:03:37.362Z] Job: Nvme0n1 ended in about 0.57 seconds with error 00:17:13.771 Verification LBA range: start 0x0 length 0x400 00:17:13.771 Nvme0n1 : 0.57 3883.14 242.70 112.05 0.00 15766.57 4805.97 20291.89 00:17:13.771 [2024-11-18T15:03:37.362Z] =================================================================================================================== 00:17:13.771 [2024-11-18T15:03:37.362Z] Total : 3883.14 242.70 112.05 0.00 15766.57 4805.97 20291.89 00:17:13.771 [2024-11-18 16:03:37.119785] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:13.771 [2024-11-18 16:03:37.119816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a3a870 (9): Bad file descriptor 00:17:13.771 16:03:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.771 16:03:37 -- target/host_management.sh@87 -- # sleep 1 00:17:13.771 [2024-11-18 16:03:37.170763] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:14.704 16:03:38 -- target/host_management.sh@91 -- # kill -9 1571114 00:17:14.704 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1571114) - No such process 00:17:14.704 16:03:38 -- target/host_management.sh@91 -- # true 00:17:14.704 16:03:38 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:14.704 16:03:38 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:14.704 16:03:38 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:14.704 16:03:38 -- nvmf/common.sh@520 -- # config=() 00:17:14.704 16:03:38 -- nvmf/common.sh@520 -- # local subsystem config 00:17:14.704 16:03:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:14.704 16:03:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:14.704 { 00:17:14.704 "params": { 00:17:14.704 "name": "Nvme$subsystem", 00:17:14.704 "trtype": "$TEST_TRANSPORT", 00:17:14.704 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:14.704 "adrfam": "ipv4", 00:17:14.704 "trsvcid": "$NVMF_PORT", 00:17:14.704 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:14.704 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:14.704 "hdgst": ${hdgst:-false}, 00:17:14.704 "ddgst": ${ddgst:-false} 00:17:14.704 }, 00:17:14.704 "method": "bdev_nvme_attach_controller" 00:17:14.704 } 00:17:14.704 EOF 00:17:14.704 )") 00:17:14.704 16:03:38 -- nvmf/common.sh@542 -- # cat 00:17:14.704 16:03:38 -- nvmf/common.sh@544 -- # jq . 00:17:14.704 16:03:38 -- nvmf/common.sh@545 -- # IFS=, 00:17:14.704 16:03:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:14.704 "params": { 00:17:14.704 "name": "Nvme0", 00:17:14.704 "trtype": "tcp", 00:17:14.704 "traddr": "10.0.0.2", 00:17:14.704 "adrfam": "ipv4", 00:17:14.704 "trsvcid": "4420", 00:17:14.704 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:14.704 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:14.704 "hdgst": false, 00:17:14.704 "ddgst": false 00:17:14.704 }, 00:17:14.704 "method": "bdev_nvme_attach_controller" 00:17:14.704 }' 00:17:14.704 [2024-11-18 16:03:38.173547] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:14.704 [2024-11-18 16:03:38.173662] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1571295 ] 00:17:14.704 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.704 [2024-11-18 16:03:38.238332] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:14.962 [2024-11-18 16:03:38.325083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:15.219 Running I/O for 1 seconds... 00:17:16.151 00:17:16.151 Latency(us) 00:17:16.151 [2024-11-18T15:03:39.742Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:16.151 [2024-11-18T15:03:39.742Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:16.151 Verification LBA range: start 0x0 length 0x400 00:17:16.151 Nvme0n1 : 1.01 3682.34 230.15 0.00 0.00 17079.84 1140.81 24078.41 00:17:16.151 [2024-11-18T15:03:39.742Z] =================================================================================================================== 00:17:16.151 [2024-11-18T15:03:39.742Z] Total : 3682.34 230.15 0.00 0.00 17079.84 1140.81 24078.41 00:17:16.409 16:03:39 -- target/host_management.sh@101 -- # stoptarget 00:17:16.409 16:03:39 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:16.409 16:03:39 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:16.409 16:03:39 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:16.409 16:03:39 -- target/host_management.sh@40 -- # nvmftestfini 00:17:16.409 16:03:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:16.409 16:03:39 -- nvmf/common.sh@116 -- # sync 00:17:16.409 16:03:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:16.409 16:03:39 -- nvmf/common.sh@119 -- # set +e 00:17:16.409 16:03:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:16.409 16:03:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:16.409 rmmod nvme_tcp 00:17:16.409 rmmod nvme_fabrics 00:17:16.409 rmmod nvme_keyring 00:17:16.409 16:03:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:16.409 16:03:39 -- nvmf/common.sh@123 -- # set -e 00:17:16.409 16:03:39 -- nvmf/common.sh@124 -- # return 0 00:17:16.409 16:03:39 -- nvmf/common.sh@477 -- # '[' -n 1570934 ']' 00:17:16.409 16:03:39 -- nvmf/common.sh@478 -- # killprocess 1570934 00:17:16.409 16:03:39 -- common/autotest_common.sh@936 -- # '[' -z 1570934 ']' 00:17:16.409 16:03:39 -- common/autotest_common.sh@940 -- # kill -0 1570934 00:17:16.409 16:03:39 -- common/autotest_common.sh@941 -- # uname 00:17:16.409 16:03:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:16.409 16:03:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1570934 00:17:16.409 16:03:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:16.409 16:03:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:16.409 16:03:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1570934' 00:17:16.409 killing process with pid 1570934 00:17:16.409 16:03:39 -- common/autotest_common.sh@955 -- # kill 1570934 00:17:16.409 16:03:39 -- common/autotest_common.sh@960 -- # wait 1570934 00:17:16.667 [2024-11-18 16:03:40.205138] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:16.668 16:03:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:16.668 16:03:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:16.668 16:03:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:16.668 16:03:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:16.668 16:03:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:16.668 16:03:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:16.668 16:03:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:16.668 16:03:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:19.196 16:03:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:19.196 00:17:19.196 real 0m7.356s 00:17:19.196 user 0m22.780s 00:17:19.196 sys 0m1.479s 00:17:19.196 16:03:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:19.196 16:03:42 -- common/autotest_common.sh@10 -- # set +x 00:17:19.196 ************************************ 00:17:19.196 END TEST nvmf_host_management 00:17:19.196 ************************************ 00:17:19.196 16:03:42 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:19.196 00:17:19.196 real 0m9.677s 00:17:19.196 user 0m23.620s 00:17:19.196 sys 0m2.991s 00:17:19.196 16:03:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:19.196 16:03:42 -- common/autotest_common.sh@10 -- # set +x 00:17:19.196 ************************************ 00:17:19.196 END TEST nvmf_host_management 00:17:19.196 ************************************ 00:17:19.196 16:03:42 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:19.196 16:03:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:19.196 16:03:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:19.196 16:03:42 -- common/autotest_common.sh@10 -- # set +x 00:17:19.196 ************************************ 00:17:19.196 START TEST nvmf_lvol 00:17:19.196 ************************************ 00:17:19.196 16:03:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:19.196 * Looking for test storage... 00:17:19.196 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:19.196 16:03:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:19.196 16:03:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:19.196 16:03:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:19.196 16:03:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:19.196 16:03:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:19.196 16:03:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:19.196 16:03:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:19.196 16:03:42 -- scripts/common.sh@335 -- # IFS=.-: 00:17:19.196 16:03:42 -- scripts/common.sh@335 -- # read -ra ver1 00:17:19.196 16:03:42 -- scripts/common.sh@336 -- # IFS=.-: 00:17:19.196 16:03:42 -- scripts/common.sh@336 -- # read -ra ver2 00:17:19.196 16:03:42 -- scripts/common.sh@337 -- # local 'op=<' 00:17:19.196 16:03:42 -- scripts/common.sh@339 -- # ver1_l=2 00:17:19.196 16:03:42 -- scripts/common.sh@340 -- # ver2_l=1 00:17:19.196 16:03:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:19.196 16:03:42 -- scripts/common.sh@343 -- # case "$op" in 00:17:19.196 16:03:42 -- scripts/common.sh@344 -- # : 1 00:17:19.196 16:03:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:19.196 16:03:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:19.196 16:03:42 -- scripts/common.sh@364 -- # decimal 1 00:17:19.196 16:03:42 -- scripts/common.sh@352 -- # local d=1 00:17:19.196 16:03:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:19.196 16:03:42 -- scripts/common.sh@354 -- # echo 1 00:17:19.196 16:03:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:19.196 16:03:42 -- scripts/common.sh@365 -- # decimal 2 00:17:19.196 16:03:42 -- scripts/common.sh@352 -- # local d=2 00:17:19.196 16:03:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:19.196 16:03:42 -- scripts/common.sh@354 -- # echo 2 00:17:19.196 16:03:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:19.196 16:03:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:19.196 16:03:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:19.196 16:03:42 -- scripts/common.sh@367 -- # return 0 00:17:19.196 16:03:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:19.196 16:03:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:19.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.196 --rc genhtml_branch_coverage=1 00:17:19.196 --rc genhtml_function_coverage=1 00:17:19.196 --rc genhtml_legend=1 00:17:19.196 --rc geninfo_all_blocks=1 00:17:19.196 --rc geninfo_unexecuted_blocks=1 00:17:19.196 00:17:19.196 ' 00:17:19.196 16:03:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:19.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.196 --rc genhtml_branch_coverage=1 00:17:19.196 --rc genhtml_function_coverage=1 00:17:19.196 --rc genhtml_legend=1 00:17:19.197 --rc geninfo_all_blocks=1 00:17:19.197 --rc geninfo_unexecuted_blocks=1 00:17:19.197 00:17:19.197 ' 00:17:19.197 16:03:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:19.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.197 --rc genhtml_branch_coverage=1 00:17:19.197 --rc genhtml_function_coverage=1 00:17:19.197 --rc genhtml_legend=1 00:17:19.197 --rc geninfo_all_blocks=1 00:17:19.197 --rc geninfo_unexecuted_blocks=1 00:17:19.197 00:17:19.197 ' 00:17:19.197 16:03:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:19.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:19.197 --rc genhtml_branch_coverage=1 00:17:19.197 --rc genhtml_function_coverage=1 00:17:19.197 --rc genhtml_legend=1 00:17:19.197 --rc geninfo_all_blocks=1 00:17:19.197 --rc geninfo_unexecuted_blocks=1 00:17:19.197 00:17:19.197 ' 00:17:19.197 16:03:42 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:19.197 16:03:42 -- nvmf/common.sh@7 -- # uname -s 00:17:19.197 16:03:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:19.197 16:03:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:19.197 16:03:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:19.197 16:03:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:19.197 16:03:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:19.197 16:03:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:19.197 16:03:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:19.197 16:03:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:19.197 16:03:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:19.197 16:03:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:19.197 16:03:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:19.197 16:03:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:19.197 16:03:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:19.197 16:03:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:19.197 16:03:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:19.197 16:03:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:19.197 16:03:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:19.197 16:03:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:19.197 16:03:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:19.197 16:03:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.197 16:03:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.197 16:03:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.197 16:03:42 -- paths/export.sh@5 -- # export PATH 00:17:19.197 16:03:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:19.197 16:03:42 -- nvmf/common.sh@46 -- # : 0 00:17:19.197 16:03:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:19.197 16:03:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:19.197 16:03:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:19.197 16:03:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:19.197 16:03:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:19.197 16:03:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:19.197 16:03:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:19.197 16:03:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:19.197 16:03:42 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:19.197 16:03:42 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:19.197 16:03:42 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:19.197 16:03:42 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:19.197 16:03:42 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:19.197 16:03:42 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:19.197 16:03:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:19.197 16:03:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:19.197 16:03:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:19.197 16:03:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:19.197 16:03:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:19.197 16:03:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:19.197 16:03:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:19.197 16:03:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:19.197 16:03:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:19.197 16:03:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:19.197 16:03:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:19.197 16:03:42 -- common/autotest_common.sh@10 -- # set +x 00:17:21.103 16:03:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:21.103 16:03:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:21.103 16:03:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:21.103 16:03:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:21.103 16:03:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:21.103 16:03:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:21.103 16:03:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:21.103 16:03:44 -- nvmf/common.sh@294 -- # net_devs=() 00:17:21.103 16:03:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:21.103 16:03:44 -- nvmf/common.sh@295 -- # e810=() 00:17:21.103 16:03:44 -- nvmf/common.sh@295 -- # local -ga e810 00:17:21.103 16:03:44 -- nvmf/common.sh@296 -- # x722=() 00:17:21.103 16:03:44 -- nvmf/common.sh@296 -- # local -ga x722 00:17:21.103 16:03:44 -- nvmf/common.sh@297 -- # mlx=() 00:17:21.103 16:03:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:21.103 16:03:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:21.103 16:03:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:21.103 16:03:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:21.103 16:03:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:21.103 16:03:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:21.103 16:03:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:21.103 16:03:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:21.103 16:03:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:21.103 16:03:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:21.103 16:03:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:21.103 16:03:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:21.103 16:03:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:21.103 16:03:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:21.103 16:03:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:21.103 16:03:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:21.103 16:03:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:21.103 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:21.103 16:03:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:21.103 16:03:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:21.103 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:21.103 16:03:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:21.103 16:03:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:21.103 16:03:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:21.103 16:03:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:21.103 16:03:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:21.103 16:03:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:21.103 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:21.103 16:03:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:21.103 16:03:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:21.103 16:03:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:21.103 16:03:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:21.103 16:03:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:21.103 16:03:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:21.103 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:21.103 16:03:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:21.103 16:03:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:21.103 16:03:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:21.103 16:03:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:21.103 16:03:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:21.103 16:03:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:21.103 16:03:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:21.103 16:03:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:21.103 16:03:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:21.103 16:03:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:21.103 16:03:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:21.103 16:03:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:21.104 16:03:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:21.104 16:03:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:21.104 16:03:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:21.104 16:03:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:21.104 16:03:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:21.104 16:03:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:21.104 16:03:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:21.104 16:03:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:21.104 16:03:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:21.104 16:03:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:21.104 16:03:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:21.104 16:03:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:21.104 16:03:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:21.104 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:21.104 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:17:21.104 00:17:21.104 --- 10.0.0.2 ping statistics --- 00:17:21.104 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:21.104 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:17:21.104 16:03:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:21.104 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:21.104 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.141 ms 00:17:21.104 00:17:21.104 --- 10.0.0.1 ping statistics --- 00:17:21.104 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:21.104 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:17:21.104 16:03:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:21.104 16:03:44 -- nvmf/common.sh@410 -- # return 0 00:17:21.104 16:03:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:21.104 16:03:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:21.104 16:03:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:21.104 16:03:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:21.104 16:03:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:21.104 16:03:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:21.104 16:03:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:21.104 16:03:44 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:21.104 16:03:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:21.104 16:03:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:21.104 16:03:44 -- common/autotest_common.sh@10 -- # set +x 00:17:21.104 16:03:44 -- nvmf/common.sh@469 -- # nvmfpid=1573518 00:17:21.104 16:03:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:21.104 16:03:44 -- nvmf/common.sh@470 -- # waitforlisten 1573518 00:17:21.104 16:03:44 -- common/autotest_common.sh@829 -- # '[' -z 1573518 ']' 00:17:21.104 16:03:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:21.104 16:03:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:21.104 16:03:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:21.104 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:21.104 16:03:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:21.104 16:03:44 -- common/autotest_common.sh@10 -- # set +x 00:17:21.363 [2024-11-18 16:03:44.696917] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:21.363 [2024-11-18 16:03:44.697006] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:21.363 EAL: No free 2048 kB hugepages reported on node 1 00:17:21.363 [2024-11-18 16:03:44.760196] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:21.363 [2024-11-18 16:03:44.842915] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:21.363 [2024-11-18 16:03:44.843071] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:21.363 [2024-11-18 16:03:44.843103] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:21.363 [2024-11-18 16:03:44.843117] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:21.363 [2024-11-18 16:03:44.843267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:21.363 [2024-11-18 16:03:44.843329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:21.363 [2024-11-18 16:03:44.843332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:22.296 16:03:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:22.296 16:03:45 -- common/autotest_common.sh@862 -- # return 0 00:17:22.296 16:03:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:22.296 16:03:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:22.296 16:03:45 -- common/autotest_common.sh@10 -- # set +x 00:17:22.296 16:03:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:22.296 16:03:45 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:22.554 [2024-11-18 16:03:46.001071] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:22.554 16:03:46 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:22.812 16:03:46 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:22.812 16:03:46 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:23.070 16:03:46 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:23.070 16:03:46 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:23.328 16:03:46 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:23.586 16:03:47 -- target/nvmf_lvol.sh@29 -- # lvs=eebb9c3d-3d7f-4eea-b0f9-e1891cbb4cb4 00:17:23.586 16:03:47 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u eebb9c3d-3d7f-4eea-b0f9-e1891cbb4cb4 lvol 20 00:17:23.843 16:03:47 -- target/nvmf_lvol.sh@32 -- # lvol=9e7cb4f3-eacc-403d-ba17-2c5c7c1a46bb 00:17:23.843 16:03:47 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:24.101 16:03:47 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 9e7cb4f3-eacc-403d-ba17-2c5c7c1a46bb 00:17:24.359 16:03:47 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:24.617 [2024-11-18 16:03:48.109639] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:24.617 16:03:48 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:24.874 16:03:48 -- target/nvmf_lvol.sh@42 -- # perf_pid=1574087 00:17:24.874 16:03:48 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:24.874 16:03:48 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:24.874 EAL: No free 2048 kB hugepages reported on node 1 00:17:25.815 16:03:49 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 9e7cb4f3-eacc-403d-ba17-2c5c7c1a46bb MY_SNAPSHOT 00:17:26.381 16:03:49 -- target/nvmf_lvol.sh@47 -- # snapshot=0a647923-64e1-41df-9e4d-ab68105b2b93 00:17:26.381 16:03:49 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 9e7cb4f3-eacc-403d-ba17-2c5c7c1a46bb 30 00:17:26.639 16:03:49 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 0a647923-64e1-41df-9e4d-ab68105b2b93 MY_CLONE 00:17:26.897 16:03:50 -- target/nvmf_lvol.sh@49 -- # clone=bd061452-0037-4d7e-872a-47b05710bb39 00:17:26.897 16:03:50 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate bd061452-0037-4d7e-872a-47b05710bb39 00:17:27.463 16:03:50 -- target/nvmf_lvol.sh@53 -- # wait 1574087 00:17:35.604 Initializing NVMe Controllers 00:17:35.604 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:35.604 Controller IO queue size 128, less than required. 00:17:35.604 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:35.604 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:35.604 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:35.604 Initialization complete. Launching workers. 00:17:35.604 ======================================================== 00:17:35.604 Latency(us) 00:17:35.604 Device Information : IOPS MiB/s Average min max 00:17:35.604 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10861.10 42.43 11787.51 1440.41 71164.19 00:17:35.604 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10714.80 41.85 11951.05 2033.87 80462.40 00:17:35.604 ======================================================== 00:17:35.604 Total : 21575.90 84.28 11868.73 1440.41 80462.40 00:17:35.604 00:17:35.604 16:03:58 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:35.604 16:03:59 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 9e7cb4f3-eacc-403d-ba17-2c5c7c1a46bb 00:17:35.861 16:03:59 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u eebb9c3d-3d7f-4eea-b0f9-e1891cbb4cb4 00:17:36.119 16:03:59 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:36.119 16:03:59 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:36.119 16:03:59 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:36.119 16:03:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:36.119 16:03:59 -- nvmf/common.sh@116 -- # sync 00:17:36.119 16:03:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:36.119 16:03:59 -- nvmf/common.sh@119 -- # set +e 00:17:36.119 16:03:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:36.119 16:03:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:36.119 rmmod nvme_tcp 00:17:36.119 rmmod nvme_fabrics 00:17:36.376 rmmod nvme_keyring 00:17:36.376 16:03:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:36.376 16:03:59 -- nvmf/common.sh@123 -- # set -e 00:17:36.376 16:03:59 -- nvmf/common.sh@124 -- # return 0 00:17:36.376 16:03:59 -- nvmf/common.sh@477 -- # '[' -n 1573518 ']' 00:17:36.376 16:03:59 -- nvmf/common.sh@478 -- # killprocess 1573518 00:17:36.376 16:03:59 -- common/autotest_common.sh@936 -- # '[' -z 1573518 ']' 00:17:36.376 16:03:59 -- common/autotest_common.sh@940 -- # kill -0 1573518 00:17:36.376 16:03:59 -- common/autotest_common.sh@941 -- # uname 00:17:36.376 16:03:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:36.376 16:03:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1573518 00:17:36.376 16:03:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:36.376 16:03:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:36.376 16:03:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1573518' 00:17:36.376 killing process with pid 1573518 00:17:36.376 16:03:59 -- common/autotest_common.sh@955 -- # kill 1573518 00:17:36.376 16:03:59 -- common/autotest_common.sh@960 -- # wait 1573518 00:17:36.634 16:04:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:36.635 16:04:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:36.635 16:04:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:36.635 16:04:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:36.635 16:04:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:36.635 16:04:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:36.635 16:04:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:36.635 16:04:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:38.533 16:04:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:38.533 00:17:38.533 real 0m19.749s 00:17:38.533 user 1m7.487s 00:17:38.533 sys 0m5.430s 00:17:38.533 16:04:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:38.533 16:04:02 -- common/autotest_common.sh@10 -- # set +x 00:17:38.533 ************************************ 00:17:38.533 END TEST nvmf_lvol 00:17:38.533 ************************************ 00:17:38.533 16:04:02 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:38.533 16:04:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:38.533 16:04:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:38.533 16:04:02 -- common/autotest_common.sh@10 -- # set +x 00:17:38.534 ************************************ 00:17:38.534 START TEST nvmf_lvs_grow 00:17:38.534 ************************************ 00:17:38.534 16:04:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:38.791 * Looking for test storage... 00:17:38.791 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:38.791 16:04:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:38.791 16:04:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:38.791 16:04:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:38.791 16:04:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:38.791 16:04:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:38.791 16:04:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:38.791 16:04:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:38.791 16:04:02 -- scripts/common.sh@335 -- # IFS=.-: 00:17:38.791 16:04:02 -- scripts/common.sh@335 -- # read -ra ver1 00:17:38.791 16:04:02 -- scripts/common.sh@336 -- # IFS=.-: 00:17:38.791 16:04:02 -- scripts/common.sh@336 -- # read -ra ver2 00:17:38.791 16:04:02 -- scripts/common.sh@337 -- # local 'op=<' 00:17:38.791 16:04:02 -- scripts/common.sh@339 -- # ver1_l=2 00:17:38.791 16:04:02 -- scripts/common.sh@340 -- # ver2_l=1 00:17:38.791 16:04:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:38.791 16:04:02 -- scripts/common.sh@343 -- # case "$op" in 00:17:38.791 16:04:02 -- scripts/common.sh@344 -- # : 1 00:17:38.791 16:04:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:38.791 16:04:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:38.791 16:04:02 -- scripts/common.sh@364 -- # decimal 1 00:17:38.791 16:04:02 -- scripts/common.sh@352 -- # local d=1 00:17:38.791 16:04:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:38.791 16:04:02 -- scripts/common.sh@354 -- # echo 1 00:17:38.791 16:04:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:38.791 16:04:02 -- scripts/common.sh@365 -- # decimal 2 00:17:38.791 16:04:02 -- scripts/common.sh@352 -- # local d=2 00:17:38.791 16:04:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:38.791 16:04:02 -- scripts/common.sh@354 -- # echo 2 00:17:38.791 16:04:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:38.791 16:04:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:38.791 16:04:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:38.791 16:04:02 -- scripts/common.sh@367 -- # return 0 00:17:38.791 16:04:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:38.791 16:04:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:38.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:38.792 --rc genhtml_branch_coverage=1 00:17:38.792 --rc genhtml_function_coverage=1 00:17:38.792 --rc genhtml_legend=1 00:17:38.792 --rc geninfo_all_blocks=1 00:17:38.792 --rc geninfo_unexecuted_blocks=1 00:17:38.792 00:17:38.792 ' 00:17:38.792 16:04:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:38.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:38.792 --rc genhtml_branch_coverage=1 00:17:38.792 --rc genhtml_function_coverage=1 00:17:38.792 --rc genhtml_legend=1 00:17:38.792 --rc geninfo_all_blocks=1 00:17:38.792 --rc geninfo_unexecuted_blocks=1 00:17:38.792 00:17:38.792 ' 00:17:38.792 16:04:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:38.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:38.792 --rc genhtml_branch_coverage=1 00:17:38.792 --rc genhtml_function_coverage=1 00:17:38.792 --rc genhtml_legend=1 00:17:38.792 --rc geninfo_all_blocks=1 00:17:38.792 --rc geninfo_unexecuted_blocks=1 00:17:38.792 00:17:38.792 ' 00:17:38.792 16:04:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:38.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:38.792 --rc genhtml_branch_coverage=1 00:17:38.792 --rc genhtml_function_coverage=1 00:17:38.792 --rc genhtml_legend=1 00:17:38.792 --rc geninfo_all_blocks=1 00:17:38.792 --rc geninfo_unexecuted_blocks=1 00:17:38.792 00:17:38.792 ' 00:17:38.792 16:04:02 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:38.792 16:04:02 -- nvmf/common.sh@7 -- # uname -s 00:17:38.792 16:04:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:38.792 16:04:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:38.792 16:04:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:38.792 16:04:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:38.792 16:04:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:38.792 16:04:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:38.792 16:04:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:38.792 16:04:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:38.792 16:04:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:38.792 16:04:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:38.792 16:04:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:38.792 16:04:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:38.792 16:04:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:38.792 16:04:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:38.792 16:04:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:38.792 16:04:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:38.792 16:04:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:38.792 16:04:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:38.792 16:04:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:38.792 16:04:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:38.792 16:04:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:38.792 16:04:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:38.792 16:04:02 -- paths/export.sh@5 -- # export PATH 00:17:38.792 16:04:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:38.792 16:04:02 -- nvmf/common.sh@46 -- # : 0 00:17:38.792 16:04:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:38.792 16:04:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:38.792 16:04:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:38.792 16:04:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:38.792 16:04:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:38.792 16:04:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:38.792 16:04:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:38.792 16:04:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:38.792 16:04:02 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:38.792 16:04:02 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:38.792 16:04:02 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:38.792 16:04:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:38.792 16:04:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:38.792 16:04:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:38.792 16:04:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:38.792 16:04:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:38.792 16:04:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:38.792 16:04:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:38.792 16:04:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:38.792 16:04:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:38.792 16:04:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:38.792 16:04:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:38.792 16:04:02 -- common/autotest_common.sh@10 -- # set +x 00:17:41.320 16:04:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:41.320 16:04:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:41.320 16:04:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:41.320 16:04:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:41.320 16:04:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:41.320 16:04:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:41.320 16:04:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:41.320 16:04:04 -- nvmf/common.sh@294 -- # net_devs=() 00:17:41.320 16:04:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:41.320 16:04:04 -- nvmf/common.sh@295 -- # e810=() 00:17:41.320 16:04:04 -- nvmf/common.sh@295 -- # local -ga e810 00:17:41.320 16:04:04 -- nvmf/common.sh@296 -- # x722=() 00:17:41.320 16:04:04 -- nvmf/common.sh@296 -- # local -ga x722 00:17:41.320 16:04:04 -- nvmf/common.sh@297 -- # mlx=() 00:17:41.320 16:04:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:41.320 16:04:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:41.320 16:04:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:41.320 16:04:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:41.320 16:04:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:41.320 16:04:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:41.320 16:04:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:41.320 16:04:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:41.320 16:04:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:41.320 16:04:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:41.320 16:04:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:41.320 16:04:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:41.320 16:04:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:41.320 16:04:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:41.320 16:04:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:41.320 16:04:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:41.320 16:04:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:41.320 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:41.320 16:04:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:41.320 16:04:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:41.320 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:41.320 16:04:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:41.320 16:04:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:41.320 16:04:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:41.320 16:04:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:41.320 16:04:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:41.320 16:04:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:41.320 16:04:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:41.320 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:41.320 16:04:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:41.320 16:04:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:41.320 16:04:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:41.320 16:04:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:41.320 16:04:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:41.320 16:04:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:41.320 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:41.320 16:04:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:41.320 16:04:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:41.320 16:04:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:41.320 16:04:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:41.321 16:04:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:41.321 16:04:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:41.321 16:04:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:41.321 16:04:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:41.321 16:04:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:41.321 16:04:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:41.321 16:04:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:41.321 16:04:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:41.321 16:04:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:41.321 16:04:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:41.321 16:04:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:41.321 16:04:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:41.321 16:04:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:41.321 16:04:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:41.321 16:04:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:41.321 16:04:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:41.321 16:04:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:41.321 16:04:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:41.321 16:04:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:41.321 16:04:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:41.321 16:04:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:41.321 16:04:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:41.321 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:41.321 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.326 ms 00:17:41.321 00:17:41.321 --- 10.0.0.2 ping statistics --- 00:17:41.321 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:41.321 rtt min/avg/max/mdev = 0.326/0.326/0.326/0.000 ms 00:17:41.321 16:04:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:41.321 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:41.321 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:17:41.321 00:17:41.321 --- 10.0.0.1 ping statistics --- 00:17:41.321 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:41.321 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:17:41.321 16:04:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:41.321 16:04:04 -- nvmf/common.sh@410 -- # return 0 00:17:41.321 16:04:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:41.321 16:04:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:41.321 16:04:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:41.321 16:04:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:41.321 16:04:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:41.321 16:04:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:41.321 16:04:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:41.321 16:04:04 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:41.321 16:04:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:41.321 16:04:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:41.321 16:04:04 -- common/autotest_common.sh@10 -- # set +x 00:17:41.321 16:04:04 -- nvmf/common.sh@469 -- # nvmfpid=1577409 00:17:41.321 16:04:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:41.321 16:04:04 -- nvmf/common.sh@470 -- # waitforlisten 1577409 00:17:41.321 16:04:04 -- common/autotest_common.sh@829 -- # '[' -z 1577409 ']' 00:17:41.321 16:04:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:41.321 16:04:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:41.321 16:04:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:41.321 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:41.321 16:04:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:41.321 16:04:04 -- common/autotest_common.sh@10 -- # set +x 00:17:41.321 [2024-11-18 16:04:04.513967] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:41.321 [2024-11-18 16:04:04.514037] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:41.321 EAL: No free 2048 kB hugepages reported on node 1 00:17:41.321 [2024-11-18 16:04:04.580180] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:41.321 [2024-11-18 16:04:04.671015] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:41.321 [2024-11-18 16:04:04.671173] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:41.321 [2024-11-18 16:04:04.671205] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:41.321 [2024-11-18 16:04:04.671231] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:41.321 [2024-11-18 16:04:04.671274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:42.254 16:04:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:42.254 16:04:05 -- common/autotest_common.sh@862 -- # return 0 00:17:42.254 16:04:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:42.254 16:04:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:42.254 16:04:05 -- common/autotest_common.sh@10 -- # set +x 00:17:42.254 16:04:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:42.254 16:04:05 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:42.254 [2024-11-18 16:04:05.778407] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:42.254 16:04:05 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:42.254 16:04:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:42.254 16:04:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:42.254 16:04:05 -- common/autotest_common.sh@10 -- # set +x 00:17:42.254 ************************************ 00:17:42.254 START TEST lvs_grow_clean 00:17:42.254 ************************************ 00:17:42.254 16:04:05 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:42.254 16:04:05 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:42.254 16:04:05 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:42.254 16:04:05 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:42.254 16:04:05 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:42.254 16:04:05 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:42.254 16:04:05 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:42.254 16:04:05 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:42.254 16:04:05 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:42.254 16:04:05 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:42.512 16:04:06 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:42.512 16:04:06 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:42.770 16:04:06 -- target/nvmf_lvs_grow.sh@28 -- # lvs=e1293a23-c107-4f78-9697-668f9ad83461 00:17:42.770 16:04:06 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1293a23-c107-4f78-9697-668f9ad83461 00:17:42.770 16:04:06 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:43.028 16:04:06 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:43.028 16:04:06 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:43.028 16:04:06 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e1293a23-c107-4f78-9697-668f9ad83461 lvol 150 00:17:43.286 16:04:06 -- target/nvmf_lvs_grow.sh@33 -- # lvol=95e23f9e-fec0-4bf7-97f4-9675b2fd9d42 00:17:43.286 16:04:06 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:43.286 16:04:06 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:43.545 [2024-11-18 16:04:07.079895] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:43.545 [2024-11-18 16:04:07.080013] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:43.545 true 00:17:43.545 16:04:07 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1293a23-c107-4f78-9697-668f9ad83461 00:17:43.545 16:04:07 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:43.804 16:04:07 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:43.804 16:04:07 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:44.061 16:04:07 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 95e23f9e-fec0-4bf7-97f4-9675b2fd9d42 00:17:44.320 16:04:07 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:44.578 [2024-11-18 16:04:08.087188] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:44.578 16:04:08 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:44.836 16:04:08 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1577859 00:17:44.836 16:04:08 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:44.836 16:04:08 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:44.836 16:04:08 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1577859 /var/tmp/bdevperf.sock 00:17:44.836 16:04:08 -- common/autotest_common.sh@829 -- # '[' -z 1577859 ']' 00:17:44.836 16:04:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:44.836 16:04:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:44.836 16:04:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:44.836 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:44.836 16:04:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:44.836 16:04:08 -- common/autotest_common.sh@10 -- # set +x 00:17:44.836 [2024-11-18 16:04:08.395261] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:44.836 [2024-11-18 16:04:08.395348] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1577859 ] 00:17:44.836 EAL: No free 2048 kB hugepages reported on node 1 00:17:45.094 [2024-11-18 16:04:08.457826] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.094 [2024-11-18 16:04:08.548008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:46.028 16:04:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:46.028 16:04:09 -- common/autotest_common.sh@862 -- # return 0 00:17:46.028 16:04:09 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:46.284 Nvme0n1 00:17:46.284 16:04:09 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:46.849 [ 00:17:46.849 { 00:17:46.849 "name": "Nvme0n1", 00:17:46.849 "aliases": [ 00:17:46.849 "95e23f9e-fec0-4bf7-97f4-9675b2fd9d42" 00:17:46.849 ], 00:17:46.849 "product_name": "NVMe disk", 00:17:46.849 "block_size": 4096, 00:17:46.849 "num_blocks": 38912, 00:17:46.850 "uuid": "95e23f9e-fec0-4bf7-97f4-9675b2fd9d42", 00:17:46.850 "assigned_rate_limits": { 00:17:46.850 "rw_ios_per_sec": 0, 00:17:46.850 "rw_mbytes_per_sec": 0, 00:17:46.850 "r_mbytes_per_sec": 0, 00:17:46.850 "w_mbytes_per_sec": 0 00:17:46.850 }, 00:17:46.850 "claimed": false, 00:17:46.850 "zoned": false, 00:17:46.850 "supported_io_types": { 00:17:46.850 "read": true, 00:17:46.850 "write": true, 00:17:46.850 "unmap": true, 00:17:46.850 "write_zeroes": true, 00:17:46.850 "flush": true, 00:17:46.850 "reset": true, 00:17:46.850 "compare": true, 00:17:46.850 "compare_and_write": true, 00:17:46.850 "abort": true, 00:17:46.850 "nvme_admin": true, 00:17:46.850 "nvme_io": true 00:17:46.850 }, 00:17:46.850 "driver_specific": { 00:17:46.850 "nvme": [ 00:17:46.850 { 00:17:46.850 "trid": { 00:17:46.850 "trtype": "TCP", 00:17:46.850 "adrfam": "IPv4", 00:17:46.850 "traddr": "10.0.0.2", 00:17:46.850 "trsvcid": "4420", 00:17:46.850 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:46.850 }, 00:17:46.850 "ctrlr_data": { 00:17:46.850 "cntlid": 1, 00:17:46.850 "vendor_id": "0x8086", 00:17:46.850 "model_number": "SPDK bdev Controller", 00:17:46.850 "serial_number": "SPDK0", 00:17:46.850 "firmware_revision": "24.01.1", 00:17:46.850 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:46.850 "oacs": { 00:17:46.850 "security": 0, 00:17:46.850 "format": 0, 00:17:46.850 "firmware": 0, 00:17:46.850 "ns_manage": 0 00:17:46.850 }, 00:17:46.850 "multi_ctrlr": true, 00:17:46.850 "ana_reporting": false 00:17:46.850 }, 00:17:46.850 "vs": { 00:17:46.850 "nvme_version": "1.3" 00:17:46.850 }, 00:17:46.850 "ns_data": { 00:17:46.850 "id": 1, 00:17:46.850 "can_share": true 00:17:46.850 } 00:17:46.850 } 00:17:46.850 ], 00:17:46.850 "mp_policy": "active_passive" 00:17:46.850 } 00:17:46.850 } 00:17:46.850 ] 00:17:46.850 16:04:10 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1578131 00:17:46.850 16:04:10 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:46.850 16:04:10 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:46.850 Running I/O for 10 seconds... 00:17:47.783 Latency(us) 00:17:47.783 [2024-11-18T15:04:11.374Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:47.783 [2024-11-18T15:04:11.374Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:47.783 Nvme0n1 : 1.00 14999.00 58.59 0.00 0.00 0.00 0.00 0.00 00:17:47.783 [2024-11-18T15:04:11.374Z] =================================================================================================================== 00:17:47.783 [2024-11-18T15:04:11.374Z] Total : 14999.00 58.59 0.00 0.00 0.00 0.00 0.00 00:17:47.783 00:17:48.718 16:04:12 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u e1293a23-c107-4f78-9697-668f9ad83461 00:17:48.718 [2024-11-18T15:04:12.309Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.718 Nvme0n1 : 2.00 14992.50 58.56 0.00 0.00 0.00 0.00 0.00 00:17:48.718 [2024-11-18T15:04:12.309Z] =================================================================================================================== 00:17:48.718 [2024-11-18T15:04:12.309Z] Total : 14992.50 58.56 0.00 0.00 0.00 0.00 0.00 00:17:48.718 00:17:48.976 true 00:17:48.976 16:04:12 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1293a23-c107-4f78-9697-668f9ad83461 00:17:48.976 16:04:12 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:49.234 16:04:12 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:49.234 16:04:12 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:49.234 16:04:12 -- target/nvmf_lvs_grow.sh@65 -- # wait 1578131 00:17:49.800 [2024-11-18T15:04:13.391Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:49.800 Nvme0n1 : 3.00 15036.67 58.74 0.00 0.00 0.00 0.00 0.00 00:17:49.800 [2024-11-18T15:04:13.391Z] =================================================================================================================== 00:17:49.800 [2024-11-18T15:04:13.391Z] Total : 15036.67 58.74 0.00 0.00 0.00 0.00 0.00 00:17:49.800 00:17:50.732 [2024-11-18T15:04:14.323Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:50.732 Nvme0n1 : 4.00 15107.75 59.01 0.00 0.00 0.00 0.00 0.00 00:17:50.732 [2024-11-18T15:04:14.323Z] =================================================================================================================== 00:17:50.732 [2024-11-18T15:04:14.323Z] Total : 15107.75 59.01 0.00 0.00 0.00 0.00 0.00 00:17:50.732 00:17:52.104 [2024-11-18T15:04:15.695Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:52.104 Nvme0n1 : 5.00 15216.20 59.44 0.00 0.00 0.00 0.00 0.00 00:17:52.104 [2024-11-18T15:04:15.695Z] =================================================================================================================== 00:17:52.104 [2024-11-18T15:04:15.695Z] Total : 15216.20 59.44 0.00 0.00 0.00 0.00 0.00 00:17:52.104 00:17:53.037 [2024-11-18T15:04:16.628Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:53.037 Nvme0n1 : 6.00 15254.50 59.59 0.00 0.00 0.00 0.00 0.00 00:17:53.037 [2024-11-18T15:04:16.628Z] =================================================================================================================== 00:17:53.037 [2024-11-18T15:04:16.628Z] Total : 15254.50 59.59 0.00 0.00 0.00 0.00 0.00 00:17:53.037 00:17:53.974 [2024-11-18T15:04:17.565Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:53.974 Nvme0n1 : 7.00 15291.00 59.73 0.00 0.00 0.00 0.00 0.00 00:17:53.974 [2024-11-18T15:04:17.565Z] =================================================================================================================== 00:17:53.974 [2024-11-18T15:04:17.565Z] Total : 15291.00 59.73 0.00 0.00 0.00 0.00 0.00 00:17:53.974 00:17:54.908 [2024-11-18T15:04:18.499Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:54.908 Nvme0n1 : 8.00 15316.75 59.83 0.00 0.00 0.00 0.00 0.00 00:17:54.908 [2024-11-18T15:04:18.499Z] =================================================================================================================== 00:17:54.908 [2024-11-18T15:04:18.499Z] Total : 15316.75 59.83 0.00 0.00 0.00 0.00 0.00 00:17:54.908 00:17:55.840 [2024-11-18T15:04:19.431Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:55.840 Nvme0n1 : 9.00 15338.33 59.92 0.00 0.00 0.00 0.00 0.00 00:17:55.840 [2024-11-18T15:04:19.431Z] =================================================================================================================== 00:17:55.840 [2024-11-18T15:04:19.431Z] Total : 15338.33 59.92 0.00 0.00 0.00 0.00 0.00 00:17:55.840 00:17:56.773 [2024-11-18T15:04:20.364Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:56.773 Nvme0n1 : 10.00 15345.10 59.94 0.00 0.00 0.00 0.00 0.00 00:17:56.773 [2024-11-18T15:04:20.364Z] =================================================================================================================== 00:17:56.773 [2024-11-18T15:04:20.364Z] Total : 15345.10 59.94 0.00 0.00 0.00 0.00 0.00 00:17:56.773 00:17:56.773 00:17:56.773 Latency(us) 00:17:56.773 [2024-11-18T15:04:20.364Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.773 [2024-11-18T15:04:20.364Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:56.773 Nvme0n1 : 10.00 15345.31 59.94 0.00 0.00 8336.19 3422.44 17282.09 00:17:56.773 [2024-11-18T15:04:20.364Z] =================================================================================================================== 00:17:56.773 [2024-11-18T15:04:20.364Z] Total : 15345.31 59.94 0.00 0.00 8336.19 3422.44 17282.09 00:17:56.773 0 00:17:56.773 16:04:20 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1577859 00:17:56.773 16:04:20 -- common/autotest_common.sh@936 -- # '[' -z 1577859 ']' 00:17:56.773 16:04:20 -- common/autotest_common.sh@940 -- # kill -0 1577859 00:17:56.773 16:04:20 -- common/autotest_common.sh@941 -- # uname 00:17:56.773 16:04:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.773 16:04:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1577859 00:17:57.030 16:04:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:57.030 16:04:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:57.030 16:04:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1577859' 00:17:57.030 killing process with pid 1577859 00:17:57.030 16:04:20 -- common/autotest_common.sh@955 -- # kill 1577859 00:17:57.030 Received shutdown signal, test time was about 10.000000 seconds 00:17:57.030 00:17:57.030 Latency(us) 00:17:57.030 [2024-11-18T15:04:20.621Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:57.030 [2024-11-18T15:04:20.621Z] =================================================================================================================== 00:17:57.030 [2024-11-18T15:04:20.621Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:57.030 16:04:20 -- common/autotest_common.sh@960 -- # wait 1577859 00:17:57.030 16:04:20 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:57.288 16:04:20 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1293a23-c107-4f78-9697-668f9ad83461 00:17:57.288 16:04:20 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:57.546 16:04:21 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:57.546 16:04:21 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:57.546 16:04:21 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:57.805 [2024-11-18 16:04:21.348464] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:57.805 16:04:21 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1293a23-c107-4f78-9697-668f9ad83461 00:17:57.805 16:04:21 -- common/autotest_common.sh@650 -- # local es=0 00:17:57.805 16:04:21 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1293a23-c107-4f78-9697-668f9ad83461 00:17:57.805 16:04:21 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:57.805 16:04:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:57.805 16:04:21 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:57.805 16:04:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:57.805 16:04:21 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:57.805 16:04:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:57.805 16:04:21 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:57.805 16:04:21 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:57.805 16:04:21 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1293a23-c107-4f78-9697-668f9ad83461 00:17:58.063 request: 00:17:58.063 { 00:17:58.063 "uuid": "e1293a23-c107-4f78-9697-668f9ad83461", 00:17:58.063 "method": "bdev_lvol_get_lvstores", 00:17:58.063 "req_id": 1 00:17:58.063 } 00:17:58.063 Got JSON-RPC error response 00:17:58.063 response: 00:17:58.063 { 00:17:58.063 "code": -19, 00:17:58.063 "message": "No such device" 00:17:58.063 } 00:17:58.063 16:04:21 -- common/autotest_common.sh@653 -- # es=1 00:17:58.063 16:04:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:58.063 16:04:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:58.063 16:04:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:58.063 16:04:21 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:58.321 aio_bdev 00:17:58.321 16:04:21 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 95e23f9e-fec0-4bf7-97f4-9675b2fd9d42 00:17:58.321 16:04:21 -- common/autotest_common.sh@897 -- # local bdev_name=95e23f9e-fec0-4bf7-97f4-9675b2fd9d42 00:17:58.321 16:04:21 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:58.321 16:04:21 -- common/autotest_common.sh@899 -- # local i 00:17:58.321 16:04:21 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:58.321 16:04:21 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:58.321 16:04:21 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:58.579 16:04:22 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 95e23f9e-fec0-4bf7-97f4-9675b2fd9d42 -t 2000 00:17:58.838 [ 00:17:58.838 { 00:17:58.838 "name": "95e23f9e-fec0-4bf7-97f4-9675b2fd9d42", 00:17:58.838 "aliases": [ 00:17:58.838 "lvs/lvol" 00:17:58.838 ], 00:17:58.838 "product_name": "Logical Volume", 00:17:58.838 "block_size": 4096, 00:17:58.838 "num_blocks": 38912, 00:17:58.838 "uuid": "95e23f9e-fec0-4bf7-97f4-9675b2fd9d42", 00:17:58.838 "assigned_rate_limits": { 00:17:58.838 "rw_ios_per_sec": 0, 00:17:58.838 "rw_mbytes_per_sec": 0, 00:17:58.838 "r_mbytes_per_sec": 0, 00:17:58.838 "w_mbytes_per_sec": 0 00:17:58.838 }, 00:17:58.838 "claimed": false, 00:17:58.838 "zoned": false, 00:17:58.838 "supported_io_types": { 00:17:58.838 "read": true, 00:17:58.838 "write": true, 00:17:58.838 "unmap": true, 00:17:58.838 "write_zeroes": true, 00:17:58.838 "flush": false, 00:17:58.838 "reset": true, 00:17:58.838 "compare": false, 00:17:58.838 "compare_and_write": false, 00:17:58.838 "abort": false, 00:17:58.838 "nvme_admin": false, 00:17:58.838 "nvme_io": false 00:17:58.838 }, 00:17:58.838 "driver_specific": { 00:17:58.838 "lvol": { 00:17:58.838 "lvol_store_uuid": "e1293a23-c107-4f78-9697-668f9ad83461", 00:17:58.838 "base_bdev": "aio_bdev", 00:17:58.838 "thin_provision": false, 00:17:58.838 "snapshot": false, 00:17:58.838 "clone": false, 00:17:58.838 "esnap_clone": false 00:17:58.838 } 00:17:58.838 } 00:17:58.838 } 00:17:58.838 ] 00:17:58.838 16:04:22 -- common/autotest_common.sh@905 -- # return 0 00:17:58.838 16:04:22 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1293a23-c107-4f78-9697-668f9ad83461 00:17:58.838 16:04:22 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:59.096 16:04:22 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:59.096 16:04:22 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1293a23-c107-4f78-9697-668f9ad83461 00:17:59.096 16:04:22 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:59.353 16:04:22 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:59.353 16:04:22 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 95e23f9e-fec0-4bf7-97f4-9675b2fd9d42 00:17:59.612 16:04:23 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e1293a23-c107-4f78-9697-668f9ad83461 00:17:59.869 16:04:23 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:00.127 16:04:23 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:00.127 00:18:00.127 real 0m17.914s 00:18:00.127 user 0m17.729s 00:18:00.127 sys 0m1.803s 00:18:00.127 16:04:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:00.127 16:04:23 -- common/autotest_common.sh@10 -- # set +x 00:18:00.127 ************************************ 00:18:00.127 END TEST lvs_grow_clean 00:18:00.127 ************************************ 00:18:00.385 16:04:23 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:18:00.385 16:04:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:00.385 16:04:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:00.385 16:04:23 -- common/autotest_common.sh@10 -- # set +x 00:18:00.385 ************************************ 00:18:00.385 START TEST lvs_grow_dirty 00:18:00.385 ************************************ 00:18:00.385 16:04:23 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:18:00.385 16:04:23 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:18:00.385 16:04:23 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:18:00.385 16:04:23 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:18:00.385 16:04:23 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:18:00.385 16:04:23 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:18:00.385 16:04:23 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:18:00.385 16:04:23 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:00.386 16:04:23 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:00.386 16:04:23 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:00.644 16:04:24 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:18:00.644 16:04:24 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:18:00.901 16:04:24 -- target/nvmf_lvs_grow.sh@28 -- # lvs=1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:00.901 16:04:24 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:00.901 16:04:24 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:18:01.159 16:04:24 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:18:01.159 16:04:24 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:18:01.159 16:04:24 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 lvol 150 00:18:01.417 16:04:24 -- target/nvmf_lvs_grow.sh@33 -- # lvol=30b90cf2-c61c-4be0-b7f8-777edc2960ed 00:18:01.417 16:04:24 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:01.417 16:04:24 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:18:01.675 [2024-11-18 16:04:25.034899] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:18:01.675 [2024-11-18 16:04:25.035005] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:18:01.675 true 00:18:01.675 16:04:25 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:01.675 16:04:25 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:18:01.933 16:04:25 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:18:01.933 16:04:25 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:18:02.191 16:04:25 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 30b90cf2-c61c-4be0-b7f8-777edc2960ed 00:18:02.449 16:04:25 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:18:02.707 16:04:26 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:02.966 16:04:26 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1580096 00:18:02.966 16:04:26 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:18:02.966 16:04:26 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:02.966 16:04:26 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1580096 /var/tmp/bdevperf.sock 00:18:02.966 16:04:26 -- common/autotest_common.sh@829 -- # '[' -z 1580096 ']' 00:18:02.966 16:04:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:02.966 16:04:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:02.966 16:04:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:02.966 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:02.966 16:04:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:02.966 16:04:26 -- common/autotest_common.sh@10 -- # set +x 00:18:02.966 [2024-11-18 16:04:26.346051] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:02.966 [2024-11-18 16:04:26.346120] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1580096 ] 00:18:02.966 EAL: No free 2048 kB hugepages reported on node 1 00:18:02.966 [2024-11-18 16:04:26.407500] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:02.966 [2024-11-18 16:04:26.496197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:03.899 16:04:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:03.899 16:04:27 -- common/autotest_common.sh@862 -- # return 0 00:18:03.899 16:04:27 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:18:04.463 Nvme0n1 00:18:04.463 16:04:27 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:18:04.463 [ 00:18:04.463 { 00:18:04.463 "name": "Nvme0n1", 00:18:04.463 "aliases": [ 00:18:04.463 "30b90cf2-c61c-4be0-b7f8-777edc2960ed" 00:18:04.463 ], 00:18:04.463 "product_name": "NVMe disk", 00:18:04.463 "block_size": 4096, 00:18:04.463 "num_blocks": 38912, 00:18:04.463 "uuid": "30b90cf2-c61c-4be0-b7f8-777edc2960ed", 00:18:04.463 "assigned_rate_limits": { 00:18:04.463 "rw_ios_per_sec": 0, 00:18:04.463 "rw_mbytes_per_sec": 0, 00:18:04.463 "r_mbytes_per_sec": 0, 00:18:04.463 "w_mbytes_per_sec": 0 00:18:04.463 }, 00:18:04.463 "claimed": false, 00:18:04.463 "zoned": false, 00:18:04.463 "supported_io_types": { 00:18:04.463 "read": true, 00:18:04.463 "write": true, 00:18:04.463 "unmap": true, 00:18:04.463 "write_zeroes": true, 00:18:04.463 "flush": true, 00:18:04.463 "reset": true, 00:18:04.463 "compare": true, 00:18:04.463 "compare_and_write": true, 00:18:04.463 "abort": true, 00:18:04.463 "nvme_admin": true, 00:18:04.463 "nvme_io": true 00:18:04.463 }, 00:18:04.464 "driver_specific": { 00:18:04.464 "nvme": [ 00:18:04.464 { 00:18:04.464 "trid": { 00:18:04.464 "trtype": "TCP", 00:18:04.464 "adrfam": "IPv4", 00:18:04.464 "traddr": "10.0.0.2", 00:18:04.464 "trsvcid": "4420", 00:18:04.464 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:18:04.464 }, 00:18:04.464 "ctrlr_data": { 00:18:04.464 "cntlid": 1, 00:18:04.464 "vendor_id": "0x8086", 00:18:04.464 "model_number": "SPDK bdev Controller", 00:18:04.464 "serial_number": "SPDK0", 00:18:04.464 "firmware_revision": "24.01.1", 00:18:04.464 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:18:04.464 "oacs": { 00:18:04.464 "security": 0, 00:18:04.464 "format": 0, 00:18:04.464 "firmware": 0, 00:18:04.464 "ns_manage": 0 00:18:04.464 }, 00:18:04.464 "multi_ctrlr": true, 00:18:04.464 "ana_reporting": false 00:18:04.464 }, 00:18:04.464 "vs": { 00:18:04.464 "nvme_version": "1.3" 00:18:04.464 }, 00:18:04.464 "ns_data": { 00:18:04.464 "id": 1, 00:18:04.464 "can_share": true 00:18:04.464 } 00:18:04.464 } 00:18:04.464 ], 00:18:04.464 "mp_policy": "active_passive" 00:18:04.464 } 00:18:04.464 } 00:18:04.464 ] 00:18:04.464 16:04:28 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1580368 00:18:04.464 16:04:28 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:04.464 16:04:28 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:18:04.721 Running I/O for 10 seconds... 00:18:05.685 Latency(us) 00:18:05.685 [2024-11-18T15:04:29.276Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:05.685 [2024-11-18T15:04:29.276Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.685 Nvme0n1 : 1.00 14608.00 57.06 0.00 0.00 0.00 0.00 0.00 00:18:05.685 [2024-11-18T15:04:29.276Z] =================================================================================================================== 00:18:05.685 [2024-11-18T15:04:29.276Z] Total : 14608.00 57.06 0.00 0.00 0.00 0.00 0.00 00:18:05.685 00:18:06.618 16:04:30 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:06.618 [2024-11-18T15:04:30.209Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:06.618 Nvme0n1 : 2.00 14829.00 57.93 0.00 0.00 0.00 0.00 0.00 00:18:06.618 [2024-11-18T15:04:30.209Z] =================================================================================================================== 00:18:06.618 [2024-11-18T15:04:30.209Z] Total : 14829.00 57.93 0.00 0.00 0.00 0.00 0.00 00:18:06.618 00:18:06.876 true 00:18:06.876 16:04:30 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:06.876 16:04:30 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:07.135 16:04:30 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:07.135 16:04:30 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:07.135 16:04:30 -- target/nvmf_lvs_grow.sh@65 -- # wait 1580368 00:18:07.706 [2024-11-18T15:04:31.297Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:07.706 Nvme0n1 : 3.00 14927.00 58.31 0.00 0.00 0.00 0.00 0.00 00:18:07.706 [2024-11-18T15:04:31.297Z] =================================================================================================================== 00:18:07.706 [2024-11-18T15:04:31.297Z] Total : 14927.00 58.31 0.00 0.00 0.00 0.00 0.00 00:18:07.706 00:18:08.709 [2024-11-18T15:04:32.300Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:08.709 Nvme0n1 : 4.00 15037.50 58.74 0.00 0.00 0.00 0.00 0.00 00:18:08.709 [2024-11-18T15:04:32.300Z] =================================================================================================================== 00:18:08.709 [2024-11-18T15:04:32.300Z] Total : 15037.50 58.74 0.00 0.00 0.00 0.00 0.00 00:18:08.709 00:18:09.643 [2024-11-18T15:04:33.234Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:09.643 Nvme0n1 : 5.00 15104.20 59.00 0.00 0.00 0.00 0.00 0.00 00:18:09.643 [2024-11-18T15:04:33.234Z] =================================================================================================================== 00:18:09.643 [2024-11-18T15:04:33.234Z] Total : 15104.20 59.00 0.00 0.00 0.00 0.00 0.00 00:18:09.643 00:18:10.576 [2024-11-18T15:04:34.167Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:10.576 Nvme0n1 : 6.00 15160.83 59.22 0.00 0.00 0.00 0.00 0.00 00:18:10.576 [2024-11-18T15:04:34.167Z] =================================================================================================================== 00:18:10.576 [2024-11-18T15:04:34.167Z] Total : 15160.83 59.22 0.00 0.00 0.00 0.00 0.00 00:18:10.576 00:18:11.950 [2024-11-18T15:04:35.541Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:11.950 Nvme0n1 : 7.00 15196.00 59.36 0.00 0.00 0.00 0.00 0.00 00:18:11.950 [2024-11-18T15:04:35.541Z] =================================================================================================================== 00:18:11.950 [2024-11-18T15:04:35.541Z] Total : 15196.00 59.36 0.00 0.00 0.00 0.00 0.00 00:18:11.950 00:18:12.885 [2024-11-18T15:04:36.476Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:12.885 Nvme0n1 : 8.00 15227.50 59.48 0.00 0.00 0.00 0.00 0.00 00:18:12.885 [2024-11-18T15:04:36.476Z] =================================================================================================================== 00:18:12.885 [2024-11-18T15:04:36.476Z] Total : 15227.50 59.48 0.00 0.00 0.00 0.00 0.00 00:18:12.885 00:18:13.818 [2024-11-18T15:04:37.409Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:13.818 Nvme0n1 : 9.00 15257.22 59.60 0.00 0.00 0.00 0.00 0.00 00:18:13.818 [2024-11-18T15:04:37.410Z] =================================================================================================================== 00:18:13.819 [2024-11-18T15:04:37.410Z] Total : 15257.22 59.60 0.00 0.00 0.00 0.00 0.00 00:18:13.819 00:18:14.751 [2024-11-18T15:04:38.342Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:14.751 Nvme0n1 : 10.00 15287.30 59.72 0.00 0.00 0.00 0.00 0.00 00:18:14.751 [2024-11-18T15:04:38.342Z] =================================================================================================================== 00:18:14.751 [2024-11-18T15:04:38.342Z] Total : 15287.30 59.72 0.00 0.00 0.00 0.00 0.00 00:18:14.751 00:18:14.751 00:18:14.751 Latency(us) 00:18:14.751 [2024-11-18T15:04:38.342Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:14.751 [2024-11-18T15:04:38.342Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:14.751 Nvme0n1 : 10.00 15286.80 59.71 0.00 0.00 8368.11 4563.25 19709.35 00:18:14.751 [2024-11-18T15:04:38.342Z] =================================================================================================================== 00:18:14.751 [2024-11-18T15:04:38.342Z] Total : 15286.80 59.71 0.00 0.00 8368.11 4563.25 19709.35 00:18:14.751 0 00:18:14.751 16:04:38 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1580096 00:18:14.751 16:04:38 -- common/autotest_common.sh@936 -- # '[' -z 1580096 ']' 00:18:14.751 16:04:38 -- common/autotest_common.sh@940 -- # kill -0 1580096 00:18:14.751 16:04:38 -- common/autotest_common.sh@941 -- # uname 00:18:14.751 16:04:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:14.751 16:04:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1580096 00:18:14.751 16:04:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:14.751 16:04:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:14.751 16:04:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1580096' 00:18:14.751 killing process with pid 1580096 00:18:14.751 16:04:38 -- common/autotest_common.sh@955 -- # kill 1580096 00:18:14.751 Received shutdown signal, test time was about 10.000000 seconds 00:18:14.751 00:18:14.751 Latency(us) 00:18:14.751 [2024-11-18T15:04:38.342Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:14.751 [2024-11-18T15:04:38.342Z] =================================================================================================================== 00:18:14.751 [2024-11-18T15:04:38.342Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:14.751 16:04:38 -- common/autotest_common.sh@960 -- # wait 1580096 00:18:15.022 16:04:38 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:15.283 16:04:38 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:15.283 16:04:38 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:15.540 16:04:38 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:15.540 16:04:38 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:15.540 16:04:38 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1577409 00:18:15.540 16:04:38 -- target/nvmf_lvs_grow.sh@74 -- # wait 1577409 00:18:15.540 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1577409 Killed "${NVMF_APP[@]}" "$@" 00:18:15.540 16:04:39 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:15.540 16:04:39 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:15.540 16:04:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:15.540 16:04:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:15.540 16:04:39 -- common/autotest_common.sh@10 -- # set +x 00:18:15.540 16:04:39 -- nvmf/common.sh@469 -- # nvmfpid=1581620 00:18:15.540 16:04:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:15.540 16:04:39 -- nvmf/common.sh@470 -- # waitforlisten 1581620 00:18:15.540 16:04:39 -- common/autotest_common.sh@829 -- # '[' -z 1581620 ']' 00:18:15.540 16:04:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:15.540 16:04:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:15.540 16:04:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:15.540 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:15.540 16:04:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:15.540 16:04:39 -- common/autotest_common.sh@10 -- # set +x 00:18:15.540 [2024-11-18 16:04:39.072424] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:15.540 [2024-11-18 16:04:39.072514] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:15.540 EAL: No free 2048 kB hugepages reported on node 1 00:18:15.798 [2024-11-18 16:04:39.138043] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:15.798 [2024-11-18 16:04:39.220683] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:15.798 [2024-11-18 16:04:39.220831] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:15.798 [2024-11-18 16:04:39.220848] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:15.798 [2024-11-18 16:04:39.220861] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:15.798 [2024-11-18 16:04:39.220900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:16.733 16:04:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:16.733 16:04:40 -- common/autotest_common.sh@862 -- # return 0 00:18:16.733 16:04:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:16.733 16:04:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:16.733 16:04:40 -- common/autotest_common.sh@10 -- # set +x 00:18:16.733 16:04:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:16.733 16:04:40 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:16.733 [2024-11-18 16:04:40.312287] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:16.733 [2024-11-18 16:04:40.312429] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:16.733 [2024-11-18 16:04:40.312487] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:16.990 16:04:40 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:16.990 16:04:40 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 30b90cf2-c61c-4be0-b7f8-777edc2960ed 00:18:16.990 16:04:40 -- common/autotest_common.sh@897 -- # local bdev_name=30b90cf2-c61c-4be0-b7f8-777edc2960ed 00:18:16.990 16:04:40 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:16.990 16:04:40 -- common/autotest_common.sh@899 -- # local i 00:18:16.990 16:04:40 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:16.990 16:04:40 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:16.990 16:04:40 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:17.248 16:04:40 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 30b90cf2-c61c-4be0-b7f8-777edc2960ed -t 2000 00:18:17.506 [ 00:18:17.506 { 00:18:17.506 "name": "30b90cf2-c61c-4be0-b7f8-777edc2960ed", 00:18:17.506 "aliases": [ 00:18:17.506 "lvs/lvol" 00:18:17.506 ], 00:18:17.506 "product_name": "Logical Volume", 00:18:17.506 "block_size": 4096, 00:18:17.506 "num_blocks": 38912, 00:18:17.506 "uuid": "30b90cf2-c61c-4be0-b7f8-777edc2960ed", 00:18:17.506 "assigned_rate_limits": { 00:18:17.506 "rw_ios_per_sec": 0, 00:18:17.506 "rw_mbytes_per_sec": 0, 00:18:17.506 "r_mbytes_per_sec": 0, 00:18:17.506 "w_mbytes_per_sec": 0 00:18:17.506 }, 00:18:17.506 "claimed": false, 00:18:17.506 "zoned": false, 00:18:17.506 "supported_io_types": { 00:18:17.506 "read": true, 00:18:17.506 "write": true, 00:18:17.506 "unmap": true, 00:18:17.506 "write_zeroes": true, 00:18:17.506 "flush": false, 00:18:17.506 "reset": true, 00:18:17.506 "compare": false, 00:18:17.506 "compare_and_write": false, 00:18:17.506 "abort": false, 00:18:17.506 "nvme_admin": false, 00:18:17.506 "nvme_io": false 00:18:17.506 }, 00:18:17.506 "driver_specific": { 00:18:17.506 "lvol": { 00:18:17.506 "lvol_store_uuid": "1ba2738b-b2f6-459f-82b0-730a72d12cb7", 00:18:17.506 "base_bdev": "aio_bdev", 00:18:17.506 "thin_provision": false, 00:18:17.506 "snapshot": false, 00:18:17.506 "clone": false, 00:18:17.506 "esnap_clone": false 00:18:17.506 } 00:18:17.506 } 00:18:17.506 } 00:18:17.506 ] 00:18:17.506 16:04:40 -- common/autotest_common.sh@905 -- # return 0 00:18:17.506 16:04:40 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:17.506 16:04:40 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:17.763 16:04:41 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:17.763 16:04:41 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:17.763 16:04:41 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:18.021 16:04:41 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:18.021 16:04:41 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:18.279 [2024-11-18 16:04:41.633482] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:18.279 16:04:41 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:18.279 16:04:41 -- common/autotest_common.sh@650 -- # local es=0 00:18:18.279 16:04:41 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:18.279 16:04:41 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:18.279 16:04:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:18.279 16:04:41 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:18.279 16:04:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:18.279 16:04:41 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:18.279 16:04:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:18.279 16:04:41 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:18.279 16:04:41 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:18.279 16:04:41 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:18.537 request: 00:18:18.537 { 00:18:18.537 "uuid": "1ba2738b-b2f6-459f-82b0-730a72d12cb7", 00:18:18.537 "method": "bdev_lvol_get_lvstores", 00:18:18.537 "req_id": 1 00:18:18.537 } 00:18:18.537 Got JSON-RPC error response 00:18:18.537 response: 00:18:18.537 { 00:18:18.537 "code": -19, 00:18:18.537 "message": "No such device" 00:18:18.537 } 00:18:18.537 16:04:41 -- common/autotest_common.sh@653 -- # es=1 00:18:18.537 16:04:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:18.537 16:04:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:18.537 16:04:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:18.537 16:04:41 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:18.795 aio_bdev 00:18:18.795 16:04:42 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 30b90cf2-c61c-4be0-b7f8-777edc2960ed 00:18:18.795 16:04:42 -- common/autotest_common.sh@897 -- # local bdev_name=30b90cf2-c61c-4be0-b7f8-777edc2960ed 00:18:18.795 16:04:42 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:18.795 16:04:42 -- common/autotest_common.sh@899 -- # local i 00:18:18.795 16:04:42 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:18.795 16:04:42 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:18.795 16:04:42 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:19.055 16:04:42 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 30b90cf2-c61c-4be0-b7f8-777edc2960ed -t 2000 00:18:19.312 [ 00:18:19.312 { 00:18:19.312 "name": "30b90cf2-c61c-4be0-b7f8-777edc2960ed", 00:18:19.312 "aliases": [ 00:18:19.312 "lvs/lvol" 00:18:19.312 ], 00:18:19.312 "product_name": "Logical Volume", 00:18:19.312 "block_size": 4096, 00:18:19.312 "num_blocks": 38912, 00:18:19.312 "uuid": "30b90cf2-c61c-4be0-b7f8-777edc2960ed", 00:18:19.312 "assigned_rate_limits": { 00:18:19.312 "rw_ios_per_sec": 0, 00:18:19.312 "rw_mbytes_per_sec": 0, 00:18:19.312 "r_mbytes_per_sec": 0, 00:18:19.312 "w_mbytes_per_sec": 0 00:18:19.312 }, 00:18:19.312 "claimed": false, 00:18:19.312 "zoned": false, 00:18:19.312 "supported_io_types": { 00:18:19.312 "read": true, 00:18:19.312 "write": true, 00:18:19.312 "unmap": true, 00:18:19.312 "write_zeroes": true, 00:18:19.312 "flush": false, 00:18:19.312 "reset": true, 00:18:19.312 "compare": false, 00:18:19.312 "compare_and_write": false, 00:18:19.312 "abort": false, 00:18:19.312 "nvme_admin": false, 00:18:19.312 "nvme_io": false 00:18:19.312 }, 00:18:19.312 "driver_specific": { 00:18:19.312 "lvol": { 00:18:19.312 "lvol_store_uuid": "1ba2738b-b2f6-459f-82b0-730a72d12cb7", 00:18:19.312 "base_bdev": "aio_bdev", 00:18:19.312 "thin_provision": false, 00:18:19.312 "snapshot": false, 00:18:19.312 "clone": false, 00:18:19.312 "esnap_clone": false 00:18:19.312 } 00:18:19.312 } 00:18:19.312 } 00:18:19.312 ] 00:18:19.312 16:04:42 -- common/autotest_common.sh@905 -- # return 0 00:18:19.312 16:04:42 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:19.313 16:04:42 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:19.570 16:04:42 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:19.570 16:04:42 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:19.570 16:04:42 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:19.828 16:04:43 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:19.828 16:04:43 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 30b90cf2-c61c-4be0-b7f8-777edc2960ed 00:18:20.085 16:04:43 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 1ba2738b-b2f6-459f-82b0-730a72d12cb7 00:18:20.343 16:04:43 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:20.601 16:04:43 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:20.601 00:18:20.601 real 0m20.280s 00:18:20.601 user 0m50.820s 00:18:20.601 sys 0m4.667s 00:18:20.601 16:04:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:20.601 16:04:44 -- common/autotest_common.sh@10 -- # set +x 00:18:20.601 ************************************ 00:18:20.601 END TEST lvs_grow_dirty 00:18:20.601 ************************************ 00:18:20.601 16:04:44 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:20.601 16:04:44 -- common/autotest_common.sh@806 -- # type=--id 00:18:20.601 16:04:44 -- common/autotest_common.sh@807 -- # id=0 00:18:20.601 16:04:44 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:20.601 16:04:44 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:20.601 16:04:44 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:20.601 16:04:44 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:20.601 16:04:44 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:20.601 16:04:44 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:20.601 nvmf_trace.0 00:18:20.601 16:04:44 -- common/autotest_common.sh@821 -- # return 0 00:18:20.601 16:04:44 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:20.601 16:04:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:20.601 16:04:44 -- nvmf/common.sh@116 -- # sync 00:18:20.601 16:04:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:20.601 16:04:44 -- nvmf/common.sh@119 -- # set +e 00:18:20.601 16:04:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:20.601 16:04:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:20.601 rmmod nvme_tcp 00:18:20.601 rmmod nvme_fabrics 00:18:20.601 rmmod nvme_keyring 00:18:20.601 16:04:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:20.601 16:04:44 -- nvmf/common.sh@123 -- # set -e 00:18:20.601 16:04:44 -- nvmf/common.sh@124 -- # return 0 00:18:20.601 16:04:44 -- nvmf/common.sh@477 -- # '[' -n 1581620 ']' 00:18:20.601 16:04:44 -- nvmf/common.sh@478 -- # killprocess 1581620 00:18:20.601 16:04:44 -- common/autotest_common.sh@936 -- # '[' -z 1581620 ']' 00:18:20.601 16:04:44 -- common/autotest_common.sh@940 -- # kill -0 1581620 00:18:20.601 16:04:44 -- common/autotest_common.sh@941 -- # uname 00:18:20.601 16:04:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.601 16:04:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1581620 00:18:20.601 16:04:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:20.601 16:04:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:20.601 16:04:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1581620' 00:18:20.601 killing process with pid 1581620 00:18:20.601 16:04:44 -- common/autotest_common.sh@955 -- # kill 1581620 00:18:20.601 16:04:44 -- common/autotest_common.sh@960 -- # wait 1581620 00:18:20.859 16:04:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:20.859 16:04:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:20.859 16:04:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:20.859 16:04:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:20.859 16:04:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:20.859 16:04:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:20.859 16:04:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:20.859 16:04:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.387 16:04:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:23.387 00:18:23.387 real 0m44.349s 00:18:23.387 user 1m15.317s 00:18:23.387 sys 0m8.417s 00:18:23.387 16:04:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:23.387 16:04:46 -- common/autotest_common.sh@10 -- # set +x 00:18:23.387 ************************************ 00:18:23.387 END TEST nvmf_lvs_grow 00:18:23.387 ************************************ 00:18:23.387 16:04:46 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:23.387 16:04:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:23.387 16:04:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:23.387 16:04:46 -- common/autotest_common.sh@10 -- # set +x 00:18:23.387 ************************************ 00:18:23.387 START TEST nvmf_bdev_io_wait 00:18:23.387 ************************************ 00:18:23.387 16:04:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:23.387 * Looking for test storage... 00:18:23.387 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:23.388 16:04:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:23.388 16:04:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:23.388 16:04:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:23.388 16:04:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:23.388 16:04:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:23.388 16:04:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:23.388 16:04:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:23.388 16:04:46 -- scripts/common.sh@335 -- # IFS=.-: 00:18:23.388 16:04:46 -- scripts/common.sh@335 -- # read -ra ver1 00:18:23.388 16:04:46 -- scripts/common.sh@336 -- # IFS=.-: 00:18:23.388 16:04:46 -- scripts/common.sh@336 -- # read -ra ver2 00:18:23.388 16:04:46 -- scripts/common.sh@337 -- # local 'op=<' 00:18:23.388 16:04:46 -- scripts/common.sh@339 -- # ver1_l=2 00:18:23.388 16:04:46 -- scripts/common.sh@340 -- # ver2_l=1 00:18:23.388 16:04:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:23.388 16:04:46 -- scripts/common.sh@343 -- # case "$op" in 00:18:23.388 16:04:46 -- scripts/common.sh@344 -- # : 1 00:18:23.388 16:04:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:23.388 16:04:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:23.388 16:04:46 -- scripts/common.sh@364 -- # decimal 1 00:18:23.388 16:04:46 -- scripts/common.sh@352 -- # local d=1 00:18:23.388 16:04:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:23.388 16:04:46 -- scripts/common.sh@354 -- # echo 1 00:18:23.388 16:04:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:23.388 16:04:46 -- scripts/common.sh@365 -- # decimal 2 00:18:23.388 16:04:46 -- scripts/common.sh@352 -- # local d=2 00:18:23.388 16:04:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:23.388 16:04:46 -- scripts/common.sh@354 -- # echo 2 00:18:23.388 16:04:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:23.388 16:04:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:23.388 16:04:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:23.388 16:04:46 -- scripts/common.sh@367 -- # return 0 00:18:23.388 16:04:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:23.388 16:04:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:23.388 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.388 --rc genhtml_branch_coverage=1 00:18:23.388 --rc genhtml_function_coverage=1 00:18:23.388 --rc genhtml_legend=1 00:18:23.388 --rc geninfo_all_blocks=1 00:18:23.388 --rc geninfo_unexecuted_blocks=1 00:18:23.388 00:18:23.388 ' 00:18:23.388 16:04:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:23.388 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.388 --rc genhtml_branch_coverage=1 00:18:23.388 --rc genhtml_function_coverage=1 00:18:23.388 --rc genhtml_legend=1 00:18:23.388 --rc geninfo_all_blocks=1 00:18:23.388 --rc geninfo_unexecuted_blocks=1 00:18:23.388 00:18:23.388 ' 00:18:23.388 16:04:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:23.388 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.388 --rc genhtml_branch_coverage=1 00:18:23.388 --rc genhtml_function_coverage=1 00:18:23.388 --rc genhtml_legend=1 00:18:23.388 --rc geninfo_all_blocks=1 00:18:23.388 --rc geninfo_unexecuted_blocks=1 00:18:23.388 00:18:23.388 ' 00:18:23.388 16:04:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:23.388 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.388 --rc genhtml_branch_coverage=1 00:18:23.388 --rc genhtml_function_coverage=1 00:18:23.388 --rc genhtml_legend=1 00:18:23.388 --rc geninfo_all_blocks=1 00:18:23.388 --rc geninfo_unexecuted_blocks=1 00:18:23.388 00:18:23.388 ' 00:18:23.388 16:04:46 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:23.388 16:04:46 -- nvmf/common.sh@7 -- # uname -s 00:18:23.388 16:04:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:23.388 16:04:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:23.388 16:04:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:23.388 16:04:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:23.388 16:04:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:23.388 16:04:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:23.388 16:04:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:23.388 16:04:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:23.388 16:04:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:23.388 16:04:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:23.388 16:04:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.388 16:04:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.388 16:04:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:23.388 16:04:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:23.388 16:04:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:23.388 16:04:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:23.388 16:04:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:23.388 16:04:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:23.388 16:04:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:23.388 16:04:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.388 16:04:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.388 16:04:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.388 16:04:46 -- paths/export.sh@5 -- # export PATH 00:18:23.388 16:04:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.388 16:04:46 -- nvmf/common.sh@46 -- # : 0 00:18:23.388 16:04:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:23.388 16:04:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:23.388 16:04:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:23.388 16:04:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:23.388 16:04:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:23.388 16:04:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:23.388 16:04:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:23.388 16:04:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:23.388 16:04:46 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:23.388 16:04:46 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:23.388 16:04:46 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:23.388 16:04:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:23.388 16:04:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:23.388 16:04:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:23.388 16:04:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:23.388 16:04:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:23.388 16:04:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.388 16:04:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.388 16:04:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.388 16:04:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:23.388 16:04:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:23.388 16:04:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:23.388 16:04:46 -- common/autotest_common.sh@10 -- # set +x 00:18:25.288 16:04:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:25.288 16:04:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:25.288 16:04:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:25.288 16:04:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:25.288 16:04:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:25.288 16:04:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:25.288 16:04:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:25.288 16:04:48 -- nvmf/common.sh@294 -- # net_devs=() 00:18:25.288 16:04:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:25.288 16:04:48 -- nvmf/common.sh@295 -- # e810=() 00:18:25.288 16:04:48 -- nvmf/common.sh@295 -- # local -ga e810 00:18:25.288 16:04:48 -- nvmf/common.sh@296 -- # x722=() 00:18:25.288 16:04:48 -- nvmf/common.sh@296 -- # local -ga x722 00:18:25.288 16:04:48 -- nvmf/common.sh@297 -- # mlx=() 00:18:25.288 16:04:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:25.288 16:04:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:25.288 16:04:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:25.288 16:04:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:25.288 16:04:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:25.288 16:04:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:25.288 16:04:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:25.288 16:04:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:25.288 16:04:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:25.288 16:04:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:25.288 16:04:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:25.288 16:04:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:25.288 16:04:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:25.288 16:04:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:25.288 16:04:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:25.288 16:04:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:25.288 16:04:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:25.288 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:25.288 16:04:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:25.288 16:04:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:25.288 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:25.288 16:04:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:25.288 16:04:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:25.288 16:04:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.288 16:04:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:25.288 16:04:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.288 16:04:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:25.288 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:25.288 16:04:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.288 16:04:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:25.288 16:04:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.288 16:04:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:25.288 16:04:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.288 16:04:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:25.288 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:25.288 16:04:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.288 16:04:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:25.288 16:04:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:25.288 16:04:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:25.288 16:04:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:25.288 16:04:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:25.288 16:04:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:25.288 16:04:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:25.288 16:04:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:25.288 16:04:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:25.288 16:04:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:25.288 16:04:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:25.288 16:04:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:25.288 16:04:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:25.288 16:04:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:25.288 16:04:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:25.288 16:04:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:25.288 16:04:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:25.288 16:04:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:25.288 16:04:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:25.288 16:04:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:25.288 16:04:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:25.288 16:04:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:25.288 16:04:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:25.288 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:25.288 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.408 ms 00:18:25.288 00:18:25.288 --- 10.0.0.2 ping statistics --- 00:18:25.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:25.288 rtt min/avg/max/mdev = 0.408/0.408/0.408/0.000 ms 00:18:25.288 16:04:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:25.288 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:25.288 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:18:25.288 00:18:25.288 --- 10.0.0.1 ping statistics --- 00:18:25.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:25.288 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:18:25.288 16:04:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:25.288 16:04:48 -- nvmf/common.sh@410 -- # return 0 00:18:25.288 16:04:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:25.288 16:04:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:25.288 16:04:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:25.288 16:04:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:25.288 16:04:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:25.288 16:04:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:25.288 16:04:48 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:25.288 16:04:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:25.288 16:04:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:25.288 16:04:48 -- common/autotest_common.sh@10 -- # set +x 00:18:25.288 16:04:48 -- nvmf/common.sh@469 -- # nvmfpid=1584298 00:18:25.288 16:04:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:25.288 16:04:48 -- nvmf/common.sh@470 -- # waitforlisten 1584298 00:18:25.288 16:04:48 -- common/autotest_common.sh@829 -- # '[' -z 1584298 ']' 00:18:25.288 16:04:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:25.288 16:04:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:25.288 16:04:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:25.288 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:25.288 16:04:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:25.288 16:04:48 -- common/autotest_common.sh@10 -- # set +x 00:18:25.288 [2024-11-18 16:04:48.812864] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:25.289 [2024-11-18 16:04:48.812929] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:25.289 EAL: No free 2048 kB hugepages reported on node 1 00:18:25.547 [2024-11-18 16:04:48.877995] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:25.547 [2024-11-18 16:04:48.968092] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:25.547 [2024-11-18 16:04:48.968250] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:25.547 [2024-11-18 16:04:48.968270] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:25.547 [2024-11-18 16:04:48.968286] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:25.547 [2024-11-18 16:04:48.968350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:25.547 [2024-11-18 16:04:48.968417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:25.547 [2024-11-18 16:04:48.968435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:25.547 [2024-11-18 16:04:48.968437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:25.547 16:04:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:25.548 16:04:49 -- common/autotest_common.sh@862 -- # return 0 00:18:25.548 16:04:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:25.548 16:04:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:25.548 16:04:49 -- common/autotest_common.sh@10 -- # set +x 00:18:25.548 16:04:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:25.548 16:04:49 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:25.548 16:04:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.548 16:04:49 -- common/autotest_common.sh@10 -- # set +x 00:18:25.548 16:04:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.548 16:04:49 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:25.548 16:04:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.548 16:04:49 -- common/autotest_common.sh@10 -- # set +x 00:18:25.548 16:04:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.548 16:04:49 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:25.548 16:04:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.548 16:04:49 -- common/autotest_common.sh@10 -- # set +x 00:18:25.548 [2024-11-18 16:04:49.122579] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:25.548 16:04:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.548 16:04:49 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:25.548 16:04:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.548 16:04:49 -- common/autotest_common.sh@10 -- # set +x 00:18:25.807 Malloc0 00:18:25.807 16:04:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:25.807 16:04:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.807 16:04:49 -- common/autotest_common.sh@10 -- # set +x 00:18:25.807 16:04:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:25.807 16:04:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.807 16:04:49 -- common/autotest_common.sh@10 -- # set +x 00:18:25.807 16:04:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:25.807 16:04:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.807 16:04:49 -- common/autotest_common.sh@10 -- # set +x 00:18:25.807 [2024-11-18 16:04:49.185275] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:25.807 16:04:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1584327 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@30 -- # READ_PID=1584328 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:25.807 16:04:49 -- nvmf/common.sh@520 -- # config=() 00:18:25.807 16:04:49 -- nvmf/common.sh@520 -- # local subsystem config 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1584331 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:25.807 16:04:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:25.807 16:04:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:25.807 { 00:18:25.807 "params": { 00:18:25.807 "name": "Nvme$subsystem", 00:18:25.807 "trtype": "$TEST_TRANSPORT", 00:18:25.807 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:25.807 "adrfam": "ipv4", 00:18:25.807 "trsvcid": "$NVMF_PORT", 00:18:25.807 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:25.807 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:25.807 "hdgst": ${hdgst:-false}, 00:18:25.807 "ddgst": ${ddgst:-false} 00:18:25.807 }, 00:18:25.807 "method": "bdev_nvme_attach_controller" 00:18:25.807 } 00:18:25.807 EOF 00:18:25.807 )") 00:18:25.807 16:04:49 -- nvmf/common.sh@520 -- # config=() 00:18:25.807 16:04:49 -- nvmf/common.sh@520 -- # local subsystem config 00:18:25.807 16:04:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:25.807 16:04:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:25.807 { 00:18:25.807 "params": { 00:18:25.807 "name": "Nvme$subsystem", 00:18:25.807 "trtype": "$TEST_TRANSPORT", 00:18:25.807 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:25.807 "adrfam": "ipv4", 00:18:25.807 "trsvcid": "$NVMF_PORT", 00:18:25.807 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:25.807 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:25.807 "hdgst": ${hdgst:-false}, 00:18:25.807 "ddgst": ${ddgst:-false} 00:18:25.807 }, 00:18:25.807 "method": "bdev_nvme_attach_controller" 00:18:25.807 } 00:18:25.807 EOF 00:18:25.807 )") 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1584333 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@35 -- # sync 00:18:25.807 16:04:49 -- nvmf/common.sh@520 -- # config=() 00:18:25.807 16:04:49 -- nvmf/common.sh@520 -- # local subsystem config 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:25.807 16:04:49 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:25.807 16:04:49 -- nvmf/common.sh@542 -- # cat 00:18:25.807 16:04:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:25.807 16:04:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:25.807 { 00:18:25.807 "params": { 00:18:25.807 "name": "Nvme$subsystem", 00:18:25.807 "trtype": "$TEST_TRANSPORT", 00:18:25.807 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:25.807 "adrfam": "ipv4", 00:18:25.807 "trsvcid": "$NVMF_PORT", 00:18:25.807 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:25.807 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:25.807 "hdgst": ${hdgst:-false}, 00:18:25.807 "ddgst": ${ddgst:-false} 00:18:25.807 }, 00:18:25.807 "method": "bdev_nvme_attach_controller" 00:18:25.807 } 00:18:25.807 EOF 00:18:25.807 )") 00:18:25.808 16:04:49 -- nvmf/common.sh@520 -- # config=() 00:18:25.808 16:04:49 -- nvmf/common.sh@520 -- # local subsystem config 00:18:25.808 16:04:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:25.808 16:04:49 -- nvmf/common.sh@542 -- # cat 00:18:25.808 16:04:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:25.808 { 00:18:25.808 "params": { 00:18:25.808 "name": "Nvme$subsystem", 00:18:25.808 "trtype": "$TEST_TRANSPORT", 00:18:25.808 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:25.808 "adrfam": "ipv4", 00:18:25.808 "trsvcid": "$NVMF_PORT", 00:18:25.808 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:25.808 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:25.808 "hdgst": ${hdgst:-false}, 00:18:25.808 "ddgst": ${ddgst:-false} 00:18:25.808 }, 00:18:25.808 "method": "bdev_nvme_attach_controller" 00:18:25.808 } 00:18:25.808 EOF 00:18:25.808 )") 00:18:25.808 16:04:49 -- nvmf/common.sh@542 -- # cat 00:18:25.808 16:04:49 -- nvmf/common.sh@542 -- # cat 00:18:25.808 16:04:49 -- target/bdev_io_wait.sh@37 -- # wait 1584327 00:18:25.808 16:04:49 -- nvmf/common.sh@544 -- # jq . 00:18:25.808 16:04:49 -- nvmf/common.sh@544 -- # jq . 00:18:25.808 16:04:49 -- nvmf/common.sh@544 -- # jq . 00:18:25.808 16:04:49 -- nvmf/common.sh@544 -- # jq . 00:18:25.808 16:04:49 -- nvmf/common.sh@545 -- # IFS=, 00:18:25.808 16:04:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:25.808 "params": { 00:18:25.808 "name": "Nvme1", 00:18:25.808 "trtype": "tcp", 00:18:25.808 "traddr": "10.0.0.2", 00:18:25.808 "adrfam": "ipv4", 00:18:25.808 "trsvcid": "4420", 00:18:25.808 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:25.808 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:25.808 "hdgst": false, 00:18:25.808 "ddgst": false 00:18:25.808 }, 00:18:25.808 "method": "bdev_nvme_attach_controller" 00:18:25.808 }' 00:18:25.808 16:04:49 -- nvmf/common.sh@545 -- # IFS=, 00:18:25.808 16:04:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:25.808 "params": { 00:18:25.808 "name": "Nvme1", 00:18:25.808 "trtype": "tcp", 00:18:25.808 "traddr": "10.0.0.2", 00:18:25.808 "adrfam": "ipv4", 00:18:25.808 "trsvcid": "4420", 00:18:25.808 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:25.808 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:25.808 "hdgst": false, 00:18:25.808 "ddgst": false 00:18:25.808 }, 00:18:25.808 "method": "bdev_nvme_attach_controller" 00:18:25.808 }' 00:18:25.808 16:04:49 -- nvmf/common.sh@545 -- # IFS=, 00:18:25.808 16:04:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:25.808 "params": { 00:18:25.808 "name": "Nvme1", 00:18:25.808 "trtype": "tcp", 00:18:25.808 "traddr": "10.0.0.2", 00:18:25.808 "adrfam": "ipv4", 00:18:25.808 "trsvcid": "4420", 00:18:25.808 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:25.808 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:25.808 "hdgst": false, 00:18:25.808 "ddgst": false 00:18:25.808 }, 00:18:25.808 "method": "bdev_nvme_attach_controller" 00:18:25.808 }' 00:18:25.808 16:04:49 -- nvmf/common.sh@545 -- # IFS=, 00:18:25.808 16:04:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:25.808 "params": { 00:18:25.808 "name": "Nvme1", 00:18:25.808 "trtype": "tcp", 00:18:25.808 "traddr": "10.0.0.2", 00:18:25.808 "adrfam": "ipv4", 00:18:25.808 "trsvcid": "4420", 00:18:25.808 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:25.808 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:25.808 "hdgst": false, 00:18:25.808 "ddgst": false 00:18:25.808 }, 00:18:25.808 "method": "bdev_nvme_attach_controller" 00:18:25.808 }' 00:18:25.808 [2024-11-18 16:04:49.231387] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:25.808 [2024-11-18 16:04:49.231474] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:25.808 [2024-11-18 16:04:49.231965] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:25.808 [2024-11-18 16:04:49.231965] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:25.808 [2024-11-18 16:04:49.231977] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:25.808 [2024-11-18 16:04:49.232051] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-18 16:04:49.232051] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:25.808 [2024-11-18 16:04:49.232051] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:25.808 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:25.808 EAL: No free 2048 kB hugepages reported on node 1 00:18:25.808 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.066 [2024-11-18 16:04:49.408994] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.066 [2024-11-18 16:04:49.485652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:26.066 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.066 [2024-11-18 16:04:49.515508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.066 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.066 [2024-11-18 16:04:49.588871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:26.066 [2024-11-18 16:04:49.616841] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.323 [2024-11-18 16:04:49.686204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:26.323 [2024-11-18 16:04:49.686702] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.323 [2024-11-18 16:04:49.751559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:26.323 Running I/O for 1 seconds... 00:18:26.323 Running I/O for 1 seconds... 00:18:26.323 Running I/O for 1 seconds... 00:18:26.581 Running I/O for 1 seconds... 00:18:27.515 00:18:27.515 Latency(us) 00:18:27.515 [2024-11-18T15:04:51.106Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:27.515 [2024-11-18T15:04:51.106Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:27.515 Nvme1n1 : 1.01 11599.01 45.31 0.00 0.00 10990.92 7087.60 19126.80 00:18:27.515 [2024-11-18T15:04:51.106Z] =================================================================================================================== 00:18:27.515 [2024-11-18T15:04:51.106Z] Total : 11599.01 45.31 0.00 0.00 10990.92 7087.60 19126.80 00:18:27.515 00:18:27.515 Latency(us) 00:18:27.515 [2024-11-18T15:04:51.106Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:27.515 [2024-11-18T15:04:51.106Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:27.515 Nvme1n1 : 1.02 4959.21 19.37 0.00 0.00 25454.84 8592.50 37865.24 00:18:27.515 [2024-11-18T15:04:51.106Z] =================================================================================================================== 00:18:27.515 [2024-11-18T15:04:51.106Z] Total : 4959.21 19.37 0.00 0.00 25454.84 8592.50 37865.24 00:18:27.515 00:18:27.515 Latency(us) 00:18:27.515 [2024-11-18T15:04:51.106Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:27.515 [2024-11-18T15:04:51.106Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:27.515 Nvme1n1 : 1.00 196567.13 767.84 0.00 0.00 648.66 273.07 1092.27 00:18:27.515 [2024-11-18T15:04:51.106Z] =================================================================================================================== 00:18:27.515 [2024-11-18T15:04:51.106Z] Total : 196567.13 767.84 0.00 0.00 648.66 273.07 1092.27 00:18:27.515 00:18:27.515 Latency(us) 00:18:27.515 [2024-11-18T15:04:51.106Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:27.515 [2024-11-18T15:04:51.106Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:27.515 Nvme1n1 : 1.01 5121.77 20.01 0.00 0.00 24904.88 5898.24 52817.16 00:18:27.515 [2024-11-18T15:04:51.106Z] =================================================================================================================== 00:18:27.515 [2024-11-18T15:04:51.106Z] Total : 5121.77 20.01 0.00 0.00 24904.88 5898.24 52817.16 00:18:27.774 16:04:51 -- target/bdev_io_wait.sh@38 -- # wait 1584328 00:18:27.774 16:04:51 -- target/bdev_io_wait.sh@39 -- # wait 1584331 00:18:27.774 16:04:51 -- target/bdev_io_wait.sh@40 -- # wait 1584333 00:18:27.774 16:04:51 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:27.774 16:04:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.774 16:04:51 -- common/autotest_common.sh@10 -- # set +x 00:18:27.774 16:04:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.774 16:04:51 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:27.774 16:04:51 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:27.774 16:04:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:27.774 16:04:51 -- nvmf/common.sh@116 -- # sync 00:18:27.774 16:04:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:27.774 16:04:51 -- nvmf/common.sh@119 -- # set +e 00:18:27.774 16:04:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:27.774 16:04:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:27.774 rmmod nvme_tcp 00:18:27.774 rmmod nvme_fabrics 00:18:27.774 rmmod nvme_keyring 00:18:27.774 16:04:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:27.774 16:04:51 -- nvmf/common.sh@123 -- # set -e 00:18:27.774 16:04:51 -- nvmf/common.sh@124 -- # return 0 00:18:27.774 16:04:51 -- nvmf/common.sh@477 -- # '[' -n 1584298 ']' 00:18:27.774 16:04:51 -- nvmf/common.sh@478 -- # killprocess 1584298 00:18:27.774 16:04:51 -- common/autotest_common.sh@936 -- # '[' -z 1584298 ']' 00:18:27.774 16:04:51 -- common/autotest_common.sh@940 -- # kill -0 1584298 00:18:27.774 16:04:51 -- common/autotest_common.sh@941 -- # uname 00:18:27.774 16:04:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:27.774 16:04:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1584298 00:18:28.033 16:04:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:28.033 16:04:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:28.033 16:04:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1584298' 00:18:28.033 killing process with pid 1584298 00:18:28.033 16:04:51 -- common/autotest_common.sh@955 -- # kill 1584298 00:18:28.033 16:04:51 -- common/autotest_common.sh@960 -- # wait 1584298 00:18:28.033 16:04:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:28.033 16:04:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:28.033 16:04:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:28.033 16:04:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:28.033 16:04:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:28.033 16:04:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:28.033 16:04:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:28.033 16:04:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:30.566 16:04:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:30.566 00:18:30.566 real 0m7.138s 00:18:30.566 user 0m16.226s 00:18:30.566 sys 0m3.392s 00:18:30.566 16:04:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:30.566 16:04:53 -- common/autotest_common.sh@10 -- # set +x 00:18:30.566 ************************************ 00:18:30.566 END TEST nvmf_bdev_io_wait 00:18:30.566 ************************************ 00:18:30.567 16:04:53 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:30.567 16:04:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:30.567 16:04:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:30.567 16:04:53 -- common/autotest_common.sh@10 -- # set +x 00:18:30.567 ************************************ 00:18:30.567 START TEST nvmf_queue_depth 00:18:30.567 ************************************ 00:18:30.567 16:04:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:30.567 * Looking for test storage... 00:18:30.567 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:30.567 16:04:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:30.567 16:04:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:30.567 16:04:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:30.567 16:04:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:30.567 16:04:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:30.567 16:04:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:30.567 16:04:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:30.567 16:04:53 -- scripts/common.sh@335 -- # IFS=.-: 00:18:30.567 16:04:53 -- scripts/common.sh@335 -- # read -ra ver1 00:18:30.567 16:04:53 -- scripts/common.sh@336 -- # IFS=.-: 00:18:30.567 16:04:53 -- scripts/common.sh@336 -- # read -ra ver2 00:18:30.567 16:04:53 -- scripts/common.sh@337 -- # local 'op=<' 00:18:30.567 16:04:53 -- scripts/common.sh@339 -- # ver1_l=2 00:18:30.567 16:04:53 -- scripts/common.sh@340 -- # ver2_l=1 00:18:30.567 16:04:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:30.567 16:04:53 -- scripts/common.sh@343 -- # case "$op" in 00:18:30.567 16:04:53 -- scripts/common.sh@344 -- # : 1 00:18:30.567 16:04:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:30.567 16:04:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:30.567 16:04:53 -- scripts/common.sh@364 -- # decimal 1 00:18:30.567 16:04:53 -- scripts/common.sh@352 -- # local d=1 00:18:30.567 16:04:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:30.567 16:04:53 -- scripts/common.sh@354 -- # echo 1 00:18:30.567 16:04:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:30.567 16:04:53 -- scripts/common.sh@365 -- # decimal 2 00:18:30.567 16:04:53 -- scripts/common.sh@352 -- # local d=2 00:18:30.567 16:04:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:30.567 16:04:53 -- scripts/common.sh@354 -- # echo 2 00:18:30.567 16:04:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:30.567 16:04:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:30.567 16:04:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:30.567 16:04:53 -- scripts/common.sh@367 -- # return 0 00:18:30.567 16:04:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:30.567 16:04:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:30.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:30.567 --rc genhtml_branch_coverage=1 00:18:30.567 --rc genhtml_function_coverage=1 00:18:30.567 --rc genhtml_legend=1 00:18:30.567 --rc geninfo_all_blocks=1 00:18:30.567 --rc geninfo_unexecuted_blocks=1 00:18:30.567 00:18:30.567 ' 00:18:30.567 16:04:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:30.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:30.567 --rc genhtml_branch_coverage=1 00:18:30.567 --rc genhtml_function_coverage=1 00:18:30.567 --rc genhtml_legend=1 00:18:30.567 --rc geninfo_all_blocks=1 00:18:30.567 --rc geninfo_unexecuted_blocks=1 00:18:30.567 00:18:30.567 ' 00:18:30.567 16:04:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:30.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:30.567 --rc genhtml_branch_coverage=1 00:18:30.567 --rc genhtml_function_coverage=1 00:18:30.567 --rc genhtml_legend=1 00:18:30.567 --rc geninfo_all_blocks=1 00:18:30.567 --rc geninfo_unexecuted_blocks=1 00:18:30.567 00:18:30.567 ' 00:18:30.567 16:04:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:30.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:30.567 --rc genhtml_branch_coverage=1 00:18:30.567 --rc genhtml_function_coverage=1 00:18:30.567 --rc genhtml_legend=1 00:18:30.567 --rc geninfo_all_blocks=1 00:18:30.567 --rc geninfo_unexecuted_blocks=1 00:18:30.567 00:18:30.567 ' 00:18:30.567 16:04:53 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:30.567 16:04:53 -- nvmf/common.sh@7 -- # uname -s 00:18:30.567 16:04:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:30.567 16:04:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:30.567 16:04:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:30.567 16:04:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:30.567 16:04:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:30.567 16:04:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:30.567 16:04:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:30.567 16:04:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:30.567 16:04:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:30.567 16:04:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:30.567 16:04:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:30.567 16:04:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:30.567 16:04:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:30.567 16:04:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:30.567 16:04:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:30.567 16:04:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:30.567 16:04:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:30.567 16:04:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:30.567 16:04:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:30.567 16:04:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.567 16:04:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.567 16:04:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.567 16:04:53 -- paths/export.sh@5 -- # export PATH 00:18:30.567 16:04:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.567 16:04:53 -- nvmf/common.sh@46 -- # : 0 00:18:30.567 16:04:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:30.567 16:04:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:30.567 16:04:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:30.567 16:04:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:30.567 16:04:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:30.567 16:04:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:30.567 16:04:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:30.567 16:04:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:30.567 16:04:53 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:30.567 16:04:53 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:30.567 16:04:53 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:30.567 16:04:53 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:30.567 16:04:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:30.567 16:04:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:30.567 16:04:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:30.568 16:04:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:30.568 16:04:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:30.568 16:04:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:30.568 16:04:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:30.568 16:04:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:30.568 16:04:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:30.568 16:04:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:30.568 16:04:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:30.568 16:04:53 -- common/autotest_common.sh@10 -- # set +x 00:18:32.469 16:04:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:32.469 16:04:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:32.469 16:04:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:32.469 16:04:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:32.469 16:04:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:32.469 16:04:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:32.469 16:04:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:32.469 16:04:55 -- nvmf/common.sh@294 -- # net_devs=() 00:18:32.469 16:04:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:32.469 16:04:55 -- nvmf/common.sh@295 -- # e810=() 00:18:32.469 16:04:55 -- nvmf/common.sh@295 -- # local -ga e810 00:18:32.469 16:04:55 -- nvmf/common.sh@296 -- # x722=() 00:18:32.469 16:04:55 -- nvmf/common.sh@296 -- # local -ga x722 00:18:32.469 16:04:55 -- nvmf/common.sh@297 -- # mlx=() 00:18:32.469 16:04:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:32.469 16:04:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:32.469 16:04:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:32.469 16:04:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:32.469 16:04:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:32.469 16:04:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:32.469 16:04:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:32.469 16:04:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:32.469 16:04:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:32.469 16:04:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:32.469 16:04:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:32.469 16:04:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:32.469 16:04:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:32.469 16:04:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:32.469 16:04:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:32.469 16:04:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:32.469 16:04:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:32.469 16:04:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:32.469 16:04:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:32.469 16:04:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:32.469 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:32.469 16:04:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:32.469 16:04:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:32.469 16:04:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:32.469 16:04:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:32.469 16:04:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:32.469 16:04:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:32.469 16:04:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:32.469 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:32.470 16:04:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:32.470 16:04:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:32.470 16:04:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:32.470 16:04:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:32.470 16:04:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:32.470 16:04:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:32.470 16:04:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:32.470 16:04:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:32.470 16:04:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:32.470 16:04:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:32.470 16:04:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:32.470 16:04:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:32.470 16:04:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:32.470 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:32.470 16:04:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:32.470 16:04:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:32.470 16:04:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:32.470 16:04:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:32.470 16:04:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:32.470 16:04:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:32.470 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:32.470 16:04:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:32.470 16:04:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:32.470 16:04:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:32.470 16:04:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:32.470 16:04:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:32.470 16:04:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:32.470 16:04:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:32.470 16:04:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:32.470 16:04:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:32.470 16:04:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:32.470 16:04:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:32.470 16:04:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:32.470 16:04:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:32.470 16:04:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:32.470 16:04:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:32.470 16:04:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:32.470 16:04:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:32.470 16:04:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:32.470 16:04:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:32.470 16:04:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:32.470 16:04:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:32.470 16:04:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:32.470 16:04:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:32.728 16:04:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:32.728 16:04:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:32.728 16:04:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:32.728 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:32.728 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:18:32.728 00:18:32.728 --- 10.0.0.2 ping statistics --- 00:18:32.728 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:32.728 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:18:32.728 16:04:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:32.728 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:32.728 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.182 ms 00:18:32.728 00:18:32.728 --- 10.0.0.1 ping statistics --- 00:18:32.728 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:32.728 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:18:32.728 16:04:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:32.728 16:04:56 -- nvmf/common.sh@410 -- # return 0 00:18:32.728 16:04:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:32.728 16:04:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:32.728 16:04:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:32.728 16:04:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:32.728 16:04:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:32.728 16:04:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:32.728 16:04:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:32.728 16:04:56 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:32.728 16:04:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:32.728 16:04:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:32.728 16:04:56 -- common/autotest_common.sh@10 -- # set +x 00:18:32.728 16:04:56 -- nvmf/common.sh@469 -- # nvmfpid=1586579 00:18:32.728 16:04:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:32.728 16:04:56 -- nvmf/common.sh@470 -- # waitforlisten 1586579 00:18:32.728 16:04:56 -- common/autotest_common.sh@829 -- # '[' -z 1586579 ']' 00:18:32.728 16:04:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:32.728 16:04:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:32.728 16:04:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:32.728 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:32.728 16:04:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:32.728 16:04:56 -- common/autotest_common.sh@10 -- # set +x 00:18:32.728 [2024-11-18 16:04:56.182628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:32.728 [2024-11-18 16:04:56.182710] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:32.728 EAL: No free 2048 kB hugepages reported on node 1 00:18:32.728 [2024-11-18 16:04:56.251553] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:32.986 [2024-11-18 16:04:56.341637] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:32.986 [2024-11-18 16:04:56.341802] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:32.986 [2024-11-18 16:04:56.341822] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:32.986 [2024-11-18 16:04:56.341837] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:32.986 [2024-11-18 16:04:56.341880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:33.919 16:04:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:33.919 16:04:57 -- common/autotest_common.sh@862 -- # return 0 00:18:33.919 16:04:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:33.919 16:04:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:33.919 16:04:57 -- common/autotest_common.sh@10 -- # set +x 00:18:33.919 16:04:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:33.919 16:04:57 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:33.919 16:04:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:33.919 16:04:57 -- common/autotest_common.sh@10 -- # set +x 00:18:33.919 [2024-11-18 16:04:57.228711] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:33.919 16:04:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:33.919 16:04:57 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:33.920 16:04:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:33.920 16:04:57 -- common/autotest_common.sh@10 -- # set +x 00:18:33.920 Malloc0 00:18:33.920 16:04:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:33.920 16:04:57 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:33.920 16:04:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:33.920 16:04:57 -- common/autotest_common.sh@10 -- # set +x 00:18:33.920 16:04:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:33.920 16:04:57 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:33.920 16:04:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:33.920 16:04:57 -- common/autotest_common.sh@10 -- # set +x 00:18:33.920 16:04:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:33.920 16:04:57 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:33.920 16:04:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:33.920 16:04:57 -- common/autotest_common.sh@10 -- # set +x 00:18:33.920 [2024-11-18 16:04:57.289357] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:33.920 16:04:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:33.920 16:04:57 -- target/queue_depth.sh@30 -- # bdevperf_pid=1586740 00:18:33.920 16:04:57 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:33.920 16:04:57 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:33.920 16:04:57 -- target/queue_depth.sh@33 -- # waitforlisten 1586740 /var/tmp/bdevperf.sock 00:18:33.920 16:04:57 -- common/autotest_common.sh@829 -- # '[' -z 1586740 ']' 00:18:33.920 16:04:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:33.920 16:04:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:33.920 16:04:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:33.920 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:33.920 16:04:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:33.920 16:04:57 -- common/autotest_common.sh@10 -- # set +x 00:18:33.920 [2024-11-18 16:04:57.336128] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:33.920 [2024-11-18 16:04:57.336199] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1586740 ] 00:18:33.920 EAL: No free 2048 kB hugepages reported on node 1 00:18:33.920 [2024-11-18 16:04:57.403003] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:33.920 [2024-11-18 16:04:57.495083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:34.854 16:04:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:34.854 16:04:58 -- common/autotest_common.sh@862 -- # return 0 00:18:34.854 16:04:58 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:34.854 16:04:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.854 16:04:58 -- common/autotest_common.sh@10 -- # set +x 00:18:35.111 NVMe0n1 00:18:35.111 16:04:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:35.111 16:04:58 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:35.111 Running I/O for 10 seconds... 00:18:47.310 00:18:47.310 Latency(us) 00:18:47.310 [2024-11-18T15:05:10.901Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:47.310 [2024-11-18T15:05:10.901Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:47.310 Verification LBA range: start 0x0 length 0x4000 00:18:47.310 NVMe0n1 : 10.07 12274.32 47.95 0.00 0.00 83077.32 14078.10 63302.92 00:18:47.310 [2024-11-18T15:05:10.901Z] =================================================================================================================== 00:18:47.310 [2024-11-18T15:05:10.901Z] Total : 12274.32 47.95 0.00 0.00 83077.32 14078.10 63302.92 00:18:47.310 0 00:18:47.310 16:05:08 -- target/queue_depth.sh@39 -- # killprocess 1586740 00:18:47.310 16:05:08 -- common/autotest_common.sh@936 -- # '[' -z 1586740 ']' 00:18:47.310 16:05:08 -- common/autotest_common.sh@940 -- # kill -0 1586740 00:18:47.310 16:05:08 -- common/autotest_common.sh@941 -- # uname 00:18:47.310 16:05:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:47.310 16:05:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1586740 00:18:47.310 16:05:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:47.310 16:05:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:47.310 16:05:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1586740' 00:18:47.310 killing process with pid 1586740 00:18:47.310 16:05:08 -- common/autotest_common.sh@955 -- # kill 1586740 00:18:47.310 Received shutdown signal, test time was about 10.000000 seconds 00:18:47.310 00:18:47.310 Latency(us) 00:18:47.310 [2024-11-18T15:05:10.901Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:47.310 [2024-11-18T15:05:10.901Z] =================================================================================================================== 00:18:47.310 [2024-11-18T15:05:10.901Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:47.310 16:05:08 -- common/autotest_common.sh@960 -- # wait 1586740 00:18:47.310 16:05:09 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:47.310 16:05:09 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:47.310 16:05:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:47.310 16:05:09 -- nvmf/common.sh@116 -- # sync 00:18:47.310 16:05:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:47.310 16:05:09 -- nvmf/common.sh@119 -- # set +e 00:18:47.310 16:05:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:47.310 16:05:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:47.310 rmmod nvme_tcp 00:18:47.310 rmmod nvme_fabrics 00:18:47.310 rmmod nvme_keyring 00:18:47.310 16:05:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:47.310 16:05:09 -- nvmf/common.sh@123 -- # set -e 00:18:47.310 16:05:09 -- nvmf/common.sh@124 -- # return 0 00:18:47.310 16:05:09 -- nvmf/common.sh@477 -- # '[' -n 1586579 ']' 00:18:47.310 16:05:09 -- nvmf/common.sh@478 -- # killprocess 1586579 00:18:47.310 16:05:09 -- common/autotest_common.sh@936 -- # '[' -z 1586579 ']' 00:18:47.310 16:05:09 -- common/autotest_common.sh@940 -- # kill -0 1586579 00:18:47.310 16:05:09 -- common/autotest_common.sh@941 -- # uname 00:18:47.310 16:05:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:47.310 16:05:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1586579 00:18:47.310 16:05:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:47.310 16:05:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:47.310 16:05:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1586579' 00:18:47.310 killing process with pid 1586579 00:18:47.310 16:05:09 -- common/autotest_common.sh@955 -- # kill 1586579 00:18:47.310 16:05:09 -- common/autotest_common.sh@960 -- # wait 1586579 00:18:47.310 16:05:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:47.310 16:05:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:47.310 16:05:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:47.310 16:05:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:47.310 16:05:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:47.310 16:05:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:47.310 16:05:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:47.310 16:05:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:48.244 16:05:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:48.244 00:18:48.244 real 0m17.840s 00:18:48.244 user 0m25.581s 00:18:48.244 sys 0m3.236s 00:18:48.244 16:05:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:48.244 16:05:11 -- common/autotest_common.sh@10 -- # set +x 00:18:48.244 ************************************ 00:18:48.244 END TEST nvmf_queue_depth 00:18:48.244 ************************************ 00:18:48.245 16:05:11 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:48.245 16:05:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:48.245 16:05:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:48.245 16:05:11 -- common/autotest_common.sh@10 -- # set +x 00:18:48.245 ************************************ 00:18:48.245 START TEST nvmf_multipath 00:18:48.245 ************************************ 00:18:48.245 16:05:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:48.245 * Looking for test storage... 00:18:48.245 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:48.245 16:05:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:48.245 16:05:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:48.245 16:05:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:48.245 16:05:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:48.245 16:05:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:48.245 16:05:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:48.245 16:05:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:48.245 16:05:11 -- scripts/common.sh@335 -- # IFS=.-: 00:18:48.245 16:05:11 -- scripts/common.sh@335 -- # read -ra ver1 00:18:48.245 16:05:11 -- scripts/common.sh@336 -- # IFS=.-: 00:18:48.245 16:05:11 -- scripts/common.sh@336 -- # read -ra ver2 00:18:48.245 16:05:11 -- scripts/common.sh@337 -- # local 'op=<' 00:18:48.245 16:05:11 -- scripts/common.sh@339 -- # ver1_l=2 00:18:48.245 16:05:11 -- scripts/common.sh@340 -- # ver2_l=1 00:18:48.245 16:05:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:48.245 16:05:11 -- scripts/common.sh@343 -- # case "$op" in 00:18:48.245 16:05:11 -- scripts/common.sh@344 -- # : 1 00:18:48.245 16:05:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:48.245 16:05:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:48.245 16:05:11 -- scripts/common.sh@364 -- # decimal 1 00:18:48.245 16:05:11 -- scripts/common.sh@352 -- # local d=1 00:18:48.245 16:05:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:48.245 16:05:11 -- scripts/common.sh@354 -- # echo 1 00:18:48.245 16:05:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:48.245 16:05:11 -- scripts/common.sh@365 -- # decimal 2 00:18:48.245 16:05:11 -- scripts/common.sh@352 -- # local d=2 00:18:48.245 16:05:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:48.245 16:05:11 -- scripts/common.sh@354 -- # echo 2 00:18:48.245 16:05:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:48.245 16:05:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:48.245 16:05:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:48.245 16:05:11 -- scripts/common.sh@367 -- # return 0 00:18:48.245 16:05:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:48.245 16:05:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:48.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:48.245 --rc genhtml_branch_coverage=1 00:18:48.245 --rc genhtml_function_coverage=1 00:18:48.245 --rc genhtml_legend=1 00:18:48.245 --rc geninfo_all_blocks=1 00:18:48.245 --rc geninfo_unexecuted_blocks=1 00:18:48.245 00:18:48.245 ' 00:18:48.245 16:05:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:48.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:48.245 --rc genhtml_branch_coverage=1 00:18:48.245 --rc genhtml_function_coverage=1 00:18:48.245 --rc genhtml_legend=1 00:18:48.245 --rc geninfo_all_blocks=1 00:18:48.245 --rc geninfo_unexecuted_blocks=1 00:18:48.245 00:18:48.245 ' 00:18:48.245 16:05:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:48.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:48.245 --rc genhtml_branch_coverage=1 00:18:48.245 --rc genhtml_function_coverage=1 00:18:48.245 --rc genhtml_legend=1 00:18:48.245 --rc geninfo_all_blocks=1 00:18:48.245 --rc geninfo_unexecuted_blocks=1 00:18:48.245 00:18:48.245 ' 00:18:48.245 16:05:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:48.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:48.245 --rc genhtml_branch_coverage=1 00:18:48.245 --rc genhtml_function_coverage=1 00:18:48.245 --rc genhtml_legend=1 00:18:48.245 --rc geninfo_all_blocks=1 00:18:48.245 --rc geninfo_unexecuted_blocks=1 00:18:48.245 00:18:48.245 ' 00:18:48.245 16:05:11 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:48.245 16:05:11 -- nvmf/common.sh@7 -- # uname -s 00:18:48.245 16:05:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:48.245 16:05:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:48.245 16:05:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:48.245 16:05:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:48.245 16:05:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:48.245 16:05:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:48.245 16:05:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:48.245 16:05:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:48.245 16:05:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:48.245 16:05:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:48.245 16:05:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:48.245 16:05:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:48.245 16:05:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:48.245 16:05:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:48.245 16:05:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:48.245 16:05:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:48.245 16:05:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:48.245 16:05:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:48.245 16:05:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:48.245 16:05:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:48.245 16:05:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:48.245 16:05:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:48.245 16:05:11 -- paths/export.sh@5 -- # export PATH 00:18:48.246 16:05:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:48.246 16:05:11 -- nvmf/common.sh@46 -- # : 0 00:18:48.246 16:05:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:48.246 16:05:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:48.246 16:05:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:48.246 16:05:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:48.246 16:05:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:48.246 16:05:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:48.246 16:05:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:48.246 16:05:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:48.246 16:05:11 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:48.246 16:05:11 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:48.246 16:05:11 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:48.246 16:05:11 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:48.246 16:05:11 -- target/multipath.sh@43 -- # nvmftestinit 00:18:48.246 16:05:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:48.246 16:05:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:48.246 16:05:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:48.246 16:05:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:48.246 16:05:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:48.246 16:05:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:48.246 16:05:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:48.246 16:05:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:48.246 16:05:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:48.246 16:05:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:48.246 16:05:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:48.246 16:05:11 -- common/autotest_common.sh@10 -- # set +x 00:18:50.200 16:05:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:50.200 16:05:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:50.200 16:05:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:50.200 16:05:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:50.200 16:05:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:50.200 16:05:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:50.200 16:05:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:50.200 16:05:13 -- nvmf/common.sh@294 -- # net_devs=() 00:18:50.200 16:05:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:50.200 16:05:13 -- nvmf/common.sh@295 -- # e810=() 00:18:50.200 16:05:13 -- nvmf/common.sh@295 -- # local -ga e810 00:18:50.200 16:05:13 -- nvmf/common.sh@296 -- # x722=() 00:18:50.200 16:05:13 -- nvmf/common.sh@296 -- # local -ga x722 00:18:50.200 16:05:13 -- nvmf/common.sh@297 -- # mlx=() 00:18:50.200 16:05:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:50.200 16:05:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:50.200 16:05:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:50.200 16:05:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:50.200 16:05:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:50.200 16:05:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:50.200 16:05:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:50.200 16:05:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:50.200 16:05:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:50.200 16:05:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:50.200 16:05:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:50.200 16:05:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:50.200 16:05:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:50.200 16:05:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:50.200 16:05:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:50.200 16:05:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:50.200 16:05:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:50.200 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:50.200 16:05:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:50.200 16:05:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:50.200 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:50.200 16:05:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:50.200 16:05:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:50.200 16:05:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:50.201 16:05:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:50.201 16:05:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:50.201 16:05:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:50.201 16:05:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:50.201 16:05:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:50.201 16:05:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:50.201 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:50.201 16:05:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:50.201 16:05:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:50.201 16:05:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:50.201 16:05:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:50.201 16:05:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:50.201 16:05:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:50.201 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:50.201 16:05:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:50.201 16:05:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:50.201 16:05:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:50.201 16:05:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:50.201 16:05:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:50.201 16:05:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:50.201 16:05:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:50.201 16:05:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:50.201 16:05:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:50.201 16:05:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:50.201 16:05:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:50.201 16:05:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:50.201 16:05:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:50.201 16:05:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:50.201 16:05:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:50.201 16:05:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:50.201 16:05:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:50.201 16:05:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:50.201 16:05:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:50.201 16:05:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:50.201 16:05:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:50.201 16:05:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:50.201 16:05:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:50.201 16:05:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:50.201 16:05:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:50.201 16:05:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:50.201 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:50.201 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.340 ms 00:18:50.201 00:18:50.201 --- 10.0.0.2 ping statistics --- 00:18:50.201 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:50.201 rtt min/avg/max/mdev = 0.340/0.340/0.340/0.000 ms 00:18:50.201 16:05:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:50.201 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:50.201 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:18:50.201 00:18:50.201 --- 10.0.0.1 ping statistics --- 00:18:50.201 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:50.201 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:18:50.201 16:05:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:50.201 16:05:13 -- nvmf/common.sh@410 -- # return 0 00:18:50.201 16:05:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:50.201 16:05:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:50.201 16:05:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:50.201 16:05:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:50.201 16:05:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:50.201 16:05:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:50.201 16:05:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:50.201 16:05:13 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:50.201 16:05:13 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:50.201 only one NIC for nvmf test 00:18:50.201 16:05:13 -- target/multipath.sh@47 -- # nvmftestfini 00:18:50.201 16:05:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:50.201 16:05:13 -- nvmf/common.sh@116 -- # sync 00:18:50.201 16:05:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:50.201 16:05:13 -- nvmf/common.sh@119 -- # set +e 00:18:50.201 16:05:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:50.201 16:05:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:50.459 rmmod nvme_tcp 00:18:50.459 rmmod nvme_fabrics 00:18:50.459 rmmod nvme_keyring 00:18:50.459 16:05:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:50.459 16:05:13 -- nvmf/common.sh@123 -- # set -e 00:18:50.459 16:05:13 -- nvmf/common.sh@124 -- # return 0 00:18:50.459 16:05:13 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:50.459 16:05:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:50.459 16:05:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:50.459 16:05:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:50.459 16:05:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:50.459 16:05:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:50.459 16:05:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:50.459 16:05:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:50.459 16:05:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:52.362 16:05:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:52.362 16:05:15 -- target/multipath.sh@48 -- # exit 0 00:18:52.362 16:05:15 -- target/multipath.sh@1 -- # nvmftestfini 00:18:52.362 16:05:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:52.362 16:05:15 -- nvmf/common.sh@116 -- # sync 00:18:52.362 16:05:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:52.362 16:05:15 -- nvmf/common.sh@119 -- # set +e 00:18:52.362 16:05:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:52.362 16:05:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:52.362 16:05:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:52.362 16:05:15 -- nvmf/common.sh@123 -- # set -e 00:18:52.362 16:05:15 -- nvmf/common.sh@124 -- # return 0 00:18:52.362 16:05:15 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:52.362 16:05:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:52.362 16:05:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:52.362 16:05:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:52.362 16:05:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:52.362 16:05:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:52.362 16:05:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:52.362 16:05:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:52.362 16:05:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:52.362 16:05:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:52.362 00:18:52.362 real 0m4.389s 00:18:52.362 user 0m0.889s 00:18:52.362 sys 0m1.486s 00:18:52.362 16:05:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:52.362 16:05:15 -- common/autotest_common.sh@10 -- # set +x 00:18:52.362 ************************************ 00:18:52.362 END TEST nvmf_multipath 00:18:52.362 ************************************ 00:18:52.362 16:05:15 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:52.362 16:05:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:52.362 16:05:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:52.362 16:05:15 -- common/autotest_common.sh@10 -- # set +x 00:18:52.362 ************************************ 00:18:52.362 START TEST nvmf_zcopy 00:18:52.362 ************************************ 00:18:52.362 16:05:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:52.621 * Looking for test storage... 00:18:52.621 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:52.621 16:05:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:52.621 16:05:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:52.621 16:05:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:52.621 16:05:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:52.621 16:05:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:52.621 16:05:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:52.621 16:05:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:52.621 16:05:16 -- scripts/common.sh@335 -- # IFS=.-: 00:18:52.621 16:05:16 -- scripts/common.sh@335 -- # read -ra ver1 00:18:52.621 16:05:16 -- scripts/common.sh@336 -- # IFS=.-: 00:18:52.621 16:05:16 -- scripts/common.sh@336 -- # read -ra ver2 00:18:52.621 16:05:16 -- scripts/common.sh@337 -- # local 'op=<' 00:18:52.621 16:05:16 -- scripts/common.sh@339 -- # ver1_l=2 00:18:52.622 16:05:16 -- scripts/common.sh@340 -- # ver2_l=1 00:18:52.622 16:05:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:52.622 16:05:16 -- scripts/common.sh@343 -- # case "$op" in 00:18:52.622 16:05:16 -- scripts/common.sh@344 -- # : 1 00:18:52.622 16:05:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:52.622 16:05:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:52.622 16:05:16 -- scripts/common.sh@364 -- # decimal 1 00:18:52.622 16:05:16 -- scripts/common.sh@352 -- # local d=1 00:18:52.622 16:05:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:52.622 16:05:16 -- scripts/common.sh@354 -- # echo 1 00:18:52.622 16:05:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:52.622 16:05:16 -- scripts/common.sh@365 -- # decimal 2 00:18:52.622 16:05:16 -- scripts/common.sh@352 -- # local d=2 00:18:52.622 16:05:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:52.622 16:05:16 -- scripts/common.sh@354 -- # echo 2 00:18:52.622 16:05:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:52.622 16:05:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:52.622 16:05:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:52.622 16:05:16 -- scripts/common.sh@367 -- # return 0 00:18:52.622 16:05:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:52.622 16:05:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:52.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:52.622 --rc genhtml_branch_coverage=1 00:18:52.622 --rc genhtml_function_coverage=1 00:18:52.622 --rc genhtml_legend=1 00:18:52.622 --rc geninfo_all_blocks=1 00:18:52.622 --rc geninfo_unexecuted_blocks=1 00:18:52.622 00:18:52.622 ' 00:18:52.622 16:05:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:52.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:52.622 --rc genhtml_branch_coverage=1 00:18:52.622 --rc genhtml_function_coverage=1 00:18:52.622 --rc genhtml_legend=1 00:18:52.622 --rc geninfo_all_blocks=1 00:18:52.622 --rc geninfo_unexecuted_blocks=1 00:18:52.622 00:18:52.622 ' 00:18:52.622 16:05:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:52.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:52.622 --rc genhtml_branch_coverage=1 00:18:52.622 --rc genhtml_function_coverage=1 00:18:52.622 --rc genhtml_legend=1 00:18:52.622 --rc geninfo_all_blocks=1 00:18:52.622 --rc geninfo_unexecuted_blocks=1 00:18:52.622 00:18:52.622 ' 00:18:52.622 16:05:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:52.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:52.622 --rc genhtml_branch_coverage=1 00:18:52.622 --rc genhtml_function_coverage=1 00:18:52.622 --rc genhtml_legend=1 00:18:52.622 --rc geninfo_all_blocks=1 00:18:52.622 --rc geninfo_unexecuted_blocks=1 00:18:52.622 00:18:52.622 ' 00:18:52.622 16:05:16 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:52.622 16:05:16 -- nvmf/common.sh@7 -- # uname -s 00:18:52.622 16:05:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:52.622 16:05:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:52.622 16:05:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:52.622 16:05:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:52.622 16:05:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:52.622 16:05:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:52.622 16:05:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:52.622 16:05:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:52.622 16:05:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:52.622 16:05:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:52.622 16:05:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:52.622 16:05:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:52.622 16:05:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:52.622 16:05:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:52.622 16:05:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:52.622 16:05:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:52.622 16:05:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:52.622 16:05:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:52.622 16:05:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:52.622 16:05:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.622 16:05:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.622 16:05:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.622 16:05:16 -- paths/export.sh@5 -- # export PATH 00:18:52.622 16:05:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.622 16:05:16 -- nvmf/common.sh@46 -- # : 0 00:18:52.622 16:05:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:52.622 16:05:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:52.622 16:05:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:52.622 16:05:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:52.622 16:05:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:52.622 16:05:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:52.622 16:05:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:52.622 16:05:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:52.622 16:05:16 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:52.622 16:05:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:52.622 16:05:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:52.622 16:05:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:52.622 16:05:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:52.622 16:05:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:52.622 16:05:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:52.622 16:05:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:52.622 16:05:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:52.622 16:05:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:52.622 16:05:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:52.622 16:05:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:52.622 16:05:16 -- common/autotest_common.sh@10 -- # set +x 00:18:55.157 16:05:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:55.157 16:05:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:55.157 16:05:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:55.157 16:05:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:55.157 16:05:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:55.157 16:05:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:55.157 16:05:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:55.157 16:05:18 -- nvmf/common.sh@294 -- # net_devs=() 00:18:55.157 16:05:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:55.157 16:05:18 -- nvmf/common.sh@295 -- # e810=() 00:18:55.157 16:05:18 -- nvmf/common.sh@295 -- # local -ga e810 00:18:55.157 16:05:18 -- nvmf/common.sh@296 -- # x722=() 00:18:55.157 16:05:18 -- nvmf/common.sh@296 -- # local -ga x722 00:18:55.157 16:05:18 -- nvmf/common.sh@297 -- # mlx=() 00:18:55.157 16:05:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:55.157 16:05:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:55.157 16:05:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:55.157 16:05:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:55.157 16:05:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:55.157 16:05:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:55.157 16:05:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:55.157 16:05:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:55.157 16:05:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:55.157 16:05:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:55.157 16:05:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:55.157 16:05:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:55.157 16:05:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:55.157 16:05:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:55.157 16:05:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:55.157 16:05:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:55.157 16:05:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:55.157 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:55.157 16:05:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:55.157 16:05:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:55.157 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:55.157 16:05:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:55.157 16:05:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:55.157 16:05:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:55.157 16:05:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:55.157 16:05:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:55.157 16:05:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:55.157 16:05:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:55.157 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:55.157 16:05:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:55.157 16:05:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:55.157 16:05:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:55.157 16:05:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:55.157 16:05:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:55.157 16:05:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:55.157 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:55.157 16:05:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:55.157 16:05:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:55.158 16:05:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:55.158 16:05:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:55.158 16:05:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:55.158 16:05:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:55.158 16:05:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:55.158 16:05:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:55.158 16:05:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:55.158 16:05:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:55.158 16:05:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:55.158 16:05:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:55.158 16:05:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:55.158 16:05:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:55.158 16:05:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:55.158 16:05:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:55.158 16:05:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:55.158 16:05:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:55.158 16:05:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:55.158 16:05:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:55.158 16:05:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:55.158 16:05:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:55.158 16:05:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:55.158 16:05:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:55.158 16:05:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:55.158 16:05:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:55.158 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:55.158 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.347 ms 00:18:55.158 00:18:55.158 --- 10.0.0.2 ping statistics --- 00:18:55.158 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:55.158 rtt min/avg/max/mdev = 0.347/0.347/0.347/0.000 ms 00:18:55.158 16:05:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:55.158 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:55.158 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:18:55.158 00:18:55.158 --- 10.0.0.1 ping statistics --- 00:18:55.158 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:55.158 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:18:55.158 16:05:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:55.158 16:05:18 -- nvmf/common.sh@410 -- # return 0 00:18:55.158 16:05:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:55.158 16:05:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:55.158 16:05:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:55.158 16:05:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:55.158 16:05:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:55.158 16:05:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:55.158 16:05:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:55.158 16:05:18 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:55.158 16:05:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:55.158 16:05:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:55.158 16:05:18 -- common/autotest_common.sh@10 -- # set +x 00:18:55.158 16:05:18 -- nvmf/common.sh@469 -- # nvmfpid=1592122 00:18:55.158 16:05:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:55.158 16:05:18 -- nvmf/common.sh@470 -- # waitforlisten 1592122 00:18:55.158 16:05:18 -- common/autotest_common.sh@829 -- # '[' -z 1592122 ']' 00:18:55.158 16:05:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:55.158 16:05:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:55.158 16:05:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:55.158 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:55.158 16:05:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:55.158 16:05:18 -- common/autotest_common.sh@10 -- # set +x 00:18:55.158 [2024-11-18 16:05:18.478027] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:55.158 [2024-11-18 16:05:18.478121] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:55.158 EAL: No free 2048 kB hugepages reported on node 1 00:18:55.158 [2024-11-18 16:05:18.549409] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:55.158 [2024-11-18 16:05:18.640007] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:55.158 [2024-11-18 16:05:18.640189] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:55.158 [2024-11-18 16:05:18.640210] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:55.158 [2024-11-18 16:05:18.640226] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:55.158 [2024-11-18 16:05:18.640258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:56.092 16:05:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:56.092 16:05:19 -- common/autotest_common.sh@862 -- # return 0 00:18:56.092 16:05:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:56.092 16:05:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:56.092 16:05:19 -- common/autotest_common.sh@10 -- # set +x 00:18:56.092 16:05:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:56.092 16:05:19 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:56.092 16:05:19 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:56.092 16:05:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.092 16:05:19 -- common/autotest_common.sh@10 -- # set +x 00:18:56.092 [2024-11-18 16:05:19.453876] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:56.092 16:05:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.092 16:05:19 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:56.092 16:05:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.092 16:05:19 -- common/autotest_common.sh@10 -- # set +x 00:18:56.092 16:05:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.092 16:05:19 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:56.092 16:05:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.092 16:05:19 -- common/autotest_common.sh@10 -- # set +x 00:18:56.092 [2024-11-18 16:05:19.470098] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:56.092 16:05:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.092 16:05:19 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:56.092 16:05:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.092 16:05:19 -- common/autotest_common.sh@10 -- # set +x 00:18:56.092 16:05:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.092 16:05:19 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:56.092 16:05:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.092 16:05:19 -- common/autotest_common.sh@10 -- # set +x 00:18:56.092 malloc0 00:18:56.092 16:05:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.092 16:05:19 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:56.092 16:05:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.092 16:05:19 -- common/autotest_common.sh@10 -- # set +x 00:18:56.092 16:05:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.092 16:05:19 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:56.092 16:05:19 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:56.092 16:05:19 -- nvmf/common.sh@520 -- # config=() 00:18:56.092 16:05:19 -- nvmf/common.sh@520 -- # local subsystem config 00:18:56.092 16:05:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:56.092 16:05:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:56.092 { 00:18:56.092 "params": { 00:18:56.092 "name": "Nvme$subsystem", 00:18:56.092 "trtype": "$TEST_TRANSPORT", 00:18:56.092 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:56.092 "adrfam": "ipv4", 00:18:56.092 "trsvcid": "$NVMF_PORT", 00:18:56.092 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:56.092 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:56.092 "hdgst": ${hdgst:-false}, 00:18:56.092 "ddgst": ${ddgst:-false} 00:18:56.092 }, 00:18:56.092 "method": "bdev_nvme_attach_controller" 00:18:56.092 } 00:18:56.092 EOF 00:18:56.092 )") 00:18:56.092 16:05:19 -- nvmf/common.sh@542 -- # cat 00:18:56.092 16:05:19 -- nvmf/common.sh@544 -- # jq . 00:18:56.092 16:05:19 -- nvmf/common.sh@545 -- # IFS=, 00:18:56.092 16:05:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:56.092 "params": { 00:18:56.092 "name": "Nvme1", 00:18:56.092 "trtype": "tcp", 00:18:56.092 "traddr": "10.0.0.2", 00:18:56.092 "adrfam": "ipv4", 00:18:56.092 "trsvcid": "4420", 00:18:56.092 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:56.092 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:56.092 "hdgst": false, 00:18:56.092 "ddgst": false 00:18:56.092 }, 00:18:56.092 "method": "bdev_nvme_attach_controller" 00:18:56.092 }' 00:18:56.092 [2024-11-18 16:05:19.540906] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:56.092 [2024-11-18 16:05:19.540998] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1592280 ] 00:18:56.092 EAL: No free 2048 kB hugepages reported on node 1 00:18:56.092 [2024-11-18 16:05:19.603900] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:56.351 [2024-11-18 16:05:19.696739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:56.608 Running I/O for 10 seconds... 00:19:06.576 00:19:06.576 Latency(us) 00:19:06.576 [2024-11-18T15:05:30.167Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:06.576 [2024-11-18T15:05:30.167Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:19:06.576 Verification LBA range: start 0x0 length 0x1000 00:19:06.576 Nvme1n1 : 10.01 8641.97 67.52 0.00 0.00 14776.27 1747.63 20583.16 00:19:06.576 [2024-11-18T15:05:30.167Z] =================================================================================================================== 00:19:06.576 [2024-11-18T15:05:30.167Z] Total : 8641.97 67.52 0.00 0.00 14776.27 1747.63 20583.16 00:19:06.834 16:05:30 -- target/zcopy.sh@39 -- # perfpid=1593620 00:19:06.834 16:05:30 -- target/zcopy.sh@41 -- # xtrace_disable 00:19:06.834 16:05:30 -- common/autotest_common.sh@10 -- # set +x 00:19:06.834 16:05:30 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:19:06.834 16:05:30 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:19:06.834 16:05:30 -- nvmf/common.sh@520 -- # config=() 00:19:06.834 16:05:30 -- nvmf/common.sh@520 -- # local subsystem config 00:19:06.834 16:05:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:06.834 [2024-11-18 16:05:30.309863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.834 16:05:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:06.834 { 00:19:06.834 "params": { 00:19:06.834 "name": "Nvme$subsystem", 00:19:06.834 "trtype": "$TEST_TRANSPORT", 00:19:06.834 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:06.834 "adrfam": "ipv4", 00:19:06.834 "trsvcid": "$NVMF_PORT", 00:19:06.834 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:06.834 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:06.834 "hdgst": ${hdgst:-false}, 00:19:06.834 "ddgst": ${ddgst:-false} 00:19:06.834 }, 00:19:06.834 "method": "bdev_nvme_attach_controller" 00:19:06.834 } 00:19:06.834 EOF 00:19:06.834 )") 00:19:06.834 [2024-11-18 16:05:30.309922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.834 16:05:30 -- nvmf/common.sh@542 -- # cat 00:19:06.834 16:05:30 -- nvmf/common.sh@544 -- # jq . 00:19:06.834 16:05:30 -- nvmf/common.sh@545 -- # IFS=, 00:19:06.834 16:05:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:06.834 "params": { 00:19:06.834 "name": "Nvme1", 00:19:06.834 "trtype": "tcp", 00:19:06.834 "traddr": "10.0.0.2", 00:19:06.834 "adrfam": "ipv4", 00:19:06.834 "trsvcid": "4420", 00:19:06.834 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:06.834 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:06.834 "hdgst": false, 00:19:06.834 "ddgst": false 00:19:06.834 }, 00:19:06.834 "method": "bdev_nvme_attach_controller" 00:19:06.834 }' 00:19:06.834 [2024-11-18 16:05:30.317824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.834 [2024-11-18 16:05:30.317848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.834 [2024-11-18 16:05:30.325845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.834 [2024-11-18 16:05:30.325868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.834 [2024-11-18 16:05:30.333865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.834 [2024-11-18 16:05:30.333905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.834 [2024-11-18 16:05:30.341904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.835 [2024-11-18 16:05:30.341926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.835 [2024-11-18 16:05:30.345536] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:06.835 [2024-11-18 16:05:30.345615] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1593620 ] 00:19:06.835 [2024-11-18 16:05:30.349922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.835 [2024-11-18 16:05:30.349942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.835 [2024-11-18 16:05:30.357943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.835 [2024-11-18 16:05:30.357978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.835 [2024-11-18 16:05:30.365963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.835 [2024-11-18 16:05:30.365983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.835 [2024-11-18 16:05:30.373991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.835 [2024-11-18 16:05:30.374013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.835 EAL: No free 2048 kB hugepages reported on node 1 00:19:06.835 [2024-11-18 16:05:30.382008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.835 [2024-11-18 16:05:30.382033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.835 [2024-11-18 16:05:30.390029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.835 [2024-11-18 16:05:30.390054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.835 [2024-11-18 16:05:30.398065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.835 [2024-11-18 16:05:30.398090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.835 [2024-11-18 16:05:30.406077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.835 [2024-11-18 16:05:30.406101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:06.835 [2024-11-18 16:05:30.412327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:06.835 [2024-11-18 16:05:30.414100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:06.835 [2024-11-18 16:05:30.414125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.093 [2024-11-18 16:05:30.426200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.093 [2024-11-18 16:05:30.426248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.093 [2024-11-18 16:05:30.434161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.093 [2024-11-18 16:05:30.434187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.093 [2024-11-18 16:05:30.442182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.442207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.450205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.450230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.458228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.458253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.466274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.466310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.474298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.474336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.482292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.482330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.490314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.490339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.498340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.498366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.506301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:07.094 [2024-11-18 16:05:30.506359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.506381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.514381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.514406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.522425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.522459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.530453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.530490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.538482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.538522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.546512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.546555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.554529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.554571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.562552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.562593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.570563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.570597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.578568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.578596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.586631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.586685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.594664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.594703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.602640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.602679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.610687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.610714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.618704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.618729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.626720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.626745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.634739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.634762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.642758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.642782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.650804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.650827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.658800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.658821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.666821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.666842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.674849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.674871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.094 [2024-11-18 16:05:30.682877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.094 [2024-11-18 16:05:30.682927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.352 [2024-11-18 16:05:30.690920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.352 [2024-11-18 16:05:30.690944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.352 [2024-11-18 16:05:30.698933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.352 [2024-11-18 16:05:30.698957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.352 [2024-11-18 16:05:30.706955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.352 [2024-11-18 16:05:30.706976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.714993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.715017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.722999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.723019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.731037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.731074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.739076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.739102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.747088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.747113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.755112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.755140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.763136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.763163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.771159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.771184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.779186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.779214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.787205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.787230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.795224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.795249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.803247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.803272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.811271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.811296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.819299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.819325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.827325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.827352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.835413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.835444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.843430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.843456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 Running I/O for 5 seconds... 00:19:07.353 [2024-11-18 16:05:30.851738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.851784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.866977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.867011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.879353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.879385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.892337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.892368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.904414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.904446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.916404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.916436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.928799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.928827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.353 [2024-11-18 16:05:30.941344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.353 [2024-11-18 16:05:30.941376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:30.953749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:30.953778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:30.966506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:30.966538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:30.978388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:30.978429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:30.990208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:30.990240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.001750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.001779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.014137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.014170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.026240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.026273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.038450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.038483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.050411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.050443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.062526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.062558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.074160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.074191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.086330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.086362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.098734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.098778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.111346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.111377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.123463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.123496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.135341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.135373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.147394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.147426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.159646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.159676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.171703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.171731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.183605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.183646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.611 [2024-11-18 16:05:31.195361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.611 [2024-11-18 16:05:31.195393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.207675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.207728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.219431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.219463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.231494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.231526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.243382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.243415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.256207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.256240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.268787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.268816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.282828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.282857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.294488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.294521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.306839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.306869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.319173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.319206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.330810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.330840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.343416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.343449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.356441] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.356472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.368798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.368827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.381018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.381050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.392770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.392800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.404804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.404833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.417423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.417456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.429712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.429754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.442386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.442429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:07.870 [2024-11-18 16:05:31.455254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:07.870 [2024-11-18 16:05:31.455287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.467649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.467693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.480490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.480522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.492556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.492590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.505147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.505179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.517258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.517290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.529883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.529927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.542154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.542187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.554438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.554470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.566706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.566735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.578816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.578845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.591069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.591101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.603174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.603207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.615934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.615977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.628317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.628349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.640500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.640532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.652758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.652787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.664692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.664721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.677419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.677461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.690302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.690335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.701614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.701643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.129 [2024-11-18 16:05:31.712400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.129 [2024-11-18 16:05:31.712428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.724762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.724791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.736888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.736932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.748949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.748981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.761249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.761281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.773425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.773457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.785981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.786013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.798023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.798056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.810349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.810381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.822621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.822667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.834801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.834831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.847073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.847105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.859153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.859185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.871448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.871479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.883811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.883840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.895519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.895552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.907721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.907758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.920125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.920158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.932022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.932054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.944289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.944321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.387 [2024-11-18 16:05:31.956472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.387 [2024-11-18 16:05:31.956504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.388 [2024-11-18 16:05:31.968584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.388 [2024-11-18 16:05:31.968628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:31.979886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:31.979914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:31.992024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:31.992056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.004549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.004581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.017208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.017241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.029763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.029791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.042097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.042128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.054127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.054159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.066295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.066326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.078561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.078593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.090465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.090497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.102092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.102124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.114468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.114500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.126906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.126938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.138682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.138710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.151139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.151171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.163449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.163481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.176065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.176097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.188656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.188685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.200746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.200775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.212827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.212855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.646 [2024-11-18 16:05:32.225155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.646 [2024-11-18 16:05:32.225187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.236769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.236812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.249349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.249381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.262026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.262057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.274506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.274538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.286849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.286876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.299470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.299501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.312014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.312046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.324075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.324107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.338076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.338108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.349288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.349319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.361632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.361677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.374077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.374109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.386170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.386201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.398019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.398051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.410017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.410048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.422251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.422282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.434636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.434682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.446440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.446472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.458443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.458475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.470490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.470522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.482809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.482838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:08.905 [2024-11-18 16:05:32.494842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:08.905 [2024-11-18 16:05:32.494871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.163 [2024-11-18 16:05:32.507832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.163 [2024-11-18 16:05:32.507860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.163 [2024-11-18 16:05:32.520206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.163 [2024-11-18 16:05:32.520238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.163 [2024-11-18 16:05:32.533171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.163 [2024-11-18 16:05:32.533203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.545071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.545109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.557129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.557161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.569254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.569285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.582274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.582306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.595135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.595167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.607286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.607318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.619527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.619560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.631746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.631775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.643743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.643771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.656135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.656167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.668197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.668228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.680226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.680258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.692632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.692676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.705063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.705096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.717232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.717263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.729621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.729669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.164 [2024-11-18 16:05:32.742004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.164 [2024-11-18 16:05:32.742036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.422 [2024-11-18 16:05:32.754919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.422 [2024-11-18 16:05:32.754947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.422 [2024-11-18 16:05:32.767061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.422 [2024-11-18 16:05:32.767093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.422 [2024-11-18 16:05:32.779232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.422 [2024-11-18 16:05:32.779264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.422 [2024-11-18 16:05:32.791041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.422 [2024-11-18 16:05:32.791074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.422 [2024-11-18 16:05:32.803652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.422 [2024-11-18 16:05:32.803684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.422 [2024-11-18 16:05:32.815856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.422 [2024-11-18 16:05:32.815901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.828068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.828116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.840669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.840702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.852789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.852819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.865709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.865739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.878029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.878061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.890246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.890278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.902435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.902467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.914534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.914565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.926511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.926543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.938781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.938810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.950722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.950750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.962570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.962602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.975022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.975055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:32.987301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:32.987332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:33.000076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:33.000108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.423 [2024-11-18 16:05:33.012254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.423 [2024-11-18 16:05:33.012297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.024435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.024466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.036721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.036749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.049118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.049150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.061512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.061553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.074150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.074182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.086318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.086351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.098849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.098877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.111090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.111123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.122915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.122943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.135119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.135153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.147740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.147770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.161811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.161840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.173431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.173463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.185822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.185851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.197839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.197872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.209979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.210011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.222328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.222360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.234521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.234553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.248435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.248468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.681 [2024-11-18 16:05:33.259651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.681 [2024-11-18 16:05:33.259701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.939 [2024-11-18 16:05:33.272286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.939 [2024-11-18 16:05:33.272318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.939 [2024-11-18 16:05:33.284793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.939 [2024-11-18 16:05:33.284822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.297477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.297519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.309585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.309625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.321500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.321532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.333558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.333591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.345215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.345247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.357543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.357575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.369830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.369859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.382059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.382092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.394556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.394589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.407257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.407289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.419578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.419617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.432308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.432340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.444474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.444505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.456696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.456738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.469099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.469132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.481350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.481382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.493372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.493404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.505333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.505365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:09.940 [2024-11-18 16:05:33.517631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:09.940 [2024-11-18 16:05:33.517680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.198 [2024-11-18 16:05:33.529716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.198 [2024-11-18 16:05:33.529757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.198 [2024-11-18 16:05:33.541846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.198 [2024-11-18 16:05:33.541874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.198 [2024-11-18 16:05:33.553790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.198 [2024-11-18 16:05:33.553819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.198 [2024-11-18 16:05:33.565968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.198 [2024-11-18 16:05:33.566000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.198 [2024-11-18 16:05:33.577910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.198 [2024-11-18 16:05:33.577942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.198 [2024-11-18 16:05:33.589937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.198 [2024-11-18 16:05:33.589983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.198 [2024-11-18 16:05:33.602218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.198 [2024-11-18 16:05:33.602250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.198 [2024-11-18 16:05:33.614518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.198 [2024-11-18 16:05:33.614550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.198 [2024-11-18 16:05:33.626707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.198 [2024-11-18 16:05:33.626736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.638763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.638793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.651069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.651101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.662717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.662747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.674938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.674970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.686982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.687014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.701439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.701470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.713067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.713099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.725303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.725335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.737990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.738022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.750125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.750156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.762509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.762550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.773994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.774026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.199 [2024-11-18 16:05:33.786475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.199 [2024-11-18 16:05:33.786520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.799286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.799318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.812036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.812067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.824530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.824562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.836268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.836300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.848318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.848350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.860528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.860560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.872922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.872954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.885001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.885032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.897457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.897488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.909563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.909595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.921725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.921757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.933756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.933787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.946048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.946080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.957928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.957960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.969773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.969804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.981685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.981716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:33.993602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:33.993643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:34.005493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:34.005524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:34.017807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:34.017838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:34.029716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:34.029759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.457 [2024-11-18 16:05:34.041737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.457 [2024-11-18 16:05:34.041768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.054018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.054051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.065995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.066027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.078137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.078168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.090108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.090140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.103246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.103277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.115988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.116020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.128730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.128762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.140989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.141021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.152914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.152946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.165037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.165070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.177197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.177229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.189600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.189640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.201622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.201659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.213563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.213595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.225927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.225958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.237888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.237930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.250057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.250089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.262651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.262684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.274952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.274984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.287171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.287204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.716 [2024-11-18 16:05:34.299665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.716 [2024-11-18 16:05:34.299697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.311900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.311932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.324303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.324335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.336692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.336724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.348928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.348960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.360971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.361003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.373172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.373204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.385241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.385274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.397551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.397583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.409159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.409190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.421453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.421485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.433469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.433501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.445273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.445305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.457239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.457271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.469059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.469091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.480823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.480855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.493081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.493114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.505050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.505081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.517680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.517713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.529463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.529496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.541328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.541361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.552880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.552912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:10.975 [2024-11-18 16:05:34.564820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:10.975 [2024-11-18 16:05:34.564852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.576638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.576670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.588676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.588707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.600883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.600915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.612491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.612523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.624430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.624462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.636447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.636479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.648901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.648934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.661288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.661321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.673847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.673890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.686356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.686389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.698456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.698488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.710686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.710719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.722839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.722871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.734759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.734793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.746539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.746570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.758571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.758603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.770279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.770311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.782171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.782203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.796108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.796139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.807202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.807241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.235 [2024-11-18 16:05:34.819424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.235 [2024-11-18 16:05:34.819456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.831859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.831893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.843966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.843997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.856690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.856731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.869118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.869150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.881288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.881321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.893318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.893351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.905725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.905767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.918177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.918209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.930358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.930390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.942115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.942146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.953967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.954000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.966251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.966284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.978566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.978598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:34.990706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:34.990738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:35.002751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:35.002783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:35.014937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:35.014969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:35.027224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:35.027256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:35.038932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:35.038965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:35.051113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:35.051146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:35.063640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:35.063672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.494 [2024-11-18 16:05:35.075906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.494 [2024-11-18 16:05:35.075939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.088393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.088426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.101012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.101044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.113408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.113440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.125242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.125274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.137191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.137232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.151058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.151090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.162889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.162921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.174541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.174573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.186523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.186555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.198509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.198541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.210691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.210723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.223436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.223467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.235777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.235809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.248017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.248048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.260391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.260423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.272731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.272762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.284860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.284901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.296748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.296780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.309098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.309130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.321800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.321832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:11.753 [2024-11-18 16:05:35.334435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:11.753 [2024-11-18 16:05:35.334467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.011 [2024-11-18 16:05:35.346600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.011 [2024-11-18 16:05:35.346642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.011 [2024-11-18 16:05:35.358852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.011 [2024-11-18 16:05:35.358884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.011 [2024-11-18 16:05:35.370670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.370711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.383001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.383034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.395569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.395614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.407307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.407338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.419020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.419052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.431217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.431248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.443147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.443178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.454727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.454758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.466392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.466423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.479075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.479107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.490983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.491015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.502787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.502818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.514731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.514762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.526543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.526574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.538701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.538732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.550202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.550233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.562327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.562359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.574715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.574746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.586994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.587025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.012 [2024-11-18 16:05:35.598562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.012 [2024-11-18 16:05:35.598601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.612445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.612477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.624013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.624044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.636180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.636211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.648295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.648326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.660007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.660039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.672860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.672892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.685782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.685813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.698262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.698294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.709924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.709956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.721779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.721811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.734219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.734251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.746262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.746294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.758657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.758689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.770955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.770986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.783089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.783122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.795033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.795065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.807311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.807343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.819241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.819273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.270 [2024-11-18 16:05:35.831557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.270 [2024-11-18 16:05:35.831588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.271 [2024-11-18 16:05:35.844460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.271 [2024-11-18 16:05:35.844493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.271 [2024-11-18 16:05:35.857164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.271 [2024-11-18 16:05:35.857195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.867849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.867893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 00:19:12.529 Latency(us) 00:19:12.529 [2024-11-18T15:05:36.120Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:12.529 [2024-11-18T15:05:36.120Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:12.529 Nvme1n1 : 5.01 10411.28 81.34 0.00 0.00 12276.74 5437.06 20777.34 00:19:12.529 [2024-11-18T15:05:36.120Z] =================================================================================================================== 00:19:12.529 [2024-11-18T15:05:36.120Z] Total : 10411.28 81.34 0.00 0.00 12276.74 5437.06 20777.34 00:19:12.529 [2024-11-18 16:05:35.873620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.873658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.881637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.881666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.889676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.889716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.897728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.897779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.905748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.905799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.913781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.913831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.921789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.921838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.929821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.929873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.937837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.937883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.945855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.945904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.953885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.953936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.961929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.961986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.969921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.969984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.977945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.977996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.985971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.986022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:35.993994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:35.994045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:36.002016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:36.002066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.529 [2024-11-18 16:05:36.010013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.529 [2024-11-18 16:05:36.010050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 [2024-11-18 16:05:36.018013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.530 [2024-11-18 16:05:36.018041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 [2024-11-18 16:05:36.026076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.530 [2024-11-18 16:05:36.026124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 [2024-11-18 16:05:36.034105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.530 [2024-11-18 16:05:36.034153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 [2024-11-18 16:05:36.046158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.530 [2024-11-18 16:05:36.046216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 [2024-11-18 16:05:36.054116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.530 [2024-11-18 16:05:36.054144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 [2024-11-18 16:05:36.062178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.530 [2024-11-18 16:05:36.062225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 [2024-11-18 16:05:36.070202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.530 [2024-11-18 16:05:36.070252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 [2024-11-18 16:05:36.078224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.530 [2024-11-18 16:05:36.078273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 [2024-11-18 16:05:36.086196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.530 [2024-11-18 16:05:36.086221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 [2024-11-18 16:05:36.094219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.530 [2024-11-18 16:05:36.094243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 [2024-11-18 16:05:36.102242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:12.530 [2024-11-18 16:05:36.102267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:12.530 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1593620) - No such process 00:19:12.530 16:05:36 -- target/zcopy.sh@49 -- # wait 1593620 00:19:12.530 16:05:36 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:12.530 16:05:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:12.530 16:05:36 -- common/autotest_common.sh@10 -- # set +x 00:19:12.530 16:05:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:12.530 16:05:36 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:12.530 16:05:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:12.530 16:05:36 -- common/autotest_common.sh@10 -- # set +x 00:19:12.788 delay0 00:19:12.788 16:05:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:12.788 16:05:36 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:12.788 16:05:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:12.788 16:05:36 -- common/autotest_common.sh@10 -- # set +x 00:19:12.788 16:05:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:12.788 16:05:36 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:12.788 EAL: No free 2048 kB hugepages reported on node 1 00:19:12.788 [2024-11-18 16:05:36.259725] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:19.342 Initializing NVMe Controllers 00:19:19.342 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:19.342 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:19.342 Initialization complete. Launching workers. 00:19:19.342 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 2690 00:19:19.342 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 2977, failed to submit 33 00:19:19.342 success 2814, unsuccess 163, failed 0 00:19:19.342 16:05:42 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:19.342 16:05:42 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:19.342 16:05:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:19.342 16:05:42 -- nvmf/common.sh@116 -- # sync 00:19:19.342 16:05:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:19.342 16:05:42 -- nvmf/common.sh@119 -- # set +e 00:19:19.342 16:05:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:19.342 16:05:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:19.342 rmmod nvme_tcp 00:19:19.342 rmmod nvme_fabrics 00:19:19.342 rmmod nvme_keyring 00:19:19.342 16:05:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:19.342 16:05:42 -- nvmf/common.sh@123 -- # set -e 00:19:19.342 16:05:42 -- nvmf/common.sh@124 -- # return 0 00:19:19.342 16:05:42 -- nvmf/common.sh@477 -- # '[' -n 1592122 ']' 00:19:19.342 16:05:42 -- nvmf/common.sh@478 -- # killprocess 1592122 00:19:19.342 16:05:42 -- common/autotest_common.sh@936 -- # '[' -z 1592122 ']' 00:19:19.342 16:05:42 -- common/autotest_common.sh@940 -- # kill -0 1592122 00:19:19.342 16:05:42 -- common/autotest_common.sh@941 -- # uname 00:19:19.342 16:05:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:19.342 16:05:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1592122 00:19:19.342 16:05:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:19.342 16:05:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:19.342 16:05:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1592122' 00:19:19.342 killing process with pid 1592122 00:19:19.342 16:05:42 -- common/autotest_common.sh@955 -- # kill 1592122 00:19:19.342 16:05:42 -- common/autotest_common.sh@960 -- # wait 1592122 00:19:19.342 16:05:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:19.342 16:05:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:19.342 16:05:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:19.342 16:05:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:19.342 16:05:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:19.342 16:05:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:19.342 16:05:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:19.343 16:05:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:21.873 16:05:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:21.873 00:19:21.873 real 0m29.012s 00:19:21.873 user 0m41.908s 00:19:21.873 sys 0m8.604s 00:19:21.873 16:05:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:21.873 16:05:44 -- common/autotest_common.sh@10 -- # set +x 00:19:21.873 ************************************ 00:19:21.873 END TEST nvmf_zcopy 00:19:21.873 ************************************ 00:19:21.873 16:05:44 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:21.873 16:05:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:21.873 16:05:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:21.873 16:05:44 -- common/autotest_common.sh@10 -- # set +x 00:19:21.873 ************************************ 00:19:21.873 START TEST nvmf_nmic 00:19:21.874 ************************************ 00:19:21.874 16:05:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:21.874 * Looking for test storage... 00:19:21.874 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:21.874 16:05:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:21.874 16:05:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:21.874 16:05:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:21.874 16:05:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:21.874 16:05:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:21.874 16:05:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:21.874 16:05:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:21.874 16:05:45 -- scripts/common.sh@335 -- # IFS=.-: 00:19:21.874 16:05:45 -- scripts/common.sh@335 -- # read -ra ver1 00:19:21.874 16:05:45 -- scripts/common.sh@336 -- # IFS=.-: 00:19:21.874 16:05:45 -- scripts/common.sh@336 -- # read -ra ver2 00:19:21.874 16:05:45 -- scripts/common.sh@337 -- # local 'op=<' 00:19:21.874 16:05:45 -- scripts/common.sh@339 -- # ver1_l=2 00:19:21.874 16:05:45 -- scripts/common.sh@340 -- # ver2_l=1 00:19:21.874 16:05:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:21.874 16:05:45 -- scripts/common.sh@343 -- # case "$op" in 00:19:21.874 16:05:45 -- scripts/common.sh@344 -- # : 1 00:19:21.874 16:05:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:21.874 16:05:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:21.874 16:05:45 -- scripts/common.sh@364 -- # decimal 1 00:19:21.874 16:05:45 -- scripts/common.sh@352 -- # local d=1 00:19:21.874 16:05:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:21.874 16:05:45 -- scripts/common.sh@354 -- # echo 1 00:19:21.874 16:05:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:21.874 16:05:45 -- scripts/common.sh@365 -- # decimal 2 00:19:21.874 16:05:45 -- scripts/common.sh@352 -- # local d=2 00:19:21.874 16:05:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:21.874 16:05:45 -- scripts/common.sh@354 -- # echo 2 00:19:21.874 16:05:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:21.874 16:05:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:21.874 16:05:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:21.874 16:05:45 -- scripts/common.sh@367 -- # return 0 00:19:21.874 16:05:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:21.874 16:05:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:21.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.874 --rc genhtml_branch_coverage=1 00:19:21.874 --rc genhtml_function_coverage=1 00:19:21.874 --rc genhtml_legend=1 00:19:21.874 --rc geninfo_all_blocks=1 00:19:21.874 --rc geninfo_unexecuted_blocks=1 00:19:21.874 00:19:21.874 ' 00:19:21.874 16:05:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:21.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.874 --rc genhtml_branch_coverage=1 00:19:21.874 --rc genhtml_function_coverage=1 00:19:21.874 --rc genhtml_legend=1 00:19:21.874 --rc geninfo_all_blocks=1 00:19:21.874 --rc geninfo_unexecuted_blocks=1 00:19:21.874 00:19:21.874 ' 00:19:21.874 16:05:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:21.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.874 --rc genhtml_branch_coverage=1 00:19:21.874 --rc genhtml_function_coverage=1 00:19:21.874 --rc genhtml_legend=1 00:19:21.874 --rc geninfo_all_blocks=1 00:19:21.874 --rc geninfo_unexecuted_blocks=1 00:19:21.874 00:19:21.874 ' 00:19:21.874 16:05:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:21.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.874 --rc genhtml_branch_coverage=1 00:19:21.874 --rc genhtml_function_coverage=1 00:19:21.874 --rc genhtml_legend=1 00:19:21.874 --rc geninfo_all_blocks=1 00:19:21.874 --rc geninfo_unexecuted_blocks=1 00:19:21.874 00:19:21.874 ' 00:19:21.874 16:05:45 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:21.874 16:05:45 -- nvmf/common.sh@7 -- # uname -s 00:19:21.874 16:05:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:21.874 16:05:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:21.874 16:05:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:21.874 16:05:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:21.874 16:05:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:21.874 16:05:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:21.874 16:05:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:21.874 16:05:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:21.874 16:05:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:21.874 16:05:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:21.874 16:05:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:21.874 16:05:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:21.874 16:05:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:21.874 16:05:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:21.874 16:05:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:21.874 16:05:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:21.874 16:05:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:21.874 16:05:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:21.874 16:05:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:21.874 16:05:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.874 16:05:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.874 16:05:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.874 16:05:45 -- paths/export.sh@5 -- # export PATH 00:19:21.874 16:05:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.874 16:05:45 -- nvmf/common.sh@46 -- # : 0 00:19:21.874 16:05:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:21.874 16:05:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:21.874 16:05:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:21.874 16:05:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:21.874 16:05:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:21.874 16:05:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:21.874 16:05:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:21.874 16:05:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:21.874 16:05:45 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:21.874 16:05:45 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:21.874 16:05:45 -- target/nmic.sh@14 -- # nvmftestinit 00:19:21.874 16:05:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:21.874 16:05:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:21.874 16:05:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:21.874 16:05:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:21.874 16:05:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:21.874 16:05:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:21.874 16:05:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:21.874 16:05:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:21.874 16:05:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:21.874 16:05:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:21.874 16:05:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:21.874 16:05:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.774 16:05:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:23.774 16:05:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:23.774 16:05:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:23.774 16:05:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:23.774 16:05:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:23.774 16:05:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:23.774 16:05:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:23.774 16:05:47 -- nvmf/common.sh@294 -- # net_devs=() 00:19:23.774 16:05:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:23.774 16:05:47 -- nvmf/common.sh@295 -- # e810=() 00:19:23.774 16:05:47 -- nvmf/common.sh@295 -- # local -ga e810 00:19:23.774 16:05:47 -- nvmf/common.sh@296 -- # x722=() 00:19:23.774 16:05:47 -- nvmf/common.sh@296 -- # local -ga x722 00:19:23.774 16:05:47 -- nvmf/common.sh@297 -- # mlx=() 00:19:23.774 16:05:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:23.774 16:05:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:23.774 16:05:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:23.774 16:05:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:23.774 16:05:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:23.774 16:05:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:23.774 16:05:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:23.774 16:05:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:23.774 16:05:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:23.774 16:05:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:23.774 16:05:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:23.774 16:05:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:23.774 16:05:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:23.774 16:05:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:23.774 16:05:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:23.774 16:05:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:23.774 16:05:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:23.774 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:23.774 16:05:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:23.774 16:05:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:23.774 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:23.774 16:05:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:23.774 16:05:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:23.774 16:05:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:23.774 16:05:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:23.774 16:05:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:23.774 16:05:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:23.774 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:23.774 16:05:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:23.774 16:05:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:23.774 16:05:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:23.774 16:05:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:23.774 16:05:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:23.774 16:05:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:23.774 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:23.774 16:05:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:23.774 16:05:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:23.774 16:05:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:23.774 16:05:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:23.774 16:05:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:23.774 16:05:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:23.774 16:05:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:23.774 16:05:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:23.774 16:05:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:23.774 16:05:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:23.774 16:05:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:23.774 16:05:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:23.774 16:05:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:23.774 16:05:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:23.774 16:05:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:23.774 16:05:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:23.774 16:05:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:23.774 16:05:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:23.774 16:05:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:23.774 16:05:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:23.774 16:05:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:23.774 16:05:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:24.032 16:05:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:24.032 16:05:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:24.032 16:05:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:24.032 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:24.032 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:19:24.032 00:19:24.032 --- 10.0.0.2 ping statistics --- 00:19:24.032 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:24.032 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:19:24.032 16:05:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:24.032 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:24.032 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:19:24.032 00:19:24.032 --- 10.0.0.1 ping statistics --- 00:19:24.032 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:24.032 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:19:24.032 16:05:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:24.032 16:05:47 -- nvmf/common.sh@410 -- # return 0 00:19:24.032 16:05:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:24.032 16:05:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:24.033 16:05:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:24.033 16:05:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:24.033 16:05:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:24.033 16:05:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:24.033 16:05:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:24.033 16:05:47 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:24.033 16:05:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:24.033 16:05:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:24.033 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:19:24.033 16:05:47 -- nvmf/common.sh@469 -- # nvmfpid=1597064 00:19:24.033 16:05:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:24.033 16:05:47 -- nvmf/common.sh@470 -- # waitforlisten 1597064 00:19:24.033 16:05:47 -- common/autotest_common.sh@829 -- # '[' -z 1597064 ']' 00:19:24.033 16:05:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:24.033 16:05:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:24.033 16:05:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:24.033 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:24.033 16:05:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:24.033 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:19:24.033 [2024-11-18 16:05:47.480682] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:24.033 [2024-11-18 16:05:47.480769] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:24.033 EAL: No free 2048 kB hugepages reported on node 1 00:19:24.033 [2024-11-18 16:05:47.550092] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:24.291 [2024-11-18 16:05:47.645119] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:24.291 [2024-11-18 16:05:47.645300] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:24.291 [2024-11-18 16:05:47.645324] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:24.291 [2024-11-18 16:05:47.645339] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:24.291 [2024-11-18 16:05:47.645404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:24.291 [2024-11-18 16:05:47.645931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:24.291 [2024-11-18 16:05:47.646247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:24.291 [2024-11-18 16:05:47.646252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:25.225 16:05:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:25.225 16:05:48 -- common/autotest_common.sh@862 -- # return 0 00:19:25.225 16:05:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:25.225 16:05:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:25.225 16:05:48 -- common/autotest_common.sh@10 -- # set +x 00:19:25.225 16:05:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:25.225 16:05:48 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:25.225 16:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:25.225 16:05:48 -- common/autotest_common.sh@10 -- # set +x 00:19:25.225 [2024-11-18 16:05:48.479307] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:25.225 16:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:25.225 16:05:48 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:25.225 16:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:25.225 16:05:48 -- common/autotest_common.sh@10 -- # set +x 00:19:25.225 Malloc0 00:19:25.225 16:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:25.225 16:05:48 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:25.225 16:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:25.225 16:05:48 -- common/autotest_common.sh@10 -- # set +x 00:19:25.225 16:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:25.225 16:05:48 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:25.225 16:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:25.225 16:05:48 -- common/autotest_common.sh@10 -- # set +x 00:19:25.225 16:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:25.225 16:05:48 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:25.225 16:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:25.225 16:05:48 -- common/autotest_common.sh@10 -- # set +x 00:19:25.225 [2024-11-18 16:05:48.532870] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:25.225 16:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:25.225 16:05:48 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:25.225 test case1: single bdev can't be used in multiple subsystems 00:19:25.225 16:05:48 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:25.225 16:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:25.225 16:05:48 -- common/autotest_common.sh@10 -- # set +x 00:19:25.225 16:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:25.225 16:05:48 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:25.225 16:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:25.225 16:05:48 -- common/autotest_common.sh@10 -- # set +x 00:19:25.225 16:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:25.225 16:05:48 -- target/nmic.sh@28 -- # nmic_status=0 00:19:25.225 16:05:48 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:25.225 16:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:25.225 16:05:48 -- common/autotest_common.sh@10 -- # set +x 00:19:25.225 [2024-11-18 16:05:48.556686] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:25.225 [2024-11-18 16:05:48.556717] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:25.225 [2024-11-18 16:05:48.556733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:25.225 request: 00:19:25.225 { 00:19:25.225 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:25.225 "namespace": { 00:19:25.225 "bdev_name": "Malloc0" 00:19:25.225 }, 00:19:25.225 "method": "nvmf_subsystem_add_ns", 00:19:25.225 "req_id": 1 00:19:25.225 } 00:19:25.225 Got JSON-RPC error response 00:19:25.225 response: 00:19:25.225 { 00:19:25.225 "code": -32602, 00:19:25.225 "message": "Invalid parameters" 00:19:25.225 } 00:19:25.225 16:05:48 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:25.225 16:05:48 -- target/nmic.sh@29 -- # nmic_status=1 00:19:25.225 16:05:48 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:25.225 16:05:48 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:25.225 Adding namespace failed - expected result. 00:19:25.225 16:05:48 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:25.225 test case2: host connect to nvmf target in multiple paths 00:19:25.225 16:05:48 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:25.225 16:05:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:25.225 16:05:48 -- common/autotest_common.sh@10 -- # set +x 00:19:25.225 [2024-11-18 16:05:48.564818] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:25.225 16:05:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:25.225 16:05:48 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:25.807 16:05:49 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:26.373 16:05:49 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:26.373 16:05:49 -- common/autotest_common.sh@1187 -- # local i=0 00:19:26.373 16:05:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:26.373 16:05:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:26.373 16:05:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:28.901 16:05:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:28.901 16:05:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:28.901 16:05:51 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:28.901 16:05:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:28.901 16:05:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:28.901 16:05:51 -- common/autotest_common.sh@1197 -- # return 0 00:19:28.901 16:05:51 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:28.901 [global] 00:19:28.901 thread=1 00:19:28.901 invalidate=1 00:19:28.901 rw=write 00:19:28.901 time_based=1 00:19:28.901 runtime=1 00:19:28.901 ioengine=libaio 00:19:28.901 direct=1 00:19:28.901 bs=4096 00:19:28.901 iodepth=1 00:19:28.901 norandommap=0 00:19:28.901 numjobs=1 00:19:28.901 00:19:28.901 verify_dump=1 00:19:28.901 verify_backlog=512 00:19:28.901 verify_state_save=0 00:19:28.901 do_verify=1 00:19:28.901 verify=crc32c-intel 00:19:28.901 [job0] 00:19:28.901 filename=/dev/nvme0n1 00:19:28.901 Could not set queue depth (nvme0n1) 00:19:28.901 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:28.901 fio-3.35 00:19:28.901 Starting 1 thread 00:19:29.835 00:19:29.835 job0: (groupid=0, jobs=1): err= 0: pid=1597729: Mon Nov 18 16:05:53 2024 00:19:29.835 read: IOPS=22, BW=89.3KiB/s (91.5kB/s)(92.0KiB/1030msec) 00:19:29.835 slat (nsec): min=6241, max=33402, avg=20011.83, stdev=9215.46 00:19:29.835 clat (usec): min=40906, max=41325, avg=40985.94, stdev=81.76 00:19:29.835 lat (usec): min=40939, max=41331, avg=41005.95, stdev=77.73 00:19:29.835 clat percentiles (usec): 00:19:29.835 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:29.835 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:29.835 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:29.835 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:29.835 | 99.99th=[41157] 00:19:29.835 write: IOPS=497, BW=1988KiB/s (2036kB/s)(2048KiB/1030msec); 0 zone resets 00:19:29.835 slat (usec): min=5, max=834, avg=11.58, stdev=37.23 00:19:29.835 clat (usec): min=121, max=355, avg=155.36, stdev=30.36 00:19:29.835 lat (usec): min=127, max=1028, avg=166.95, stdev=50.72 00:19:29.835 clat percentiles (usec): 00:19:29.835 | 1.00th=[ 124], 5.00th=[ 130], 10.00th=[ 133], 20.00th=[ 137], 00:19:29.835 | 30.00th=[ 139], 40.00th=[ 143], 50.00th=[ 147], 60.00th=[ 151], 00:19:29.835 | 70.00th=[ 159], 80.00th=[ 167], 90.00th=[ 184], 95.00th=[ 245], 00:19:29.835 | 99.00th=[ 251], 99.50th=[ 265], 99.90th=[ 355], 99.95th=[ 355], 00:19:29.835 | 99.99th=[ 355] 00:19:29.835 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:29.835 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:29.835 lat (usec) : 250=94.21%, 500=1.50% 00:19:29.835 lat (msec) : 50=4.30% 00:19:29.835 cpu : usr=0.19%, sys=0.49%, ctx=538, majf=0, minf=1 00:19:29.835 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:29.835 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:29.835 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:29.835 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:29.835 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:29.835 00:19:29.835 Run status group 0 (all jobs): 00:19:29.835 READ: bw=89.3KiB/s (91.5kB/s), 89.3KiB/s-89.3KiB/s (91.5kB/s-91.5kB/s), io=92.0KiB (94.2kB), run=1030-1030msec 00:19:29.836 WRITE: bw=1988KiB/s (2036kB/s), 1988KiB/s-1988KiB/s (2036kB/s-2036kB/s), io=2048KiB (2097kB), run=1030-1030msec 00:19:29.836 00:19:29.836 Disk stats (read/write): 00:19:29.836 nvme0n1: ios=71/512, merge=0/0, ticks=904/74, in_queue=978, util=98.60% 00:19:29.836 16:05:53 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:29.836 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:29.836 16:05:53 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:29.836 16:05:53 -- common/autotest_common.sh@1208 -- # local i=0 00:19:29.836 16:05:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:29.836 16:05:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:29.836 16:05:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:29.836 16:05:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:29.836 16:05:53 -- common/autotest_common.sh@1220 -- # return 0 00:19:29.836 16:05:53 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:29.836 16:05:53 -- target/nmic.sh@53 -- # nvmftestfini 00:19:29.836 16:05:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:29.836 16:05:53 -- nvmf/common.sh@116 -- # sync 00:19:30.094 16:05:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:30.094 16:05:53 -- nvmf/common.sh@119 -- # set +e 00:19:30.094 16:05:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:30.094 16:05:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:30.094 rmmod nvme_tcp 00:19:30.094 rmmod nvme_fabrics 00:19:30.094 rmmod nvme_keyring 00:19:30.094 16:05:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:30.094 16:05:53 -- nvmf/common.sh@123 -- # set -e 00:19:30.094 16:05:53 -- nvmf/common.sh@124 -- # return 0 00:19:30.094 16:05:53 -- nvmf/common.sh@477 -- # '[' -n 1597064 ']' 00:19:30.094 16:05:53 -- nvmf/common.sh@478 -- # killprocess 1597064 00:19:30.094 16:05:53 -- common/autotest_common.sh@936 -- # '[' -z 1597064 ']' 00:19:30.094 16:05:53 -- common/autotest_common.sh@940 -- # kill -0 1597064 00:19:30.094 16:05:53 -- common/autotest_common.sh@941 -- # uname 00:19:30.094 16:05:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:30.094 16:05:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1597064 00:19:30.094 16:05:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:30.094 16:05:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:30.094 16:05:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1597064' 00:19:30.094 killing process with pid 1597064 00:19:30.094 16:05:53 -- common/autotest_common.sh@955 -- # kill 1597064 00:19:30.094 16:05:53 -- common/autotest_common.sh@960 -- # wait 1597064 00:19:30.352 16:05:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:30.352 16:05:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:30.352 16:05:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:30.352 16:05:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:30.352 16:05:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:30.352 16:05:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:30.352 16:05:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:30.352 16:05:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.259 16:05:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:32.259 00:19:32.259 real 0m10.843s 00:19:32.259 user 0m25.586s 00:19:32.259 sys 0m2.423s 00:19:32.259 16:05:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:32.259 16:05:55 -- common/autotest_common.sh@10 -- # set +x 00:19:32.259 ************************************ 00:19:32.259 END TEST nvmf_nmic 00:19:32.259 ************************************ 00:19:32.259 16:05:55 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:32.259 16:05:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:32.259 16:05:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:32.259 16:05:55 -- common/autotest_common.sh@10 -- # set +x 00:19:32.259 ************************************ 00:19:32.259 START TEST nvmf_fio_target 00:19:32.259 ************************************ 00:19:32.259 16:05:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:32.518 * Looking for test storage... 00:19:32.518 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:32.518 16:05:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:32.518 16:05:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:32.518 16:05:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:32.518 16:05:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:32.518 16:05:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:32.518 16:05:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:32.518 16:05:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:32.518 16:05:55 -- scripts/common.sh@335 -- # IFS=.-: 00:19:32.518 16:05:55 -- scripts/common.sh@335 -- # read -ra ver1 00:19:32.518 16:05:55 -- scripts/common.sh@336 -- # IFS=.-: 00:19:32.518 16:05:55 -- scripts/common.sh@336 -- # read -ra ver2 00:19:32.518 16:05:55 -- scripts/common.sh@337 -- # local 'op=<' 00:19:32.518 16:05:55 -- scripts/common.sh@339 -- # ver1_l=2 00:19:32.518 16:05:55 -- scripts/common.sh@340 -- # ver2_l=1 00:19:32.518 16:05:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:32.518 16:05:55 -- scripts/common.sh@343 -- # case "$op" in 00:19:32.518 16:05:55 -- scripts/common.sh@344 -- # : 1 00:19:32.518 16:05:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:32.518 16:05:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:32.518 16:05:55 -- scripts/common.sh@364 -- # decimal 1 00:19:32.518 16:05:55 -- scripts/common.sh@352 -- # local d=1 00:19:32.518 16:05:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:32.518 16:05:55 -- scripts/common.sh@354 -- # echo 1 00:19:32.518 16:05:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:32.518 16:05:55 -- scripts/common.sh@365 -- # decimal 2 00:19:32.518 16:05:55 -- scripts/common.sh@352 -- # local d=2 00:19:32.518 16:05:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:32.518 16:05:55 -- scripts/common.sh@354 -- # echo 2 00:19:32.518 16:05:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:32.518 16:05:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:32.518 16:05:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:32.518 16:05:55 -- scripts/common.sh@367 -- # return 0 00:19:32.518 16:05:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:32.518 16:05:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:32.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.518 --rc genhtml_branch_coverage=1 00:19:32.518 --rc genhtml_function_coverage=1 00:19:32.518 --rc genhtml_legend=1 00:19:32.518 --rc geninfo_all_blocks=1 00:19:32.518 --rc geninfo_unexecuted_blocks=1 00:19:32.518 00:19:32.518 ' 00:19:32.518 16:05:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:32.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.518 --rc genhtml_branch_coverage=1 00:19:32.518 --rc genhtml_function_coverage=1 00:19:32.518 --rc genhtml_legend=1 00:19:32.518 --rc geninfo_all_blocks=1 00:19:32.518 --rc geninfo_unexecuted_blocks=1 00:19:32.518 00:19:32.518 ' 00:19:32.518 16:05:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:32.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.518 --rc genhtml_branch_coverage=1 00:19:32.518 --rc genhtml_function_coverage=1 00:19:32.518 --rc genhtml_legend=1 00:19:32.518 --rc geninfo_all_blocks=1 00:19:32.518 --rc geninfo_unexecuted_blocks=1 00:19:32.518 00:19:32.518 ' 00:19:32.518 16:05:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:32.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.518 --rc genhtml_branch_coverage=1 00:19:32.518 --rc genhtml_function_coverage=1 00:19:32.518 --rc genhtml_legend=1 00:19:32.518 --rc geninfo_all_blocks=1 00:19:32.518 --rc geninfo_unexecuted_blocks=1 00:19:32.518 00:19:32.518 ' 00:19:32.518 16:05:55 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:32.518 16:05:55 -- nvmf/common.sh@7 -- # uname -s 00:19:32.518 16:05:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:32.518 16:05:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:32.518 16:05:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:32.518 16:05:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:32.518 16:05:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:32.518 16:05:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:32.518 16:05:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:32.518 16:05:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:32.518 16:05:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:32.518 16:05:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:32.518 16:05:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.518 16:05:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.518 16:05:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:32.518 16:05:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:32.518 16:05:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:32.518 16:05:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:32.518 16:05:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:32.518 16:05:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:32.518 16:05:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:32.518 16:05:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.518 16:05:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.518 16:05:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.518 16:05:55 -- paths/export.sh@5 -- # export PATH 00:19:32.518 16:05:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.518 16:05:55 -- nvmf/common.sh@46 -- # : 0 00:19:32.518 16:05:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:32.518 16:05:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:32.518 16:05:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:32.518 16:05:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:32.518 16:05:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:32.518 16:05:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:32.518 16:05:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:32.518 16:05:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:32.518 16:05:55 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:32.519 16:05:55 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:32.519 16:05:55 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:32.519 16:05:55 -- target/fio.sh@16 -- # nvmftestinit 00:19:32.519 16:05:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:32.519 16:05:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:32.519 16:05:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:32.519 16:05:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:32.519 16:05:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:32.519 16:05:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:32.519 16:05:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:32.519 16:05:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.519 16:05:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:32.519 16:05:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:32.519 16:05:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:32.519 16:05:56 -- common/autotest_common.sh@10 -- # set +x 00:19:35.127 16:05:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:35.127 16:05:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:35.127 16:05:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:35.127 16:05:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:35.127 16:05:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:35.127 16:05:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:35.127 16:05:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:35.127 16:05:58 -- nvmf/common.sh@294 -- # net_devs=() 00:19:35.127 16:05:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:35.127 16:05:58 -- nvmf/common.sh@295 -- # e810=() 00:19:35.127 16:05:58 -- nvmf/common.sh@295 -- # local -ga e810 00:19:35.127 16:05:58 -- nvmf/common.sh@296 -- # x722=() 00:19:35.127 16:05:58 -- nvmf/common.sh@296 -- # local -ga x722 00:19:35.127 16:05:58 -- nvmf/common.sh@297 -- # mlx=() 00:19:35.127 16:05:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:35.127 16:05:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:35.127 16:05:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:35.127 16:05:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:35.127 16:05:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:35.127 16:05:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:35.127 16:05:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:35.127 16:05:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:35.127 16:05:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:35.127 16:05:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:35.127 16:05:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:35.127 16:05:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:35.127 16:05:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:35.127 16:05:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:35.127 16:05:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:35.127 16:05:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:35.127 16:05:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:35.127 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:35.127 16:05:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:35.127 16:05:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:35.127 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:35.127 16:05:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:35.127 16:05:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:35.127 16:05:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:35.127 16:05:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:35.127 16:05:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:35.127 16:05:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:35.127 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:35.127 16:05:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:35.127 16:05:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:35.127 16:05:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:35.127 16:05:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:35.127 16:05:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:35.127 16:05:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:35.127 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:35.127 16:05:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:35.127 16:05:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:35.127 16:05:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:35.127 16:05:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:35.127 16:05:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:35.127 16:05:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:35.127 16:05:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:35.127 16:05:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:35.127 16:05:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:35.127 16:05:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:35.127 16:05:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:35.127 16:05:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:35.127 16:05:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:35.127 16:05:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:35.127 16:05:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:35.127 16:05:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:35.127 16:05:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:35.127 16:05:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:35.127 16:05:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:35.127 16:05:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:35.127 16:05:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:35.127 16:05:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:35.127 16:05:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:35.127 16:05:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:35.127 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:35.127 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.301 ms 00:19:35.127 00:19:35.127 --- 10.0.0.2 ping statistics --- 00:19:35.127 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:35.127 rtt min/avg/max/mdev = 0.301/0.301/0.301/0.000 ms 00:19:35.127 16:05:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:35.127 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:35.127 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.164 ms 00:19:35.127 00:19:35.127 --- 10.0.0.1 ping statistics --- 00:19:35.127 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:35.127 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:19:35.127 16:05:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:35.127 16:05:58 -- nvmf/common.sh@410 -- # return 0 00:19:35.127 16:05:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:35.127 16:05:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:35.127 16:05:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:35.127 16:05:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:35.127 16:05:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:35.127 16:05:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:35.127 16:05:58 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:35.127 16:05:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:35.127 16:05:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:35.127 16:05:58 -- common/autotest_common.sh@10 -- # set +x 00:19:35.127 16:05:58 -- nvmf/common.sh@469 -- # nvmfpid=1599833 00:19:35.127 16:05:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:35.127 16:05:58 -- nvmf/common.sh@470 -- # waitforlisten 1599833 00:19:35.127 16:05:58 -- common/autotest_common.sh@829 -- # '[' -z 1599833 ']' 00:19:35.127 16:05:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:35.127 16:05:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:35.127 16:05:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:35.127 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:35.127 16:05:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:35.127 16:05:58 -- common/autotest_common.sh@10 -- # set +x 00:19:35.127 [2024-11-18 16:05:58.494800] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:35.127 [2024-11-18 16:05:58.494886] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:35.127 EAL: No free 2048 kB hugepages reported on node 1 00:19:35.127 [2024-11-18 16:05:58.561051] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:35.127 [2024-11-18 16:05:58.649074] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:35.127 [2024-11-18 16:05:58.649235] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:35.127 [2024-11-18 16:05:58.649268] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:35.127 [2024-11-18 16:05:58.649281] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:35.128 [2024-11-18 16:05:58.649348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:35.128 [2024-11-18 16:05:58.649402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:35.128 [2024-11-18 16:05:58.649451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:35.128 [2024-11-18 16:05:58.649453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:36.061 16:05:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:36.061 16:05:59 -- common/autotest_common.sh@862 -- # return 0 00:19:36.061 16:05:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:36.061 16:05:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:36.061 16:05:59 -- common/autotest_common.sh@10 -- # set +x 00:19:36.061 16:05:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:36.061 16:05:59 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:36.319 [2024-11-18 16:05:59.761269] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:36.319 16:05:59 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:36.578 16:06:00 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:36.578 16:06:00 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:36.836 16:06:00 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:36.836 16:06:00 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:37.094 16:06:00 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:37.094 16:06:00 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:37.660 16:06:00 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:37.660 16:06:00 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:37.660 16:06:01 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:38.226 16:06:01 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:38.226 16:06:01 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:38.226 16:06:01 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:38.226 16:06:01 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:38.791 16:06:02 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:38.791 16:06:02 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:38.791 16:06:02 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:39.049 16:06:02 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:39.049 16:06:02 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:39.307 16:06:02 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:39.307 16:06:02 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:39.564 16:06:03 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:39.822 [2024-11-18 16:06:03.396306] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:40.081 16:06:03 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:40.081 16:06:03 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:40.338 16:06:03 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:41.271 16:06:04 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:41.272 16:06:04 -- common/autotest_common.sh@1187 -- # local i=0 00:19:41.272 16:06:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:41.272 16:06:04 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:41.272 16:06:04 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:41.272 16:06:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:43.169 16:06:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:43.169 16:06:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:43.169 16:06:06 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:43.169 16:06:06 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:43.169 16:06:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:43.169 16:06:06 -- common/autotest_common.sh@1197 -- # return 0 00:19:43.169 16:06:06 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:43.169 [global] 00:19:43.169 thread=1 00:19:43.169 invalidate=1 00:19:43.169 rw=write 00:19:43.169 time_based=1 00:19:43.169 runtime=1 00:19:43.169 ioengine=libaio 00:19:43.169 direct=1 00:19:43.169 bs=4096 00:19:43.169 iodepth=1 00:19:43.169 norandommap=0 00:19:43.169 numjobs=1 00:19:43.169 00:19:43.169 verify_dump=1 00:19:43.169 verify_backlog=512 00:19:43.169 verify_state_save=0 00:19:43.169 do_verify=1 00:19:43.169 verify=crc32c-intel 00:19:43.169 [job0] 00:19:43.169 filename=/dev/nvme0n1 00:19:43.169 [job1] 00:19:43.169 filename=/dev/nvme0n2 00:19:43.169 [job2] 00:19:43.169 filename=/dev/nvme0n3 00:19:43.169 [job3] 00:19:43.169 filename=/dev/nvme0n4 00:19:43.169 Could not set queue depth (nvme0n1) 00:19:43.169 Could not set queue depth (nvme0n2) 00:19:43.169 Could not set queue depth (nvme0n3) 00:19:43.169 Could not set queue depth (nvme0n4) 00:19:43.169 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:43.169 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:43.169 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:43.169 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:43.169 fio-3.35 00:19:43.169 Starting 4 threads 00:19:44.544 00:19:44.544 job0: (groupid=0, jobs=1): err= 0: pid=1601182: Mon Nov 18 16:06:07 2024 00:19:44.544 read: IOPS=1959, BW=7836KiB/s (8024kB/s)(7844KiB/1001msec) 00:19:44.544 slat (nsec): min=5822, max=52399, avg=9402.91, stdev=4754.63 00:19:44.544 clat (usec): min=185, max=2983, avg=266.38, stdev=109.87 00:19:44.544 lat (usec): min=193, max=2992, avg=275.78, stdev=110.57 00:19:44.544 clat percentiles (usec): 00:19:44.544 | 1.00th=[ 200], 5.00th=[ 212], 10.00th=[ 221], 20.00th=[ 229], 00:19:44.544 | 30.00th=[ 235], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 255], 00:19:44.544 | 70.00th=[ 262], 80.00th=[ 273], 90.00th=[ 297], 95.00th=[ 449], 00:19:44.544 | 99.00th=[ 529], 99.50th=[ 562], 99.90th=[ 2835], 99.95th=[ 2999], 00:19:44.544 | 99.99th=[ 2999] 00:19:44.544 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:44.544 slat (usec): min=7, max=41325, avg=32.94, stdev=912.92 00:19:44.544 clat (usec): min=135, max=445, avg=184.97, stdev=23.32 00:19:44.544 lat (usec): min=145, max=41704, avg=217.91, stdev=917.51 00:19:44.544 clat percentiles (usec): 00:19:44.544 | 1.00th=[ 147], 5.00th=[ 155], 10.00th=[ 161], 20.00th=[ 167], 00:19:44.544 | 30.00th=[ 174], 40.00th=[ 178], 50.00th=[ 182], 60.00th=[ 188], 00:19:44.544 | 70.00th=[ 194], 80.00th=[ 200], 90.00th=[ 212], 95.00th=[ 221], 00:19:44.544 | 99.00th=[ 255], 99.50th=[ 269], 99.90th=[ 379], 99.95th=[ 420], 00:19:44.544 | 99.99th=[ 445] 00:19:44.544 bw ( KiB/s): min= 8192, max= 8192, per=28.81%, avg=8192.00, stdev= 0.00, samples=1 00:19:44.544 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:44.544 lat (usec) : 250=77.38%, 500=21.73%, 750=0.77%, 1000=0.05% 00:19:44.544 lat (msec) : 2=0.02%, 4=0.05% 00:19:44.544 cpu : usr=2.60%, sys=6.70%, ctx=4012, majf=0, minf=1 00:19:44.544 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:44.544 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:44.544 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:44.544 issued rwts: total=1961,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:44.544 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:44.544 job1: (groupid=0, jobs=1): err= 0: pid=1601183: Mon Nov 18 16:06:07 2024 00:19:44.544 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:19:44.544 slat (nsec): min=6088, max=52132, avg=8938.79, stdev=3907.58 00:19:44.544 clat (usec): min=175, max=41327, avg=254.97, stdev=909.94 00:19:44.544 lat (usec): min=182, max=41348, avg=263.91, stdev=910.28 00:19:44.544 clat percentiles (usec): 00:19:44.544 | 1.00th=[ 188], 5.00th=[ 196], 10.00th=[ 200], 20.00th=[ 204], 00:19:44.544 | 30.00th=[ 208], 40.00th=[ 215], 50.00th=[ 219], 60.00th=[ 223], 00:19:44.544 | 70.00th=[ 233], 80.00th=[ 260], 90.00th=[ 302], 95.00th=[ 326], 00:19:44.544 | 99.00th=[ 396], 99.50th=[ 424], 99.90th=[ 922], 99.95th=[ 1680], 00:19:44.544 | 99.99th=[41157] 00:19:44.544 write: IOPS=2149, BW=8599KiB/s (8806kB/s)(8608KiB/1001msec); 0 zone resets 00:19:44.544 slat (nsec): min=7731, max=59248, avg=11653.09, stdev=5046.94 00:19:44.544 clat (usec): min=136, max=4163, avg=195.93, stdev=95.29 00:19:44.544 lat (usec): min=145, max=4172, avg=207.58, stdev=95.48 00:19:44.544 clat percentiles (usec): 00:19:44.544 | 1.00th=[ 143], 5.00th=[ 149], 10.00th=[ 153], 20.00th=[ 159], 00:19:44.544 | 30.00th=[ 167], 40.00th=[ 176], 50.00th=[ 186], 60.00th=[ 194], 00:19:44.544 | 70.00th=[ 204], 80.00th=[ 221], 90.00th=[ 258], 95.00th=[ 281], 00:19:44.544 | 99.00th=[ 314], 99.50th=[ 326], 99.90th=[ 545], 99.95th=[ 545], 00:19:44.544 | 99.99th=[ 4178] 00:19:44.544 bw ( KiB/s): min= 8192, max= 8192, per=28.81%, avg=8192.00, stdev= 0.00, samples=1 00:19:44.544 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:44.544 lat (usec) : 250=83.67%, 500=16.14%, 750=0.05%, 1000=0.07% 00:19:44.544 lat (msec) : 2=0.02%, 10=0.02%, 50=0.02% 00:19:44.544 cpu : usr=4.40%, sys=4.70%, ctx=4202, majf=0, minf=1 00:19:44.544 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:44.544 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:44.544 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:44.544 issued rwts: total=2048,2152,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:44.544 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:44.544 job2: (groupid=0, jobs=1): err= 0: pid=1601185: Mon Nov 18 16:06:07 2024 00:19:44.544 read: IOPS=1867, BW=7469KiB/s (7648kB/s)(7476KiB/1001msec) 00:19:44.544 slat (nsec): min=6079, max=51025, avg=9293.04, stdev=4502.46 00:19:44.544 clat (usec): min=204, max=2836, avg=276.04, stdev=79.06 00:19:44.544 lat (usec): min=213, max=2850, avg=285.33, stdev=79.67 00:19:44.544 clat percentiles (usec): 00:19:44.544 | 1.00th=[ 221], 5.00th=[ 231], 10.00th=[ 237], 20.00th=[ 243], 00:19:44.544 | 30.00th=[ 249], 40.00th=[ 253], 50.00th=[ 262], 60.00th=[ 273], 00:19:44.544 | 70.00th=[ 289], 80.00th=[ 302], 90.00th=[ 314], 95.00th=[ 330], 00:19:44.544 | 99.00th=[ 465], 99.50th=[ 510], 99.90th=[ 1156], 99.95th=[ 2835], 00:19:44.544 | 99.99th=[ 2835] 00:19:44.544 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:44.544 slat (nsec): min=7253, max=60896, avg=12280.92, stdev=5553.12 00:19:44.544 clat (usec): min=151, max=3999, avg=209.91, stdev=99.69 00:19:44.544 lat (usec): min=159, max=4009, avg=222.20, stdev=100.14 00:19:44.544 clat percentiles (usec): 00:19:44.544 | 1.00th=[ 159], 5.00th=[ 165], 10.00th=[ 172], 20.00th=[ 178], 00:19:44.544 | 30.00th=[ 182], 40.00th=[ 188], 50.00th=[ 198], 60.00th=[ 204], 00:19:44.544 | 70.00th=[ 212], 80.00th=[ 227], 90.00th=[ 258], 95.00th=[ 289], 00:19:44.544 | 99.00th=[ 388], 99.50th=[ 523], 99.90th=[ 840], 99.95th=[ 1172], 00:19:44.544 | 99.99th=[ 4015] 00:19:44.544 bw ( KiB/s): min= 8192, max= 8192, per=28.81%, avg=8192.00, stdev= 0.00, samples=1 00:19:44.544 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:44.544 lat (usec) : 250=62.24%, 500=37.22%, 750=0.31%, 1000=0.13% 00:19:44.544 lat (msec) : 2=0.05%, 4=0.05% 00:19:44.544 cpu : usr=3.50%, sys=5.40%, ctx=3917, majf=0, minf=1 00:19:44.544 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:44.544 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:44.544 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:44.544 issued rwts: total=1869,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:44.544 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:44.544 job3: (groupid=0, jobs=1): err= 0: pid=1601186: Mon Nov 18 16:06:07 2024 00:19:44.544 read: IOPS=514, BW=2057KiB/s (2106kB/s)(2104KiB/1023msec) 00:19:44.544 slat (nsec): min=5815, max=34173, avg=12587.84, stdev=5519.69 00:19:44.544 clat (usec): min=214, max=42008, avg=1448.76, stdev=6579.42 00:19:44.544 lat (usec): min=222, max=42022, avg=1461.34, stdev=6579.58 00:19:44.544 clat percentiles (usec): 00:19:44.544 | 1.00th=[ 235], 5.00th=[ 243], 10.00th=[ 251], 20.00th=[ 269], 00:19:44.544 | 30.00th=[ 302], 40.00th=[ 314], 50.00th=[ 322], 60.00th=[ 400], 00:19:44.544 | 70.00th=[ 420], 80.00th=[ 457], 90.00th=[ 486], 95.00th=[ 510], 00:19:44.544 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:19:44.544 | 99.99th=[42206] 00:19:44.544 write: IOPS=1000, BW=4004KiB/s (4100kB/s)(4096KiB/1023msec); 0 zone resets 00:19:44.544 slat (nsec): min=6157, max=53344, avg=12801.69, stdev=5978.86 00:19:44.544 clat (usec): min=150, max=630, avg=230.41, stdev=46.42 00:19:44.544 lat (usec): min=161, max=641, avg=243.21, stdev=45.71 00:19:44.544 clat percentiles (usec): 00:19:44.544 | 1.00th=[ 161], 5.00th=[ 180], 10.00th=[ 186], 20.00th=[ 194], 00:19:44.544 | 30.00th=[ 200], 40.00th=[ 206], 50.00th=[ 219], 60.00th=[ 231], 00:19:44.544 | 70.00th=[ 245], 80.00th=[ 273], 90.00th=[ 293], 95.00th=[ 314], 00:19:44.544 | 99.00th=[ 355], 99.50th=[ 396], 99.90th=[ 420], 99.95th=[ 635], 00:19:44.544 | 99.99th=[ 635] 00:19:44.544 bw ( KiB/s): min= 8192, max= 8192, per=28.81%, avg=8192.00, stdev= 0.00, samples=1 00:19:44.544 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:44.544 lat (usec) : 250=50.84%, 500=46.71%, 750=1.48% 00:19:44.544 lat (msec) : 10=0.06%, 50=0.90% 00:19:44.544 cpu : usr=1.86%, sys=2.05%, ctx=1550, majf=0, minf=2 00:19:44.544 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:44.544 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:44.544 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:44.544 issued rwts: total=526,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:44.544 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:44.544 00:19:44.544 Run status group 0 (all jobs): 00:19:44.544 READ: bw=24.5MiB/s (25.6MB/s), 2057KiB/s-8184KiB/s (2106kB/s-8380kB/s), io=25.0MiB (26.2MB), run=1001-1023msec 00:19:44.544 WRITE: bw=27.8MiB/s (29.1MB/s), 4004KiB/s-8599KiB/s (4100kB/s-8806kB/s), io=28.4MiB (29.8MB), run=1001-1023msec 00:19:44.544 00:19:44.544 Disk stats (read/write): 00:19:44.544 nvme0n1: ios=1597/1872, merge=0/0, ticks=724/342, in_queue=1066, util=85.57% 00:19:44.544 nvme0n2: ios=1585/1983, merge=0/0, ticks=739/373, in_queue=1112, util=89.62% 00:19:44.544 nvme0n3: ios=1593/1727, merge=0/0, ticks=493/357, in_queue=850, util=94.88% 00:19:44.544 nvme0n4: ios=578/1024, merge=0/0, ticks=617/224, in_queue=841, util=95.68% 00:19:44.544 16:06:07 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:44.544 [global] 00:19:44.544 thread=1 00:19:44.544 invalidate=1 00:19:44.544 rw=randwrite 00:19:44.544 time_based=1 00:19:44.544 runtime=1 00:19:44.544 ioengine=libaio 00:19:44.544 direct=1 00:19:44.544 bs=4096 00:19:44.544 iodepth=1 00:19:44.544 norandommap=0 00:19:44.544 numjobs=1 00:19:44.544 00:19:44.544 verify_dump=1 00:19:44.544 verify_backlog=512 00:19:44.544 verify_state_save=0 00:19:44.544 do_verify=1 00:19:44.544 verify=crc32c-intel 00:19:44.544 [job0] 00:19:44.544 filename=/dev/nvme0n1 00:19:44.544 [job1] 00:19:44.544 filename=/dev/nvme0n2 00:19:44.544 [job2] 00:19:44.544 filename=/dev/nvme0n3 00:19:44.544 [job3] 00:19:44.544 filename=/dev/nvme0n4 00:19:44.544 Could not set queue depth (nvme0n1) 00:19:44.544 Could not set queue depth (nvme0n2) 00:19:44.544 Could not set queue depth (nvme0n3) 00:19:44.544 Could not set queue depth (nvme0n4) 00:19:44.802 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:44.802 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:44.802 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:44.802 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:44.802 fio-3.35 00:19:44.803 Starting 4 threads 00:19:46.186 00:19:46.186 job0: (groupid=0, jobs=1): err= 0: pid=1601798: Mon Nov 18 16:06:09 2024 00:19:46.186 read: IOPS=370, BW=1481KiB/s (1516kB/s)(1488KiB/1005msec) 00:19:46.186 slat (nsec): min=4877, max=19777, avg=6760.58, stdev=2079.81 00:19:46.186 clat (usec): min=190, max=42017, avg=2326.24, stdev=9001.80 00:19:46.186 lat (usec): min=196, max=42033, avg=2333.00, stdev=9003.25 00:19:46.186 clat percentiles (usec): 00:19:46.186 | 1.00th=[ 192], 5.00th=[ 202], 10.00th=[ 210], 20.00th=[ 223], 00:19:46.186 | 30.00th=[ 229], 40.00th=[ 237], 50.00th=[ 243], 60.00th=[ 247], 00:19:46.186 | 70.00th=[ 255], 80.00th=[ 262], 90.00th=[ 281], 95.00th=[40633], 00:19:46.186 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:46.186 | 99.99th=[42206] 00:19:46.186 write: IOPS=509, BW=2038KiB/s (2087kB/s)(2048KiB/1005msec); 0 zone resets 00:19:46.186 slat (nsec): min=8397, max=43273, avg=11255.90, stdev=3815.31 00:19:46.186 clat (usec): min=149, max=929, avg=250.92, stdev=71.00 00:19:46.186 lat (usec): min=159, max=940, avg=262.18, stdev=72.00 00:19:46.186 clat percentiles (usec): 00:19:46.186 | 1.00th=[ 159], 5.00th=[ 174], 10.00th=[ 190], 20.00th=[ 206], 00:19:46.186 | 30.00th=[ 215], 40.00th=[ 223], 50.00th=[ 229], 60.00th=[ 239], 00:19:46.186 | 70.00th=[ 253], 80.00th=[ 322], 90.00th=[ 338], 95.00th=[ 351], 00:19:46.186 | 99.00th=[ 465], 99.50th=[ 627], 99.90th=[ 930], 99.95th=[ 930], 00:19:46.186 | 99.99th=[ 930] 00:19:46.186 bw ( KiB/s): min= 4096, max= 4096, per=20.62%, avg=4096.00, stdev= 0.00, samples=1 00:19:46.186 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:46.186 lat (usec) : 250=67.08%, 500=30.20%, 750=0.45%, 1000=0.11% 00:19:46.186 lat (msec) : 50=2.15% 00:19:46.186 cpu : usr=0.40%, sys=0.90%, ctx=885, majf=0, minf=1 00:19:46.186 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:46.186 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.186 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.186 issued rwts: total=372,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.186 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:46.186 job1: (groupid=0, jobs=1): err= 0: pid=1601804: Mon Nov 18 16:06:09 2024 00:19:46.186 read: IOPS=51, BW=207KiB/s (212kB/s)(212KiB/1022msec) 00:19:46.186 slat (nsec): min=6260, max=33188, avg=13861.42, stdev=5599.00 00:19:46.186 clat (usec): min=225, max=42009, avg=17208.73, stdev=20275.60 00:19:46.186 lat (usec): min=234, max=42028, avg=17222.59, stdev=20276.82 00:19:46.186 clat percentiles (usec): 00:19:46.186 | 1.00th=[ 227], 5.00th=[ 231], 10.00th=[ 241], 20.00th=[ 260], 00:19:46.186 | 30.00th=[ 302], 40.00th=[ 330], 50.00th=[ 343], 60.00th=[39060], 00:19:46.186 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:19:46.186 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:46.186 | 99.99th=[42206] 00:19:46.186 write: IOPS=500, BW=2004KiB/s (2052kB/s)(2048KiB/1022msec); 0 zone resets 00:19:46.186 slat (nsec): min=5530, max=39821, avg=10422.19, stdev=5378.66 00:19:46.186 clat (usec): min=132, max=460, avg=199.07, stdev=48.88 00:19:46.186 lat (usec): min=138, max=472, avg=209.50, stdev=50.92 00:19:46.186 clat percentiles (usec): 00:19:46.186 | 1.00th=[ 137], 5.00th=[ 145], 10.00th=[ 149], 20.00th=[ 157], 00:19:46.186 | 30.00th=[ 165], 40.00th=[ 180], 50.00th=[ 198], 60.00th=[ 210], 00:19:46.186 | 70.00th=[ 221], 80.00th=[ 231], 90.00th=[ 245], 95.00th=[ 258], 00:19:46.186 | 99.00th=[ 404], 99.50th=[ 433], 99.90th=[ 461], 99.95th=[ 461], 00:19:46.186 | 99.99th=[ 461] 00:19:46.186 bw ( KiB/s): min= 4096, max= 4096, per=20.62%, avg=4096.00, stdev= 0.00, samples=1 00:19:46.186 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:46.186 lat (usec) : 250=85.49%, 500=10.62% 00:19:46.186 lat (msec) : 50=3.89% 00:19:46.186 cpu : usr=0.49%, sys=0.29%, ctx=566, majf=0, minf=1 00:19:46.186 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:46.186 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.186 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.186 issued rwts: total=53,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.186 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:46.186 job2: (groupid=0, jobs=1): err= 0: pid=1601805: Mon Nov 18 16:06:09 2024 00:19:46.186 read: IOPS=1208, BW=4835KiB/s (4951kB/s)(4840KiB/1001msec) 00:19:46.186 slat (nsec): min=4474, max=56117, avg=8339.43, stdev=5178.80 00:19:46.186 clat (usec): min=181, max=41046, avg=519.80, stdev=3303.60 00:19:46.186 lat (usec): min=202, max=41060, avg=528.14, stdev=3304.06 00:19:46.186 clat percentiles (usec): 00:19:46.186 | 1.00th=[ 202], 5.00th=[ 217], 10.00th=[ 221], 20.00th=[ 229], 00:19:46.186 | 30.00th=[ 237], 40.00th=[ 241], 50.00th=[ 245], 60.00th=[ 247], 00:19:46.186 | 70.00th=[ 251], 80.00th=[ 260], 90.00th=[ 277], 95.00th=[ 314], 00:19:46.186 | 99.00th=[ 490], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:46.186 | 99.99th=[41157] 00:19:46.186 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:19:46.186 slat (nsec): min=5724, max=42697, avg=11269.61, stdev=4971.47 00:19:46.186 clat (usec): min=138, max=1071, avg=218.68, stdev=60.44 00:19:46.186 lat (usec): min=144, max=1083, avg=229.95, stdev=61.54 00:19:46.186 clat percentiles (usec): 00:19:46.186 | 1.00th=[ 143], 5.00th=[ 151], 10.00th=[ 157], 20.00th=[ 172], 00:19:46.186 | 30.00th=[ 184], 40.00th=[ 196], 50.00th=[ 208], 60.00th=[ 221], 00:19:46.186 | 70.00th=[ 237], 80.00th=[ 253], 90.00th=[ 293], 95.00th=[ 338], 00:19:46.186 | 99.00th=[ 375], 99.50th=[ 420], 99.90th=[ 660], 99.95th=[ 1074], 00:19:46.186 | 99.99th=[ 1074] 00:19:46.186 bw ( KiB/s): min= 8192, max= 8192, per=41.23%, avg=8192.00, stdev= 0.00, samples=1 00:19:46.186 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:46.186 lat (usec) : 250=72.40%, 500=27.13%, 750=0.15% 00:19:46.186 lat (msec) : 2=0.04%, 50=0.29% 00:19:46.186 cpu : usr=1.20%, sys=3.20%, ctx=2747, majf=0, minf=1 00:19:46.186 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:46.186 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.186 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.186 issued rwts: total=1210,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.186 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:46.187 job3: (groupid=0, jobs=1): err= 0: pid=1601806: Mon Nov 18 16:06:09 2024 00:19:46.187 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:19:46.187 slat (nsec): min=4540, max=66929, avg=8586.89, stdev=5169.02 00:19:46.187 clat (usec): min=166, max=534, avg=235.55, stdev=46.68 00:19:46.187 lat (usec): min=171, max=548, avg=244.14, stdev=49.07 00:19:46.187 clat percentiles (usec): 00:19:46.187 | 1.00th=[ 176], 5.00th=[ 182], 10.00th=[ 190], 20.00th=[ 198], 00:19:46.187 | 30.00th=[ 206], 40.00th=[ 219], 50.00th=[ 233], 60.00th=[ 241], 00:19:46.187 | 70.00th=[ 249], 80.00th=[ 260], 90.00th=[ 281], 95.00th=[ 310], 00:19:46.187 | 99.00th=[ 461], 99.50th=[ 478], 99.90th=[ 515], 99.95th=[ 529], 00:19:46.187 | 99.99th=[ 537] 00:19:46.187 write: IOPS=2513, BW=9.82MiB/s (10.3MB/s)(9.83MiB/1001msec); 0 zone resets 00:19:46.187 slat (nsec): min=6093, max=44657, avg=10815.14, stdev=4883.96 00:19:46.187 clat (usec): min=125, max=670, avg=183.32, stdev=52.57 00:19:46.187 lat (usec): min=131, max=681, avg=194.14, stdev=53.69 00:19:46.187 clat percentiles (usec): 00:19:46.187 | 1.00th=[ 131], 5.00th=[ 139], 10.00th=[ 143], 20.00th=[ 149], 00:19:46.187 | 30.00th=[ 153], 40.00th=[ 159], 50.00th=[ 163], 60.00th=[ 172], 00:19:46.187 | 70.00th=[ 182], 80.00th=[ 219], 90.00th=[ 258], 95.00th=[ 310], 00:19:46.187 | 99.00th=[ 351], 99.50th=[ 379], 99.90th=[ 429], 99.95th=[ 586], 00:19:46.187 | 99.99th=[ 668] 00:19:46.187 bw ( KiB/s): min= 8192, max= 8192, per=41.23%, avg=8192.00, stdev= 0.00, samples=1 00:19:46.187 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:46.187 lat (usec) : 250=80.17%, 500=19.70%, 750=0.13% 00:19:46.187 cpu : usr=2.40%, sys=4.40%, ctx=4565, majf=0, minf=1 00:19:46.187 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:46.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.187 issued rwts: total=2048,2516,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.187 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:46.187 00:19:46.187 Run status group 0 (all jobs): 00:19:46.187 READ: bw=14.1MiB/s (14.8MB/s), 207KiB/s-8184KiB/s (212kB/s-8380kB/s), io=14.4MiB (15.1MB), run=1001-1022msec 00:19:46.187 WRITE: bw=19.4MiB/s (20.3MB/s), 2004KiB/s-9.82MiB/s (2052kB/s-10.3MB/s), io=19.8MiB (20.8MB), run=1001-1022msec 00:19:46.187 00:19:46.187 Disk stats (read/write): 00:19:46.187 nvme0n1: ios=418/512, merge=0/0, ticks=722/125, in_queue=847, util=86.57% 00:19:46.187 nvme0n2: ios=98/512, merge=0/0, ticks=840/98, in_queue=938, util=95.83% 00:19:46.187 nvme0n3: ios=1081/1096, merge=0/0, ticks=650/241, in_queue=891, util=94.88% 00:19:46.187 nvme0n4: ios=1863/2048, merge=0/0, ticks=559/379, in_queue=938, util=97.89% 00:19:46.187 16:06:09 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:46.187 [global] 00:19:46.187 thread=1 00:19:46.187 invalidate=1 00:19:46.187 rw=write 00:19:46.187 time_based=1 00:19:46.187 runtime=1 00:19:46.187 ioengine=libaio 00:19:46.187 direct=1 00:19:46.187 bs=4096 00:19:46.187 iodepth=128 00:19:46.187 norandommap=0 00:19:46.187 numjobs=1 00:19:46.187 00:19:46.187 verify_dump=1 00:19:46.187 verify_backlog=512 00:19:46.187 verify_state_save=0 00:19:46.187 do_verify=1 00:19:46.187 verify=crc32c-intel 00:19:46.187 [job0] 00:19:46.187 filename=/dev/nvme0n1 00:19:46.187 [job1] 00:19:46.187 filename=/dev/nvme0n2 00:19:46.187 [job2] 00:19:46.187 filename=/dev/nvme0n3 00:19:46.187 [job3] 00:19:46.187 filename=/dev/nvme0n4 00:19:46.187 Could not set queue depth (nvme0n1) 00:19:46.187 Could not set queue depth (nvme0n2) 00:19:46.187 Could not set queue depth (nvme0n3) 00:19:46.187 Could not set queue depth (nvme0n4) 00:19:46.187 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:46.187 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:46.187 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:46.187 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:46.187 fio-3.35 00:19:46.187 Starting 4 threads 00:19:47.560 00:19:47.560 job0: (groupid=0, jobs=1): err= 0: pid=1602157: Mon Nov 18 16:06:10 2024 00:19:47.560 read: IOPS=4087, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1002msec) 00:19:47.560 slat (usec): min=3, max=9607, avg=103.05, stdev=586.86 00:19:47.560 clat (usec): min=7474, max=42252, avg=13686.81, stdev=6152.14 00:19:47.560 lat (usec): min=7481, max=44192, avg=13789.85, stdev=6215.31 00:19:47.560 clat percentiles (usec): 00:19:47.560 | 1.00th=[ 7701], 5.00th=[ 9634], 10.00th=[10028], 20.00th=[10552], 00:19:47.560 | 30.00th=[10814], 40.00th=[10945], 50.00th=[11338], 60.00th=[11469], 00:19:47.560 | 70.00th=[11863], 80.00th=[16057], 90.00th=[22676], 95.00th=[28705], 00:19:47.560 | 99.00th=[35914], 99.50th=[39060], 99.90th=[40109], 99.95th=[40109], 00:19:47.560 | 99.99th=[42206] 00:19:47.560 write: IOPS=4514, BW=17.6MiB/s (18.5MB/s)(17.7MiB/1002msec); 0 zone resets 00:19:47.560 slat (usec): min=4, max=16641, avg=115.22, stdev=573.90 00:19:47.560 clat (usec): min=359, max=42638, avg=15519.75, stdev=8758.38 00:19:47.560 lat (usec): min=3249, max=42671, avg=15634.97, stdev=8814.60 00:19:47.560 clat percentiles (usec): 00:19:47.560 | 1.00th=[ 4424], 5.00th=[ 8455], 10.00th=[ 8848], 20.00th=[ 9896], 00:19:47.560 | 30.00th=[11076], 40.00th=[11469], 50.00th=[11731], 60.00th=[12125], 00:19:47.560 | 70.00th=[12911], 80.00th=[24249], 90.00th=[31851], 95.00th=[34866], 00:19:47.560 | 99.00th=[40633], 99.50th=[41157], 99.90th=[42730], 99.95th=[42730], 00:19:47.560 | 99.99th=[42730] 00:19:47.560 bw ( KiB/s): min=16384, max=16384, per=24.73%, avg=16384.00, stdev= 0.00, samples=1 00:19:47.560 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:19:47.560 lat (usec) : 500=0.01% 00:19:47.560 lat (msec) : 4=0.34%, 10=14.30%, 20=66.65%, 50=18.70% 00:19:47.560 cpu : usr=7.19%, sys=11.09%, ctx=373, majf=0, minf=1 00:19:47.560 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:47.560 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:47.560 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:47.560 issued rwts: total=4096,4524,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:47.560 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:47.560 job1: (groupid=0, jobs=1): err= 0: pid=1602158: Mon Nov 18 16:06:10 2024 00:19:47.560 read: IOPS=4540, BW=17.7MiB/s (18.6MB/s)(17.8MiB/1004msec) 00:19:47.560 slat (usec): min=2, max=18673, avg=100.44, stdev=706.16 00:19:47.560 clat (usec): min=1248, max=35921, avg=12111.79, stdev=4682.55 00:19:47.560 lat (usec): min=1282, max=35930, avg=12212.23, stdev=4729.02 00:19:47.560 clat percentiles (usec): 00:19:47.560 | 1.00th=[ 2311], 5.00th=[ 6325], 10.00th=[ 7767], 20.00th=[ 9241], 00:19:47.560 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11469], 60.00th=[11863], 00:19:47.560 | 70.00th=[12649], 80.00th=[13960], 90.00th=[17433], 95.00th=[20317], 00:19:47.560 | 99.00th=[30802], 99.50th=[31851], 99.90th=[35914], 99.95th=[35914], 00:19:47.560 | 99.99th=[35914] 00:19:47.560 write: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec); 0 zone resets 00:19:47.560 slat (usec): min=3, max=10734, avg=107.10, stdev=527.11 00:19:47.560 clat (usec): min=862, max=40237, avg=15512.06, stdev=8684.20 00:19:47.560 lat (usec): min=878, max=40252, avg=15619.16, stdev=8741.84 00:19:47.560 clat percentiles (usec): 00:19:47.560 | 1.00th=[ 3818], 5.00th=[ 6194], 10.00th=[ 8848], 20.00th=[ 9503], 00:19:47.560 | 30.00th=[10290], 40.00th=[10683], 50.00th=[11338], 60.00th=[12256], 00:19:47.560 | 70.00th=[19006], 80.00th=[23987], 90.00th=[28443], 95.00th=[33817], 00:19:47.560 | 99.00th=[40109], 99.50th=[40109], 99.90th=[40109], 99.95th=[40109], 00:19:47.560 | 99.99th=[40109] 00:19:47.560 bw ( KiB/s): min=16384, max=20480, per=27.82%, avg=18432.00, stdev=2896.31, samples=2 00:19:47.560 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:19:47.560 lat (usec) : 1000=0.02% 00:19:47.560 lat (msec) : 2=0.45%, 4=1.49%, 10=24.10%, 20=56.75%, 50=17.19% 00:19:47.560 cpu : usr=5.08%, sys=6.98%, ctx=516, majf=0, minf=1 00:19:47.560 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:47.560 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:47.560 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:47.560 issued rwts: total=4559,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:47.560 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:47.560 job2: (groupid=0, jobs=1): err= 0: pid=1602159: Mon Nov 18 16:06:10 2024 00:19:47.560 read: IOPS=4927, BW=19.2MiB/s (20.2MB/s)(19.3MiB/1003msec) 00:19:47.560 slat (usec): min=3, max=5692, avg=91.23, stdev=458.30 00:19:47.560 clat (usec): min=1677, max=18817, avg=12013.30, stdev=1402.00 00:19:47.560 lat (usec): min=5397, max=18847, avg=12104.53, stdev=1423.80 00:19:47.560 clat percentiles (usec): 00:19:47.560 | 1.00th=[ 6521], 5.00th=[ 9896], 10.00th=[10552], 20.00th=[11207], 00:19:47.560 | 30.00th=[11600], 40.00th=[11863], 50.00th=[11994], 60.00th=[12125], 00:19:47.560 | 70.00th=[12518], 80.00th=[12911], 90.00th=[13698], 95.00th=[14484], 00:19:47.560 | 99.00th=[15401], 99.50th=[15401], 99.90th=[17171], 99.95th=[17695], 00:19:47.560 | 99.99th=[18744] 00:19:47.560 write: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec); 0 zone resets 00:19:47.560 slat (usec): min=4, max=17041, avg=93.84, stdev=499.79 00:19:47.560 clat (usec): min=4609, max=28250, avg=12684.59, stdev=2328.91 00:19:47.560 lat (usec): min=4616, max=28276, avg=12778.43, stdev=2327.20 00:19:47.560 clat percentiles (usec): 00:19:47.560 | 1.00th=[ 8356], 5.00th=[ 9241], 10.00th=[ 9896], 20.00th=[11469], 00:19:47.560 | 30.00th=[11994], 40.00th=[12256], 50.00th=[12518], 60.00th=[12649], 00:19:47.560 | 70.00th=[13173], 80.00th=[13435], 90.00th=[15139], 95.00th=[16909], 00:19:47.560 | 99.00th=[22414], 99.50th=[22676], 99.90th=[23200], 99.95th=[23200], 00:19:47.560 | 99.99th=[28181] 00:19:47.560 bw ( KiB/s): min=20480, max=20480, per=30.91%, avg=20480.00, stdev= 0.00, samples=2 00:19:47.560 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=2 00:19:47.560 lat (msec) : 2=0.01%, 10=8.69%, 20=90.13%, 50=1.17% 00:19:47.560 cpu : usr=8.08%, sys=13.47%, ctx=516, majf=0, minf=1 00:19:47.560 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:47.560 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:47.560 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:47.560 issued rwts: total=4942,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:47.560 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:47.560 job3: (groupid=0, jobs=1): err= 0: pid=1602160: Mon Nov 18 16:06:10 2024 00:19:47.561 read: IOPS=2728, BW=10.7MiB/s (11.2MB/s)(11.1MiB/1046msec) 00:19:47.561 slat (usec): min=2, max=12717, avg=170.74, stdev=971.12 00:19:47.561 clat (usec): min=7757, max=89162, avg=23609.39, stdev=12829.68 00:19:47.561 lat (usec): min=7764, max=91220, avg=23780.13, stdev=12885.45 00:19:47.561 clat percentiles (usec): 00:19:47.561 | 1.00th=[ 8979], 5.00th=[11600], 10.00th=[15795], 20.00th=[17171], 00:19:47.561 | 30.00th=[17695], 40.00th=[18744], 50.00th=[21890], 60.00th=[23200], 00:19:47.561 | 70.00th=[23987], 80.00th=[26346], 90.00th=[30278], 95.00th=[42206], 00:19:47.561 | 99.00th=[88605], 99.50th=[88605], 99.90th=[88605], 99.95th=[88605], 00:19:47.561 | 99.99th=[89654] 00:19:47.561 write: IOPS=2936, BW=11.5MiB/s (12.0MB/s)(12.0MiB/1046msec); 0 zone resets 00:19:47.561 slat (usec): min=3, max=12823, avg=157.68, stdev=821.12 00:19:47.561 clat (usec): min=7312, max=53181, avg=21167.27, stdev=8088.54 00:19:47.561 lat (usec): min=7318, max=53202, avg=21324.94, stdev=8148.00 00:19:47.561 clat percentiles (usec): 00:19:47.561 | 1.00th=[10683], 5.00th=[13566], 10.00th=[14615], 20.00th=[15270], 00:19:47.561 | 30.00th=[15795], 40.00th=[17171], 50.00th=[17957], 60.00th=[21365], 00:19:47.561 | 70.00th=[23462], 80.00th=[26084], 90.00th=[30540], 95.00th=[38011], 00:19:47.561 | 99.00th=[52691], 99.50th=[52691], 99.90th=[53216], 99.95th=[53216], 00:19:47.561 | 99.99th=[53216] 00:19:47.561 bw ( KiB/s): min=12288, max=12288, per=18.55%, avg=12288.00, stdev= 0.00, samples=2 00:19:47.561 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=2 00:19:47.561 lat (msec) : 10=1.47%, 20=49.14%, 50=46.46%, 100=2.94% 00:19:47.561 cpu : usr=2.68%, sys=7.08%, ctx=274, majf=0, minf=2 00:19:47.561 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:47.561 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:47.561 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:47.561 issued rwts: total=2854,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:47.561 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:47.561 00:19:47.561 Run status group 0 (all jobs): 00:19:47.561 READ: bw=61.4MiB/s (64.4MB/s), 10.7MiB/s-19.2MiB/s (11.2MB/s-20.2MB/s), io=64.3MiB (67.4MB), run=1002-1046msec 00:19:47.561 WRITE: bw=64.7MiB/s (67.8MB/s), 11.5MiB/s-19.9MiB/s (12.0MB/s-20.9MB/s), io=67.7MiB (71.0MB), run=1002-1046msec 00:19:47.561 00:19:47.561 Disk stats (read/write): 00:19:47.561 nvme0n1: ios=3213/3584, merge=0/0, ticks=14932/19266, in_queue=34198, util=96.89% 00:19:47.561 nvme0n2: ios=3880/4096, merge=0/0, ticks=31857/48900, in_queue=80757, util=99.19% 00:19:47.561 nvme0n3: ios=4155/4470, merge=0/0, ticks=16585/18185, in_queue=34770, util=97.28% 00:19:47.561 nvme0n4: ios=2600/2671, merge=0/0, ticks=18110/17882, in_queue=35992, util=90.41% 00:19:47.561 16:06:10 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:47.561 [global] 00:19:47.561 thread=1 00:19:47.561 invalidate=1 00:19:47.561 rw=randwrite 00:19:47.561 time_based=1 00:19:47.561 runtime=1 00:19:47.561 ioengine=libaio 00:19:47.561 direct=1 00:19:47.561 bs=4096 00:19:47.561 iodepth=128 00:19:47.561 norandommap=0 00:19:47.561 numjobs=1 00:19:47.561 00:19:47.561 verify_dump=1 00:19:47.561 verify_backlog=512 00:19:47.561 verify_state_save=0 00:19:47.561 do_verify=1 00:19:47.561 verify=crc32c-intel 00:19:47.561 [job0] 00:19:47.561 filename=/dev/nvme0n1 00:19:47.561 [job1] 00:19:47.561 filename=/dev/nvme0n2 00:19:47.561 [job2] 00:19:47.561 filename=/dev/nvme0n3 00:19:47.561 [job3] 00:19:47.561 filename=/dev/nvme0n4 00:19:47.561 Could not set queue depth (nvme0n1) 00:19:47.561 Could not set queue depth (nvme0n2) 00:19:47.561 Could not set queue depth (nvme0n3) 00:19:47.561 Could not set queue depth (nvme0n4) 00:19:47.561 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:47.561 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:47.561 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:47.561 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:47.561 fio-3.35 00:19:47.561 Starting 4 threads 00:19:48.935 00:19:48.935 job0: (groupid=0, jobs=1): err= 0: pid=1602521: Mon Nov 18 16:06:12 2024 00:19:48.935 read: IOPS=3413, BW=13.3MiB/s (14.0MB/s)(13.4MiB/1003msec) 00:19:48.935 slat (usec): min=3, max=18771, avg=121.08, stdev=783.41 00:19:48.935 clat (usec): min=609, max=48149, avg=14317.52, stdev=7262.99 00:19:48.935 lat (usec): min=2771, max=48154, avg=14438.60, stdev=7330.02 00:19:48.935 clat percentiles (usec): 00:19:48.935 | 1.00th=[ 4752], 5.00th=[ 7963], 10.00th=[ 8586], 20.00th=[ 9896], 00:19:48.935 | 30.00th=[10421], 40.00th=[10945], 50.00th=[12256], 60.00th=[12518], 00:19:48.935 | 70.00th=[13435], 80.00th=[19006], 90.00th=[25560], 95.00th=[30802], 00:19:48.935 | 99.00th=[40109], 99.50th=[43254], 99.90th=[47973], 99.95th=[47973], 00:19:48.935 | 99.99th=[47973] 00:19:48.935 write: IOPS=3573, BW=14.0MiB/s (14.6MB/s)(14.0MiB/1003msec); 0 zone resets 00:19:48.935 slat (usec): min=3, max=11041, avg=149.29, stdev=713.94 00:19:48.935 clat (usec): min=643, max=76009, avg=21828.02, stdev=13139.97 00:19:48.935 lat (usec): min=650, max=76026, avg=21977.31, stdev=13213.91 00:19:48.935 clat percentiles (usec): 00:19:48.935 | 1.00th=[ 3032], 5.00th=[ 6128], 10.00th=[ 8717], 20.00th=[10159], 00:19:48.935 | 30.00th=[11731], 40.00th=[16188], 50.00th=[19792], 60.00th=[23200], 00:19:48.935 | 70.00th=[28443], 80.00th=[29754], 90.00th=[37487], 95.00th=[42730], 00:19:48.935 | 99.00th=[70779], 99.50th=[72877], 99.90th=[76022], 99.95th=[76022], 00:19:48.935 | 99.99th=[76022] 00:19:48.935 bw ( KiB/s): min=12288, max=16384, per=23.02%, avg=14336.00, stdev=2896.31, samples=2 00:19:48.935 iops : min= 3072, max= 4096, avg=3584.00, stdev=724.08, samples=2 00:19:48.935 lat (usec) : 750=0.04% 00:19:48.935 lat (msec) : 2=0.16%, 4=0.91%, 10=18.22%, 20=47.25%, 50=31.61% 00:19:48.935 lat (msec) : 100=1.81% 00:19:48.935 cpu : usr=5.89%, sys=7.39%, ctx=410, majf=0, minf=2 00:19:48.935 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:48.935 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.935 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:48.935 issued rwts: total=3424,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.935 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:48.935 job1: (groupid=0, jobs=1): err= 0: pid=1602522: Mon Nov 18 16:06:12 2024 00:19:48.935 read: IOPS=5089, BW=19.9MiB/s (20.8MB/s)(20.0MiB/1006msec) 00:19:48.935 slat (usec): min=2, max=23900, avg=87.80, stdev=599.93 00:19:48.935 clat (usec): min=5479, max=40808, avg=11565.77, stdev=5537.66 00:19:48.935 lat (usec): min=5488, max=40812, avg=11653.57, stdev=5571.43 00:19:48.936 clat percentiles (usec): 00:19:48.936 | 1.00th=[ 6325], 5.00th=[ 8029], 10.00th=[ 8356], 20.00th=[ 8586], 00:19:48.936 | 30.00th=[ 8848], 40.00th=[ 8979], 50.00th=[10159], 60.00th=[10814], 00:19:48.936 | 70.00th=[11600], 80.00th=[13042], 90.00th=[15533], 95.00th=[17957], 00:19:48.936 | 99.00th=[40633], 99.50th=[40633], 99.90th=[40633], 99.95th=[40633], 00:19:48.936 | 99.99th=[40633] 00:19:48.936 write: IOPS=5550, BW=21.7MiB/s (22.7MB/s)(21.8MiB/1006msec); 0 zone resets 00:19:48.936 slat (usec): min=3, max=7916, avg=88.76, stdev=465.12 00:19:48.936 clat (usec): min=288, max=32812, avg=12164.66, stdev=5100.73 00:19:48.936 lat (usec): min=4708, max=32853, avg=12253.42, stdev=5126.72 00:19:48.936 clat percentiles (usec): 00:19:48.936 | 1.00th=[ 5800], 5.00th=[ 7570], 10.00th=[ 8455], 20.00th=[ 8586], 00:19:48.936 | 30.00th=[ 8848], 40.00th=[ 9503], 50.00th=[11076], 60.00th=[11469], 00:19:48.936 | 70.00th=[11994], 80.00th=[14746], 90.00th=[19530], 95.00th=[22938], 00:19:48.936 | 99.00th=[30802], 99.50th=[32375], 99.90th=[32900], 99.95th=[32900], 00:19:48.936 | 99.99th=[32900] 00:19:48.936 bw ( KiB/s): min=19960, max=23688, per=35.05%, avg=21824.00, stdev=2636.09, samples=2 00:19:48.936 iops : min= 4990, max= 5922, avg=5456.00, stdev=659.02, samples=2 00:19:48.936 lat (usec) : 500=0.01% 00:19:48.936 lat (msec) : 10=45.68%, 20=47.80%, 50=6.50% 00:19:48.936 cpu : usr=7.16%, sys=12.14%, ctx=471, majf=0, minf=1 00:19:48.936 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:48.936 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.936 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:48.936 issued rwts: total=5120,5584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.936 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:48.936 job2: (groupid=0, jobs=1): err= 0: pid=1602523: Mon Nov 18 16:06:12 2024 00:19:48.936 read: IOPS=2492, BW=9968KiB/s (10.2MB/s)(9988KiB/1002msec) 00:19:48.936 slat (usec): min=2, max=33106, avg=233.75, stdev=1546.56 00:19:48.936 clat (usec): min=590, max=132373, avg=30157.00, stdev=25818.31 00:19:48.936 lat (msec): min=2, max=132, avg=30.39, stdev=25.96 00:19:48.936 clat percentiles (msec): 00:19:48.936 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 14], 00:19:48.936 | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 20], 60.00th=[ 25], 00:19:48.936 | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 67], 95.00th=[ 88], 00:19:48.936 | 99.00th=[ 131], 99.50th=[ 133], 99.90th=[ 133], 99.95th=[ 133], 00:19:48.936 | 99.99th=[ 133] 00:19:48.936 write: IOPS=2554, BW=9.98MiB/s (10.5MB/s)(10.0MiB/1002msec); 0 zone resets 00:19:48.936 slat (usec): min=4, max=12843, avg=153.90, stdev=849.66 00:19:48.936 clat (usec): min=9937, max=50304, avg=19986.94, stdev=9155.28 00:19:48.936 lat (usec): min=9943, max=50308, avg=20140.84, stdev=9197.03 00:19:48.936 clat percentiles (usec): 00:19:48.936 | 1.00th=[10159], 5.00th=[11338], 10.00th=[13435], 20.00th=[14484], 00:19:48.936 | 30.00th=[14877], 40.00th=[15664], 50.00th=[16581], 60.00th=[18744], 00:19:48.936 | 70.00th=[19530], 80.00th=[21103], 90.00th=[37487], 95.00th=[42730], 00:19:48.936 | 99.00th=[49546], 99.50th=[49546], 99.90th=[50070], 99.95th=[50070], 00:19:48.936 | 99.99th=[50070] 00:19:48.936 bw ( KiB/s): min= 8440, max=12064, per=16.46%, avg=10252.00, stdev=2562.55, samples=2 00:19:48.936 iops : min= 2110, max= 3016, avg=2563.00, stdev=640.64, samples=2 00:19:48.936 lat (usec) : 750=0.02% 00:19:48.936 lat (msec) : 4=0.63%, 10=1.60%, 20=60.96%, 50=29.19%, 100=5.26% 00:19:48.936 lat (msec) : 250=2.33% 00:19:48.936 cpu : usr=3.60%, sys=4.20%, ctx=253, majf=0, minf=1 00:19:48.936 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:48.936 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.936 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:48.936 issued rwts: total=2497,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.936 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:48.936 job3: (groupid=0, jobs=1): err= 0: pid=1602524: Mon Nov 18 16:06:12 2024 00:19:48.936 read: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec) 00:19:48.936 slat (usec): min=2, max=18275, avg=142.35, stdev=924.90 00:19:48.936 clat (usec): min=3571, max=80542, avg=18207.97, stdev=9880.39 00:19:48.936 lat (usec): min=3609, max=80551, avg=18350.32, stdev=9957.78 00:19:48.936 clat percentiles (usec): 00:19:48.936 | 1.00th=[ 4686], 5.00th=[ 9241], 10.00th=[10159], 20.00th=[10945], 00:19:48.936 | 30.00th=[12125], 40.00th=[13829], 50.00th=[16188], 60.00th=[18744], 00:19:48.936 | 70.00th=[21365], 80.00th=[23200], 90.00th=[26870], 95.00th=[34866], 00:19:48.936 | 99.00th=[70779], 99.50th=[76022], 99.90th=[80217], 99.95th=[80217], 00:19:48.936 | 99.99th=[80217] 00:19:48.936 write: IOPS=3909, BW=15.3MiB/s (16.0MB/s)(15.4MiB/1006msec); 0 zone resets 00:19:48.936 slat (usec): min=4, max=12817, avg=114.38, stdev=633.20 00:19:48.936 clat (usec): min=1116, max=80522, avg=15853.17, stdev=9139.29 00:19:48.936 lat (usec): min=1125, max=80529, avg=15967.55, stdev=9180.37 00:19:48.936 clat percentiles (usec): 00:19:48.936 | 1.00th=[ 3818], 5.00th=[ 7242], 10.00th=[ 8225], 20.00th=[10421], 00:19:48.936 | 30.00th=[11863], 40.00th=[12387], 50.00th=[12780], 60.00th=[15401], 00:19:48.936 | 70.00th=[17171], 80.00th=[19006], 90.00th=[27395], 95.00th=[32637], 00:19:48.936 | 99.00th=[61080], 99.50th=[68682], 99.90th=[69731], 99.95th=[76022], 00:19:48.936 | 99.99th=[80217] 00:19:48.936 bw ( KiB/s): min=14056, max=16384, per=24.44%, avg=15220.00, stdev=1646.14, samples=2 00:19:48.936 iops : min= 3514, max= 4096, avg=3805.00, stdev=411.54, samples=2 00:19:48.936 lat (msec) : 2=0.15%, 4=0.68%, 10=11.31%, 20=63.04%, 50=23.15% 00:19:48.936 lat (msec) : 100=1.68% 00:19:48.936 cpu : usr=3.68%, sys=6.27%, ctx=378, majf=0, minf=1 00:19:48.936 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:48.936 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.936 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:48.936 issued rwts: total=3584,3933,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.936 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:48.936 00:19:48.936 Run status group 0 (all jobs): 00:19:48.936 READ: bw=56.8MiB/s (59.5MB/s), 9968KiB/s-19.9MiB/s (10.2MB/s-20.8MB/s), io=57.1MiB (59.9MB), run=1002-1006msec 00:19:48.936 WRITE: bw=60.8MiB/s (63.8MB/s), 9.98MiB/s-21.7MiB/s (10.5MB/s-22.7MB/s), io=61.2MiB (64.1MB), run=1002-1006msec 00:19:48.936 00:19:48.936 Disk stats (read/write): 00:19:48.936 nvme0n1: ios=2610/2875, merge=0/0, ticks=37611/66289, in_queue=103900, util=87.17% 00:19:48.936 nvme0n2: ios=4631/5043, merge=0/0, ticks=22486/24213, in_queue=46699, util=99.09% 00:19:48.936 nvme0n3: ios=1690/2048, merge=0/0, ticks=19082/12397, in_queue=31479, util=99.27% 00:19:48.936 nvme0n4: ios=3038/3072, merge=0/0, ticks=37369/38534, in_queue=75903, util=99.06% 00:19:48.936 16:06:12 -- target/fio.sh@55 -- # sync 00:19:48.936 16:06:12 -- target/fio.sh@59 -- # fio_pid=1602662 00:19:48.936 16:06:12 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:48.936 16:06:12 -- target/fio.sh@61 -- # sleep 3 00:19:48.936 [global] 00:19:48.936 thread=1 00:19:48.936 invalidate=1 00:19:48.936 rw=read 00:19:48.936 time_based=1 00:19:48.936 runtime=10 00:19:48.936 ioengine=libaio 00:19:48.936 direct=1 00:19:48.936 bs=4096 00:19:48.936 iodepth=1 00:19:48.936 norandommap=1 00:19:48.936 numjobs=1 00:19:48.936 00:19:48.936 [job0] 00:19:48.936 filename=/dev/nvme0n1 00:19:48.936 [job1] 00:19:48.936 filename=/dev/nvme0n2 00:19:48.936 [job2] 00:19:48.936 filename=/dev/nvme0n3 00:19:48.936 [job3] 00:19:48.936 filename=/dev/nvme0n4 00:19:48.936 Could not set queue depth (nvme0n1) 00:19:48.936 Could not set queue depth (nvme0n2) 00:19:48.936 Could not set queue depth (nvme0n3) 00:19:48.936 Could not set queue depth (nvme0n4) 00:19:49.194 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:49.194 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:49.194 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:49.194 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:49.194 fio-3.35 00:19:49.194 Starting 4 threads 00:19:52.473 16:06:15 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:52.473 16:06:15 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:52.473 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=290816, buflen=4096 00:19:52.473 fio: pid=1602753, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:52.473 16:06:15 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:52.473 16:06:15 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:52.473 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=45170688, buflen=4096 00:19:52.473 fio: pid=1602752, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:52.731 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=9719808, buflen=4096 00:19:52.731 fio: pid=1602750, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:52.731 16:06:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:52.731 16:06:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:52.990 16:06:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:52.990 16:06:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:52.990 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=372736, buflen=4096 00:19:52.990 fio: pid=1602751, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:52.990 00:19:52.990 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1602750: Mon Nov 18 16:06:16 2024 00:19:52.990 read: IOPS=691, BW=2766KiB/s (2832kB/s)(9492KiB/3432msec) 00:19:52.990 slat (usec): min=5, max=16836, avg=24.47, stdev=441.08 00:19:52.990 clat (usec): min=167, max=42085, avg=1409.84, stdev=6775.06 00:19:52.990 lat (usec): min=173, max=42101, avg=1434.32, stdev=6789.53 00:19:52.990 clat percentiles (usec): 00:19:52.990 | 1.00th=[ 178], 5.00th=[ 186], 10.00th=[ 192], 20.00th=[ 200], 00:19:52.990 | 30.00th=[ 208], 40.00th=[ 215], 50.00th=[ 229], 60.00th=[ 247], 00:19:52.990 | 70.00th=[ 258], 80.00th=[ 273], 90.00th=[ 396], 95.00th=[ 474], 00:19:52.990 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:52.990 | 99.99th=[42206] 00:19:52.990 bw ( KiB/s): min= 96, max= 5920, per=7.40%, avg=1078.67, stdev=2371.83, samples=6 00:19:52.990 iops : min= 24, max= 1480, avg=269.67, stdev=592.96, samples=6 00:19:52.990 lat (usec) : 250=62.59%, 500=33.02%, 750=1.31%, 1000=0.04% 00:19:52.990 lat (msec) : 2=0.13%, 50=2.86% 00:19:52.990 cpu : usr=0.26%, sys=0.90%, ctx=2381, majf=0, minf=1 00:19:52.990 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:52.990 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.990 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.990 issued rwts: total=2374,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.990 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:52.990 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1602751: Mon Nov 18 16:06:16 2024 00:19:52.990 read: IOPS=24, BW=97.8KiB/s (100kB/s)(364KiB/3723msec) 00:19:52.990 slat (usec): min=11, max=16918, avg=321.79, stdev=2079.91 00:19:52.990 clat (usec): min=240, max=42085, avg=40320.73, stdev=6046.56 00:19:52.990 lat (usec): min=257, max=58993, avg=40527.23, stdev=6352.55 00:19:52.990 clat percentiles (usec): 00:19:52.990 | 1.00th=[ 241], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:52.990 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:52.990 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:19:52.990 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:52.990 | 99.99th=[42206] 00:19:52.990 bw ( KiB/s): min= 86, max= 104, per=0.67%, avg=98.00, stdev= 6.63, samples=7 00:19:52.990 iops : min= 21, max= 26, avg=24.43, stdev= 1.81, samples=7 00:19:52.990 lat (usec) : 250=1.09%, 500=1.09% 00:19:52.990 lat (msec) : 50=96.74% 00:19:52.990 cpu : usr=0.11%, sys=0.00%, ctx=95, majf=0, minf=2 00:19:52.990 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:52.990 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.990 complete : 0=1.1%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.990 issued rwts: total=92,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.990 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:52.990 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1602752: Mon Nov 18 16:06:16 2024 00:19:52.990 read: IOPS=3469, BW=13.6MiB/s (14.2MB/s)(43.1MiB/3179msec) 00:19:52.990 slat (nsec): min=5579, max=59362, avg=12188.35, stdev=6560.14 00:19:52.990 clat (usec): min=182, max=41935, avg=270.99, stdev=954.81 00:19:52.990 lat (usec): min=188, max=41944, avg=283.18, stdev=954.96 00:19:52.990 clat percentiles (usec): 00:19:52.990 | 1.00th=[ 194], 5.00th=[ 200], 10.00th=[ 206], 20.00th=[ 215], 00:19:52.990 | 30.00th=[ 229], 40.00th=[ 237], 50.00th=[ 241], 60.00th=[ 247], 00:19:52.990 | 70.00th=[ 253], 80.00th=[ 260], 90.00th=[ 273], 95.00th=[ 293], 00:19:52.990 | 99.00th=[ 562], 99.50th=[ 594], 99.90th=[ 1012], 99.95th=[40633], 00:19:52.990 | 99.99th=[41157] 00:19:52.990 bw ( KiB/s): min=13160, max=17392, per=100.00%, avg=14697.33, stdev=1604.84, samples=6 00:19:52.990 iops : min= 3290, max= 4348, avg=3674.33, stdev=401.21, samples=6 00:19:52.990 lat (usec) : 250=66.53%, 500=31.72%, 750=1.50%, 1000=0.14% 00:19:52.990 lat (msec) : 2=0.05%, 4=0.01%, 50=0.05% 00:19:52.990 cpu : usr=2.58%, sys=6.45%, ctx=11030, majf=0, minf=2 00:19:52.990 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:52.990 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.990 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.990 issued rwts: total=11029,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.990 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:52.990 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1602753: Mon Nov 18 16:06:16 2024 00:19:52.990 read: IOPS=24, BW=96.3KiB/s (98.6kB/s)(284KiB/2949msec) 00:19:52.990 slat (nsec): min=12173, max=33408, avg=21517.12, stdev=9158.61 00:19:52.990 clat (usec): min=40917, max=43976, avg=41103.13, stdev=445.07 00:19:52.990 lat (usec): min=40930, max=43994, avg=41124.77, stdev=446.19 00:19:52.990 clat percentiles (usec): 00:19:52.990 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:52.990 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:52.990 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:19:52.990 | 99.00th=[43779], 99.50th=[43779], 99.90th=[43779], 99.95th=[43779], 00:19:52.990 | 99.99th=[43779] 00:19:52.990 bw ( KiB/s): min= 96, max= 96, per=0.66%, avg=96.00, stdev= 0.00, samples=5 00:19:52.990 iops : min= 24, max= 24, avg=24.00, stdev= 0.00, samples=5 00:19:52.990 lat (msec) : 50=98.61% 00:19:52.990 cpu : usr=0.10%, sys=0.00%, ctx=72, majf=0, minf=1 00:19:52.990 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:52.990 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.990 complete : 0=1.4%, 4=98.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.990 issued rwts: total=72,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.990 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:52.990 00:19:52.990 Run status group 0 (all jobs): 00:19:52.990 READ: bw=14.2MiB/s (14.9MB/s), 96.3KiB/s-13.6MiB/s (98.6kB/s-14.2MB/s), io=53.0MiB (55.6MB), run=2949-3723msec 00:19:52.990 00:19:52.990 Disk stats (read/write): 00:19:52.990 nvme0n1: ios=2209/0, merge=0/0, ticks=3497/0, in_queue=3497, util=98.23% 00:19:52.990 nvme0n2: ios=88/0, merge=0/0, ticks=3548/0, in_queue=3548, util=96.20% 00:19:52.990 nvme0n3: ios=11074/0, merge=0/0, ticks=3831/0, in_queue=3831, util=98.91% 00:19:52.990 nvme0n4: ios=69/0, merge=0/0, ticks=2839/0, in_queue=2839, util=96.75% 00:19:53.248 16:06:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:53.248 16:06:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:53.506 16:06:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:53.506 16:06:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:53.764 16:06:17 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:53.764 16:06:17 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:54.025 16:06:17 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:54.025 16:06:17 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:54.282 16:06:17 -- target/fio.sh@69 -- # fio_status=0 00:19:54.282 16:06:17 -- target/fio.sh@70 -- # wait 1602662 00:19:54.282 16:06:17 -- target/fio.sh@70 -- # fio_status=4 00:19:54.282 16:06:17 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:54.282 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:54.282 16:06:17 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:54.282 16:06:17 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.282 16:06:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.282 16:06:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:54.540 16:06:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.540 16:06:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:54.540 16:06:17 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.540 16:06:17 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:54.540 16:06:17 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:54.540 nvmf hotplug test: fio failed as expected 00:19:54.540 16:06:17 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:54.540 16:06:18 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:54.540 16:06:18 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:54.540 16:06:18 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:54.798 16:06:18 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:54.798 16:06:18 -- target/fio.sh@91 -- # nvmftestfini 00:19:54.798 16:06:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:54.798 16:06:18 -- nvmf/common.sh@116 -- # sync 00:19:54.798 16:06:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:54.798 16:06:18 -- nvmf/common.sh@119 -- # set +e 00:19:54.798 16:06:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:54.798 16:06:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:54.798 rmmod nvme_tcp 00:19:54.798 rmmod nvme_fabrics 00:19:54.798 rmmod nvme_keyring 00:19:54.798 16:06:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:54.798 16:06:18 -- nvmf/common.sh@123 -- # set -e 00:19:54.798 16:06:18 -- nvmf/common.sh@124 -- # return 0 00:19:54.798 16:06:18 -- nvmf/common.sh@477 -- # '[' -n 1599833 ']' 00:19:54.798 16:06:18 -- nvmf/common.sh@478 -- # killprocess 1599833 00:19:54.798 16:06:18 -- common/autotest_common.sh@936 -- # '[' -z 1599833 ']' 00:19:54.798 16:06:18 -- common/autotest_common.sh@940 -- # kill -0 1599833 00:19:54.798 16:06:18 -- common/autotest_common.sh@941 -- # uname 00:19:54.798 16:06:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:54.798 16:06:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1599833 00:19:54.798 16:06:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:54.798 16:06:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:54.798 16:06:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1599833' 00:19:54.798 killing process with pid 1599833 00:19:54.798 16:06:18 -- common/autotest_common.sh@955 -- # kill 1599833 00:19:54.798 16:06:18 -- common/autotest_common.sh@960 -- # wait 1599833 00:19:55.057 16:06:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:55.057 16:06:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:55.057 16:06:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:55.057 16:06:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:55.057 16:06:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:55.057 16:06:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:55.057 16:06:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:55.057 16:06:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:56.959 16:06:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:56.959 00:19:56.959 real 0m24.679s 00:19:56.959 user 1m26.103s 00:19:56.959 sys 0m6.985s 00:19:56.959 16:06:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:56.959 16:06:20 -- common/autotest_common.sh@10 -- # set +x 00:19:56.959 ************************************ 00:19:56.959 END TEST nvmf_fio_target 00:19:56.959 ************************************ 00:19:56.959 16:06:20 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:56.959 16:06:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:56.959 16:06:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:56.959 16:06:20 -- common/autotest_common.sh@10 -- # set +x 00:19:56.959 ************************************ 00:19:56.959 START TEST nvmf_bdevio 00:19:56.959 ************************************ 00:19:56.959 16:06:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:57.217 * Looking for test storage... 00:19:57.217 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:57.217 16:06:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:57.217 16:06:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:57.217 16:06:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:57.217 16:06:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:57.217 16:06:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:57.217 16:06:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:57.217 16:06:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:57.217 16:06:20 -- scripts/common.sh@335 -- # IFS=.-: 00:19:57.217 16:06:20 -- scripts/common.sh@335 -- # read -ra ver1 00:19:57.217 16:06:20 -- scripts/common.sh@336 -- # IFS=.-: 00:19:57.217 16:06:20 -- scripts/common.sh@336 -- # read -ra ver2 00:19:57.217 16:06:20 -- scripts/common.sh@337 -- # local 'op=<' 00:19:57.217 16:06:20 -- scripts/common.sh@339 -- # ver1_l=2 00:19:57.217 16:06:20 -- scripts/common.sh@340 -- # ver2_l=1 00:19:57.217 16:06:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:57.217 16:06:20 -- scripts/common.sh@343 -- # case "$op" in 00:19:57.217 16:06:20 -- scripts/common.sh@344 -- # : 1 00:19:57.217 16:06:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:57.217 16:06:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:57.217 16:06:20 -- scripts/common.sh@364 -- # decimal 1 00:19:57.217 16:06:20 -- scripts/common.sh@352 -- # local d=1 00:19:57.217 16:06:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:57.217 16:06:20 -- scripts/common.sh@354 -- # echo 1 00:19:57.217 16:06:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:57.217 16:06:20 -- scripts/common.sh@365 -- # decimal 2 00:19:57.217 16:06:20 -- scripts/common.sh@352 -- # local d=2 00:19:57.217 16:06:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:57.217 16:06:20 -- scripts/common.sh@354 -- # echo 2 00:19:57.217 16:06:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:57.217 16:06:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:57.217 16:06:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:57.217 16:06:20 -- scripts/common.sh@367 -- # return 0 00:19:57.217 16:06:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:57.217 16:06:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:57.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.217 --rc genhtml_branch_coverage=1 00:19:57.217 --rc genhtml_function_coverage=1 00:19:57.217 --rc genhtml_legend=1 00:19:57.217 --rc geninfo_all_blocks=1 00:19:57.217 --rc geninfo_unexecuted_blocks=1 00:19:57.217 00:19:57.217 ' 00:19:57.217 16:06:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:57.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.217 --rc genhtml_branch_coverage=1 00:19:57.217 --rc genhtml_function_coverage=1 00:19:57.217 --rc genhtml_legend=1 00:19:57.217 --rc geninfo_all_blocks=1 00:19:57.217 --rc geninfo_unexecuted_blocks=1 00:19:57.217 00:19:57.217 ' 00:19:57.217 16:06:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:57.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.217 --rc genhtml_branch_coverage=1 00:19:57.217 --rc genhtml_function_coverage=1 00:19:57.217 --rc genhtml_legend=1 00:19:57.217 --rc geninfo_all_blocks=1 00:19:57.217 --rc geninfo_unexecuted_blocks=1 00:19:57.217 00:19:57.217 ' 00:19:57.217 16:06:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:57.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.217 --rc genhtml_branch_coverage=1 00:19:57.217 --rc genhtml_function_coverage=1 00:19:57.217 --rc genhtml_legend=1 00:19:57.217 --rc geninfo_all_blocks=1 00:19:57.217 --rc geninfo_unexecuted_blocks=1 00:19:57.217 00:19:57.217 ' 00:19:57.217 16:06:20 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:57.217 16:06:20 -- nvmf/common.sh@7 -- # uname -s 00:19:57.217 16:06:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:57.217 16:06:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:57.218 16:06:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:57.218 16:06:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:57.218 16:06:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:57.218 16:06:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:57.218 16:06:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:57.218 16:06:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:57.218 16:06:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:57.218 16:06:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:57.218 16:06:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:57.218 16:06:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:57.218 16:06:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:57.218 16:06:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:57.218 16:06:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:57.218 16:06:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:57.218 16:06:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:57.218 16:06:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:57.218 16:06:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:57.218 16:06:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.218 16:06:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.218 16:06:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.218 16:06:20 -- paths/export.sh@5 -- # export PATH 00:19:57.218 16:06:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.218 16:06:20 -- nvmf/common.sh@46 -- # : 0 00:19:57.218 16:06:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:57.218 16:06:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:57.218 16:06:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:57.218 16:06:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:57.218 16:06:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:57.218 16:06:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:57.218 16:06:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:57.218 16:06:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:57.218 16:06:20 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:57.218 16:06:20 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:57.218 16:06:20 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:57.218 16:06:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:57.218 16:06:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:57.218 16:06:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:57.218 16:06:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:57.218 16:06:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:57.218 16:06:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:57.218 16:06:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:57.218 16:06:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:57.218 16:06:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:57.218 16:06:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:57.218 16:06:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:57.218 16:06:20 -- common/autotest_common.sh@10 -- # set +x 00:19:59.747 16:06:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:59.747 16:06:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:59.747 16:06:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:59.747 16:06:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:59.747 16:06:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:59.747 16:06:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:59.747 16:06:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:59.747 16:06:22 -- nvmf/common.sh@294 -- # net_devs=() 00:19:59.747 16:06:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:59.747 16:06:22 -- nvmf/common.sh@295 -- # e810=() 00:19:59.747 16:06:22 -- nvmf/common.sh@295 -- # local -ga e810 00:19:59.747 16:06:22 -- nvmf/common.sh@296 -- # x722=() 00:19:59.747 16:06:22 -- nvmf/common.sh@296 -- # local -ga x722 00:19:59.747 16:06:22 -- nvmf/common.sh@297 -- # mlx=() 00:19:59.747 16:06:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:59.747 16:06:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:59.747 16:06:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:59.747 16:06:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:59.747 16:06:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:59.747 16:06:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:59.747 16:06:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:59.747 16:06:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:59.747 16:06:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:59.747 16:06:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:59.747 16:06:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:59.747 16:06:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:59.747 16:06:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:59.747 16:06:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:59.747 16:06:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:59.747 16:06:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:59.747 16:06:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:59.747 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:59.747 16:06:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:59.747 16:06:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:59.747 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:59.747 16:06:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:59.747 16:06:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:59.747 16:06:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:59.747 16:06:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:59.747 16:06:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:59.747 16:06:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:59.747 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:59.747 16:06:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:59.747 16:06:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:59.747 16:06:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:59.747 16:06:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:59.747 16:06:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:59.747 16:06:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:59.747 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:59.747 16:06:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:59.747 16:06:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:59.747 16:06:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:59.747 16:06:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:59.747 16:06:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:59.747 16:06:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:59.747 16:06:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:59.747 16:06:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:59.747 16:06:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:59.747 16:06:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:59.747 16:06:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:59.747 16:06:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:59.747 16:06:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:59.747 16:06:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:59.747 16:06:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:59.747 16:06:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:59.747 16:06:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:59.747 16:06:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:59.747 16:06:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:59.747 16:06:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:59.747 16:06:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:59.747 16:06:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:59.747 16:06:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:59.747 16:06:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:59.747 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:59.747 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.264 ms 00:19:59.747 00:19:59.747 --- 10.0.0.2 ping statistics --- 00:19:59.747 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:59.747 rtt min/avg/max/mdev = 0.264/0.264/0.264/0.000 ms 00:19:59.747 16:06:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:59.747 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:59.747 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.149 ms 00:19:59.747 00:19:59.747 --- 10.0.0.1 ping statistics --- 00:19:59.747 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:59.747 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:19:59.747 16:06:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:59.747 16:06:22 -- nvmf/common.sh@410 -- # return 0 00:19:59.747 16:06:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:59.747 16:06:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:59.747 16:06:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:59.747 16:06:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:59.747 16:06:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:59.747 16:06:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:59.747 16:06:22 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:59.747 16:06:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:59.747 16:06:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:59.747 16:06:22 -- common/autotest_common.sh@10 -- # set +x 00:19:59.747 16:06:22 -- nvmf/common.sh@469 -- # nvmfpid=1605412 00:19:59.747 16:06:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:59.747 16:06:22 -- nvmf/common.sh@470 -- # waitforlisten 1605412 00:19:59.747 16:06:22 -- common/autotest_common.sh@829 -- # '[' -z 1605412 ']' 00:19:59.747 16:06:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:59.747 16:06:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:59.747 16:06:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:59.747 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:59.747 16:06:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:59.747 16:06:22 -- common/autotest_common.sh@10 -- # set +x 00:19:59.747 [2024-11-18 16:06:22.944199] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:59.747 [2024-11-18 16:06:22.944286] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:59.747 EAL: No free 2048 kB hugepages reported on node 1 00:19:59.747 [2024-11-18 16:06:23.014776] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:59.747 [2024-11-18 16:06:23.111346] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:59.748 [2024-11-18 16:06:23.111509] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:59.748 [2024-11-18 16:06:23.111529] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:59.748 [2024-11-18 16:06:23.111554] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:59.748 [2024-11-18 16:06:23.111642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:59.748 [2024-11-18 16:06:23.111700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:59.748 [2024-11-18 16:06:23.111756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:59.748 [2024-11-18 16:06:23.111758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:00.681 16:06:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:00.681 16:06:23 -- common/autotest_common.sh@862 -- # return 0 00:20:00.681 16:06:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:00.681 16:06:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:00.681 16:06:23 -- common/autotest_common.sh@10 -- # set +x 00:20:00.681 16:06:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:00.681 16:06:23 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:00.681 16:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.681 16:06:23 -- common/autotest_common.sh@10 -- # set +x 00:20:00.681 [2024-11-18 16:06:23.974321] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:00.681 16:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.681 16:06:23 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:00.681 16:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.681 16:06:23 -- common/autotest_common.sh@10 -- # set +x 00:20:00.681 Malloc0 00:20:00.681 16:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.681 16:06:24 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:00.681 16:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.681 16:06:24 -- common/autotest_common.sh@10 -- # set +x 00:20:00.681 16:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.681 16:06:24 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:00.681 16:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.681 16:06:24 -- common/autotest_common.sh@10 -- # set +x 00:20:00.681 16:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.681 16:06:24 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:00.681 16:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.681 16:06:24 -- common/autotest_common.sh@10 -- # set +x 00:20:00.681 [2024-11-18 16:06:24.025362] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:00.681 16:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.681 16:06:24 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:20:00.681 16:06:24 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:00.681 16:06:24 -- nvmf/common.sh@520 -- # config=() 00:20:00.681 16:06:24 -- nvmf/common.sh@520 -- # local subsystem config 00:20:00.681 16:06:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:00.681 16:06:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:00.681 { 00:20:00.681 "params": { 00:20:00.681 "name": "Nvme$subsystem", 00:20:00.681 "trtype": "$TEST_TRANSPORT", 00:20:00.681 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:00.681 "adrfam": "ipv4", 00:20:00.681 "trsvcid": "$NVMF_PORT", 00:20:00.682 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:00.682 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:00.682 "hdgst": ${hdgst:-false}, 00:20:00.682 "ddgst": ${ddgst:-false} 00:20:00.682 }, 00:20:00.682 "method": "bdev_nvme_attach_controller" 00:20:00.682 } 00:20:00.682 EOF 00:20:00.682 )") 00:20:00.682 16:06:24 -- nvmf/common.sh@542 -- # cat 00:20:00.682 16:06:24 -- nvmf/common.sh@544 -- # jq . 00:20:00.682 16:06:24 -- nvmf/common.sh@545 -- # IFS=, 00:20:00.682 16:06:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:00.682 "params": { 00:20:00.682 "name": "Nvme1", 00:20:00.682 "trtype": "tcp", 00:20:00.682 "traddr": "10.0.0.2", 00:20:00.682 "adrfam": "ipv4", 00:20:00.682 "trsvcid": "4420", 00:20:00.682 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:00.682 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:00.682 "hdgst": false, 00:20:00.682 "ddgst": false 00:20:00.682 }, 00:20:00.682 "method": "bdev_nvme_attach_controller" 00:20:00.682 }' 00:20:00.682 [2024-11-18 16:06:24.065948] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:00.682 [2024-11-18 16:06:24.066030] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1605573 ] 00:20:00.682 EAL: No free 2048 kB hugepages reported on node 1 00:20:00.682 [2024-11-18 16:06:24.127032] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:00.682 [2024-11-18 16:06:24.213938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:00.682 [2024-11-18 16:06:24.213989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:00.682 [2024-11-18 16:06:24.213991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:00.940 [2024-11-18 16:06:24.506079] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:00.940 [2024-11-18 16:06:24.506127] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:00.940 I/O targets: 00:20:00.940 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:00.940 00:20:00.940 00:20:00.940 CUnit - A unit testing framework for C - Version 2.1-3 00:20:00.940 http://cunit.sourceforge.net/ 00:20:00.940 00:20:00.940 00:20:00.940 Suite: bdevio tests on: Nvme1n1 00:20:01.197 Test: blockdev write read block ...passed 00:20:01.197 Test: blockdev write zeroes read block ...passed 00:20:01.197 Test: blockdev write zeroes read no split ...passed 00:20:01.197 Test: blockdev write zeroes read split ...passed 00:20:01.197 Test: blockdev write zeroes read split partial ...passed 00:20:01.197 Test: blockdev reset ...[2024-11-18 16:06:24.706640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:01.197 [2024-11-18 16:06:24.706753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22d5670 (9): Bad file descriptor 00:20:01.197 [2024-11-18 16:06:24.727437] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:01.197 passed 00:20:01.197 Test: blockdev write read 8 blocks ...passed 00:20:01.197 Test: blockdev write read size > 128k ...passed 00:20:01.197 Test: blockdev write read invalid size ...passed 00:20:01.454 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:01.454 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:01.454 Test: blockdev write read max offset ...passed 00:20:01.454 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:01.454 Test: blockdev writev readv 8 blocks ...passed 00:20:01.454 Test: blockdev writev readv 30 x 1block ...passed 00:20:01.454 Test: blockdev writev readv block ...passed 00:20:01.454 Test: blockdev writev readv size > 128k ...passed 00:20:01.454 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:01.454 Test: blockdev comparev and writev ...[2024-11-18 16:06:24.984131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.454 [2024-11-18 16:06:24.984169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:01.454 [2024-11-18 16:06:24.984192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.454 [2024-11-18 16:06:24.984210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:01.454 [2024-11-18 16:06:24.984544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.454 [2024-11-18 16:06:24.984568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:01.454 [2024-11-18 16:06:24.984590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.454 [2024-11-18 16:06:24.984605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:01.454 [2024-11-18 16:06:24.984933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.454 [2024-11-18 16:06:24.984957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:01.454 [2024-11-18 16:06:24.984978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.454 [2024-11-18 16:06:24.985004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:01.454 [2024-11-18 16:06:24.985330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.454 [2024-11-18 16:06:24.985353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:01.454 [2024-11-18 16:06:24.985374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:01.455 [2024-11-18 16:06:24.985390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:01.455 passed 00:20:01.712 Test: blockdev nvme passthru rw ...passed 00:20:01.712 Test: blockdev nvme passthru vendor specific ...[2024-11-18 16:06:25.068904] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:01.712 [2024-11-18 16:06:25.068931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:01.712 [2024-11-18 16:06:25.069066] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:01.712 [2024-11-18 16:06:25.069088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:01.712 [2024-11-18 16:06:25.069223] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:01.712 [2024-11-18 16:06:25.069245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:01.712 [2024-11-18 16:06:25.069376] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:01.712 [2024-11-18 16:06:25.069398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:01.712 passed 00:20:01.712 Test: blockdev nvme admin passthru ...passed 00:20:01.712 Test: blockdev copy ...passed 00:20:01.712 00:20:01.712 Run Summary: Type Total Ran Passed Failed Inactive 00:20:01.712 suites 1 1 n/a 0 0 00:20:01.712 tests 23 23 23 0 0 00:20:01.712 asserts 152 152 152 0 n/a 00:20:01.712 00:20:01.712 Elapsed time = 1.245 seconds 00:20:01.971 16:06:25 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:01.971 16:06:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:01.971 16:06:25 -- common/autotest_common.sh@10 -- # set +x 00:20:01.971 16:06:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:01.971 16:06:25 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:01.971 16:06:25 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:01.971 16:06:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:01.971 16:06:25 -- nvmf/common.sh@116 -- # sync 00:20:01.971 16:06:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:01.971 16:06:25 -- nvmf/common.sh@119 -- # set +e 00:20:01.971 16:06:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:01.971 16:06:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:01.971 rmmod nvme_tcp 00:20:01.971 rmmod nvme_fabrics 00:20:01.971 rmmod nvme_keyring 00:20:01.971 16:06:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:01.971 16:06:25 -- nvmf/common.sh@123 -- # set -e 00:20:01.971 16:06:25 -- nvmf/common.sh@124 -- # return 0 00:20:01.971 16:06:25 -- nvmf/common.sh@477 -- # '[' -n 1605412 ']' 00:20:01.971 16:06:25 -- nvmf/common.sh@478 -- # killprocess 1605412 00:20:01.971 16:06:25 -- common/autotest_common.sh@936 -- # '[' -z 1605412 ']' 00:20:01.971 16:06:25 -- common/autotest_common.sh@940 -- # kill -0 1605412 00:20:01.971 16:06:25 -- common/autotest_common.sh@941 -- # uname 00:20:01.971 16:06:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:01.971 16:06:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1605412 00:20:01.971 16:06:25 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:01.971 16:06:25 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:01.971 16:06:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1605412' 00:20:01.971 killing process with pid 1605412 00:20:01.971 16:06:25 -- common/autotest_common.sh@955 -- # kill 1605412 00:20:01.971 16:06:25 -- common/autotest_common.sh@960 -- # wait 1605412 00:20:02.230 16:06:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:02.230 16:06:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:02.230 16:06:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:02.230 16:06:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:02.230 16:06:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:02.230 16:06:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:02.230 16:06:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:02.230 16:06:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:04.130 16:06:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:04.130 00:20:04.130 real 0m7.144s 00:20:04.130 user 0m13.609s 00:20:04.130 sys 0m2.131s 00:20:04.130 16:06:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:04.130 16:06:27 -- common/autotest_common.sh@10 -- # set +x 00:20:04.130 ************************************ 00:20:04.130 END TEST nvmf_bdevio 00:20:04.130 ************************************ 00:20:04.389 16:06:27 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:20:04.389 16:06:27 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:04.389 16:06:27 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:20:04.389 16:06:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:04.389 16:06:27 -- common/autotest_common.sh@10 -- # set +x 00:20:04.389 ************************************ 00:20:04.389 START TEST nvmf_bdevio_no_huge 00:20:04.389 ************************************ 00:20:04.389 16:06:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:20:04.389 * Looking for test storage... 00:20:04.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:04.389 16:06:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:04.389 16:06:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:04.389 16:06:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:04.389 16:06:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:04.389 16:06:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:04.389 16:06:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:04.389 16:06:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:04.389 16:06:27 -- scripts/common.sh@335 -- # IFS=.-: 00:20:04.389 16:06:27 -- scripts/common.sh@335 -- # read -ra ver1 00:20:04.389 16:06:27 -- scripts/common.sh@336 -- # IFS=.-: 00:20:04.389 16:06:27 -- scripts/common.sh@336 -- # read -ra ver2 00:20:04.389 16:06:27 -- scripts/common.sh@337 -- # local 'op=<' 00:20:04.389 16:06:27 -- scripts/common.sh@339 -- # ver1_l=2 00:20:04.389 16:06:27 -- scripts/common.sh@340 -- # ver2_l=1 00:20:04.389 16:06:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:04.389 16:06:27 -- scripts/common.sh@343 -- # case "$op" in 00:20:04.389 16:06:27 -- scripts/common.sh@344 -- # : 1 00:20:04.389 16:06:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:04.389 16:06:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:04.389 16:06:27 -- scripts/common.sh@364 -- # decimal 1 00:20:04.389 16:06:27 -- scripts/common.sh@352 -- # local d=1 00:20:04.389 16:06:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:04.389 16:06:27 -- scripts/common.sh@354 -- # echo 1 00:20:04.389 16:06:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:04.389 16:06:27 -- scripts/common.sh@365 -- # decimal 2 00:20:04.389 16:06:27 -- scripts/common.sh@352 -- # local d=2 00:20:04.389 16:06:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:04.389 16:06:27 -- scripts/common.sh@354 -- # echo 2 00:20:04.389 16:06:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:04.389 16:06:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:04.389 16:06:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:04.389 16:06:27 -- scripts/common.sh@367 -- # return 0 00:20:04.389 16:06:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:04.389 16:06:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:04.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.389 --rc genhtml_branch_coverage=1 00:20:04.389 --rc genhtml_function_coverage=1 00:20:04.389 --rc genhtml_legend=1 00:20:04.389 --rc geninfo_all_blocks=1 00:20:04.389 --rc geninfo_unexecuted_blocks=1 00:20:04.389 00:20:04.389 ' 00:20:04.389 16:06:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:04.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.389 --rc genhtml_branch_coverage=1 00:20:04.389 --rc genhtml_function_coverage=1 00:20:04.389 --rc genhtml_legend=1 00:20:04.389 --rc geninfo_all_blocks=1 00:20:04.389 --rc geninfo_unexecuted_blocks=1 00:20:04.389 00:20:04.389 ' 00:20:04.389 16:06:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:04.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.389 --rc genhtml_branch_coverage=1 00:20:04.389 --rc genhtml_function_coverage=1 00:20:04.389 --rc genhtml_legend=1 00:20:04.389 --rc geninfo_all_blocks=1 00:20:04.389 --rc geninfo_unexecuted_blocks=1 00:20:04.389 00:20:04.389 ' 00:20:04.389 16:06:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:04.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.389 --rc genhtml_branch_coverage=1 00:20:04.389 --rc genhtml_function_coverage=1 00:20:04.389 --rc genhtml_legend=1 00:20:04.389 --rc geninfo_all_blocks=1 00:20:04.389 --rc geninfo_unexecuted_blocks=1 00:20:04.389 00:20:04.389 ' 00:20:04.389 16:06:27 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:04.389 16:06:27 -- nvmf/common.sh@7 -- # uname -s 00:20:04.389 16:06:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:04.389 16:06:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:04.389 16:06:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:04.389 16:06:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:04.389 16:06:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:04.389 16:06:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:04.389 16:06:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:04.389 16:06:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:04.389 16:06:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:04.389 16:06:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:04.390 16:06:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:04.390 16:06:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:04.390 16:06:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:04.390 16:06:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:04.390 16:06:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:04.390 16:06:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:04.390 16:06:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:04.390 16:06:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:04.390 16:06:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:04.390 16:06:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.390 16:06:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.390 16:06:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.390 16:06:27 -- paths/export.sh@5 -- # export PATH 00:20:04.390 16:06:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.390 16:06:27 -- nvmf/common.sh@46 -- # : 0 00:20:04.390 16:06:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:04.390 16:06:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:04.390 16:06:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:04.390 16:06:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:04.390 16:06:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:04.390 16:06:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:04.390 16:06:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:04.390 16:06:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:04.390 16:06:27 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:04.390 16:06:27 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:04.390 16:06:27 -- target/bdevio.sh@14 -- # nvmftestinit 00:20:04.390 16:06:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:04.390 16:06:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:04.390 16:06:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:04.390 16:06:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:04.390 16:06:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:04.390 16:06:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:04.390 16:06:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:04.390 16:06:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:04.390 16:06:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:04.390 16:06:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:04.390 16:06:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:04.390 16:06:27 -- common/autotest_common.sh@10 -- # set +x 00:20:06.304 16:06:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:06.304 16:06:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:06.304 16:06:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:06.304 16:06:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:06.304 16:06:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:06.304 16:06:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:06.304 16:06:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:06.304 16:06:29 -- nvmf/common.sh@294 -- # net_devs=() 00:20:06.304 16:06:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:06.304 16:06:29 -- nvmf/common.sh@295 -- # e810=() 00:20:06.304 16:06:29 -- nvmf/common.sh@295 -- # local -ga e810 00:20:06.304 16:06:29 -- nvmf/common.sh@296 -- # x722=() 00:20:06.304 16:06:29 -- nvmf/common.sh@296 -- # local -ga x722 00:20:06.304 16:06:29 -- nvmf/common.sh@297 -- # mlx=() 00:20:06.304 16:06:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:06.304 16:06:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:06.304 16:06:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:06.304 16:06:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:06.304 16:06:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:06.304 16:06:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:06.304 16:06:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:06.304 16:06:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:06.304 16:06:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:06.304 16:06:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:06.304 16:06:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:06.304 16:06:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:06.304 16:06:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:06.304 16:06:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:06.304 16:06:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:06.304 16:06:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:06.304 16:06:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:06.304 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:06.304 16:06:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:06.304 16:06:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:06.304 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:06.304 16:06:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:06.304 16:06:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:06.304 16:06:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:06.305 16:06:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:06.305 16:06:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:06.305 16:06:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:06.305 16:06:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:06.305 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:06.305 16:06:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:06.305 16:06:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:06.305 16:06:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:06.305 16:06:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:06.305 16:06:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:06.305 16:06:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:06.305 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:06.305 16:06:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:06.305 16:06:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:06.305 16:06:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:06.305 16:06:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:06.305 16:06:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:06.305 16:06:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:06.305 16:06:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:06.305 16:06:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:06.305 16:06:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:06.305 16:06:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:06.305 16:06:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:06.305 16:06:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:06.305 16:06:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:06.305 16:06:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:06.305 16:06:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:06.305 16:06:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:06.305 16:06:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:06.305 16:06:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:06.305 16:06:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:06.305 16:06:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:06.305 16:06:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:06.562 16:06:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:06.562 16:06:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:06.562 16:06:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:06.562 16:06:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:06.562 16:06:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:06.562 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:06.562 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:20:06.562 00:20:06.562 --- 10.0.0.2 ping statistics --- 00:20:06.562 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:06.562 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:20:06.563 16:06:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:06.563 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:06.563 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:20:06.563 00:20:06.563 --- 10.0.0.1 ping statistics --- 00:20:06.563 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:06.563 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:20:06.563 16:06:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:06.563 16:06:29 -- nvmf/common.sh@410 -- # return 0 00:20:06.563 16:06:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:06.563 16:06:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:06.563 16:06:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:06.563 16:06:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:06.563 16:06:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:06.563 16:06:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:06.563 16:06:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:06.563 16:06:29 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:20:06.563 16:06:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:06.563 16:06:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:06.563 16:06:29 -- common/autotest_common.sh@10 -- # set +x 00:20:06.563 16:06:29 -- nvmf/common.sh@469 -- # nvmfpid=1607661 00:20:06.563 16:06:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:20:06.563 16:06:29 -- nvmf/common.sh@470 -- # waitforlisten 1607661 00:20:06.563 16:06:29 -- common/autotest_common.sh@829 -- # '[' -z 1607661 ']' 00:20:06.563 16:06:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:06.563 16:06:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:06.563 16:06:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:06.563 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:06.563 16:06:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:06.563 16:06:29 -- common/autotest_common.sh@10 -- # set +x 00:20:06.563 [2024-11-18 16:06:30.038303] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:06.563 [2024-11-18 16:06:30.038420] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:20:06.563 [2024-11-18 16:06:30.110811] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:06.821 [2024-11-18 16:06:30.196199] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:06.821 [2024-11-18 16:06:30.196365] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:06.821 [2024-11-18 16:06:30.196383] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:06.821 [2024-11-18 16:06:30.196397] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:06.821 [2024-11-18 16:06:30.196482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:06.821 [2024-11-18 16:06:30.198629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:20:06.821 [2024-11-18 16:06:30.198704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:20:06.821 [2024-11-18 16:06:30.202623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:06.821 16:06:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:06.821 16:06:30 -- common/autotest_common.sh@862 -- # return 0 00:20:06.821 16:06:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:06.821 16:06:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:06.821 16:06:30 -- common/autotest_common.sh@10 -- # set +x 00:20:06.821 16:06:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:06.821 16:06:30 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:06.821 16:06:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.821 16:06:30 -- common/autotest_common.sh@10 -- # set +x 00:20:06.821 [2024-11-18 16:06:30.322559] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:06.821 16:06:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.821 16:06:30 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:06.821 16:06:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.821 16:06:30 -- common/autotest_common.sh@10 -- # set +x 00:20:06.821 Malloc0 00:20:06.821 16:06:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.821 16:06:30 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:06.822 16:06:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.822 16:06:30 -- common/autotest_common.sh@10 -- # set +x 00:20:06.822 16:06:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.822 16:06:30 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:06.822 16:06:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.822 16:06:30 -- common/autotest_common.sh@10 -- # set +x 00:20:06.822 16:06:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.822 16:06:30 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:06.822 16:06:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.822 16:06:30 -- common/autotest_common.sh@10 -- # set +x 00:20:06.822 [2024-11-18 16:06:30.360848] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:06.822 16:06:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.822 16:06:30 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:20:06.822 16:06:30 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:20:06.822 16:06:30 -- nvmf/common.sh@520 -- # config=() 00:20:06.822 16:06:30 -- nvmf/common.sh@520 -- # local subsystem config 00:20:06.822 16:06:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:20:06.822 16:06:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:20:06.822 { 00:20:06.822 "params": { 00:20:06.822 "name": "Nvme$subsystem", 00:20:06.822 "trtype": "$TEST_TRANSPORT", 00:20:06.822 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:06.822 "adrfam": "ipv4", 00:20:06.822 "trsvcid": "$NVMF_PORT", 00:20:06.822 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:06.822 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:06.822 "hdgst": ${hdgst:-false}, 00:20:06.822 "ddgst": ${ddgst:-false} 00:20:06.822 }, 00:20:06.822 "method": "bdev_nvme_attach_controller" 00:20:06.822 } 00:20:06.822 EOF 00:20:06.822 )") 00:20:06.822 16:06:30 -- nvmf/common.sh@542 -- # cat 00:20:06.822 16:06:30 -- nvmf/common.sh@544 -- # jq . 00:20:06.822 16:06:30 -- nvmf/common.sh@545 -- # IFS=, 00:20:06.822 16:06:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:20:06.822 "params": { 00:20:06.822 "name": "Nvme1", 00:20:06.822 "trtype": "tcp", 00:20:06.822 "traddr": "10.0.0.2", 00:20:06.822 "adrfam": "ipv4", 00:20:06.822 "trsvcid": "4420", 00:20:06.822 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:06.822 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:06.822 "hdgst": false, 00:20:06.822 "ddgst": false 00:20:06.822 }, 00:20:06.822 "method": "bdev_nvme_attach_controller" 00:20:06.822 }' 00:20:06.822 [2024-11-18 16:06:30.404387] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:06.822 [2024-11-18 16:06:30.404468] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1607810 ] 00:20:07.080 [2024-11-18 16:06:30.470920] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:07.080 [2024-11-18 16:06:30.557978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:07.080 [2024-11-18 16:06:30.558029] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:07.080 [2024-11-18 16:06:30.558033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:07.338 [2024-11-18 16:06:30.825523] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:07.338 [2024-11-18 16:06:30.825578] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:07.338 I/O targets: 00:20:07.338 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:07.338 00:20:07.338 00:20:07.338 CUnit - A unit testing framework for C - Version 2.1-3 00:20:07.338 http://cunit.sourceforge.net/ 00:20:07.338 00:20:07.338 00:20:07.338 Suite: bdevio tests on: Nvme1n1 00:20:07.338 Test: blockdev write read block ...passed 00:20:07.338 Test: blockdev write zeroes read block ...passed 00:20:07.597 Test: blockdev write zeroes read no split ...passed 00:20:07.597 Test: blockdev write zeroes read split ...passed 00:20:07.597 Test: blockdev write zeroes read split partial ...passed 00:20:07.597 Test: blockdev reset ...[2024-11-18 16:06:31.069963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:07.597 [2024-11-18 16:06:31.070073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f44150 (9): Bad file descriptor 00:20:07.597 [2024-11-18 16:06:31.125364] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:07.597 passed 00:20:07.597 Test: blockdev write read 8 blocks ...passed 00:20:07.597 Test: blockdev write read size > 128k ...passed 00:20:07.597 Test: blockdev write read invalid size ...passed 00:20:07.855 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:07.855 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:07.855 Test: blockdev write read max offset ...passed 00:20:07.855 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:07.855 Test: blockdev writev readv 8 blocks ...passed 00:20:07.855 Test: blockdev writev readv 30 x 1block ...passed 00:20:07.855 Test: blockdev writev readv block ...passed 00:20:07.855 Test: blockdev writev readv size > 128k ...passed 00:20:07.855 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:07.855 Test: blockdev comparev and writev ...[2024-11-18 16:06:31.340744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:07.855 [2024-11-18 16:06:31.340781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:07.855 [2024-11-18 16:06:31.340806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:07.855 [2024-11-18 16:06:31.340823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:07.855 [2024-11-18 16:06:31.341193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:07.855 [2024-11-18 16:06:31.341217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:07.855 [2024-11-18 16:06:31.341239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:07.855 [2024-11-18 16:06:31.341255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:07.855 [2024-11-18 16:06:31.341624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:07.855 [2024-11-18 16:06:31.341648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:07.855 [2024-11-18 16:06:31.341670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:07.855 [2024-11-18 16:06:31.341686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:07.855 [2024-11-18 16:06:31.342050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:07.855 [2024-11-18 16:06:31.342074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:07.855 [2024-11-18 16:06:31.342095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:07.855 [2024-11-18 16:06:31.342111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:07.855 passed 00:20:07.855 Test: blockdev nvme passthru rw ...passed 00:20:07.855 Test: blockdev nvme passthru vendor specific ...[2024-11-18 16:06:31.424899] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:07.855 [2024-11-18 16:06:31.424926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:07.855 [2024-11-18 16:06:31.425065] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:07.855 [2024-11-18 16:06:31.425087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:07.855 [2024-11-18 16:06:31.425238] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:07.855 [2024-11-18 16:06:31.425259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:07.855 [2024-11-18 16:06:31.425394] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:07.855 [2024-11-18 16:06:31.425415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:07.855 passed 00:20:07.855 Test: blockdev nvme admin passthru ...passed 00:20:08.139 Test: blockdev copy ...passed 00:20:08.139 00:20:08.139 Run Summary: Type Total Ran Passed Failed Inactive 00:20:08.139 suites 1 1 n/a 0 0 00:20:08.139 tests 23 23 23 0 0 00:20:08.139 asserts 152 152 152 0 n/a 00:20:08.139 00:20:08.139 Elapsed time = 1.313 seconds 00:20:08.422 16:06:31 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:08.422 16:06:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:08.422 16:06:31 -- common/autotest_common.sh@10 -- # set +x 00:20:08.422 16:06:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:08.422 16:06:31 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:08.422 16:06:31 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:08.422 16:06:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:08.422 16:06:31 -- nvmf/common.sh@116 -- # sync 00:20:08.422 16:06:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:08.422 16:06:31 -- nvmf/common.sh@119 -- # set +e 00:20:08.422 16:06:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:08.422 16:06:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:08.422 rmmod nvme_tcp 00:20:08.422 rmmod nvme_fabrics 00:20:08.422 rmmod nvme_keyring 00:20:08.422 16:06:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:08.422 16:06:31 -- nvmf/common.sh@123 -- # set -e 00:20:08.422 16:06:31 -- nvmf/common.sh@124 -- # return 0 00:20:08.422 16:06:31 -- nvmf/common.sh@477 -- # '[' -n 1607661 ']' 00:20:08.422 16:06:31 -- nvmf/common.sh@478 -- # killprocess 1607661 00:20:08.422 16:06:31 -- common/autotest_common.sh@936 -- # '[' -z 1607661 ']' 00:20:08.422 16:06:31 -- common/autotest_common.sh@940 -- # kill -0 1607661 00:20:08.422 16:06:31 -- common/autotest_common.sh@941 -- # uname 00:20:08.422 16:06:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:08.422 16:06:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1607661 00:20:08.422 16:06:31 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:08.422 16:06:31 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:08.422 16:06:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1607661' 00:20:08.422 killing process with pid 1607661 00:20:08.422 16:06:31 -- common/autotest_common.sh@955 -- # kill 1607661 00:20:08.422 16:06:31 -- common/autotest_common.sh@960 -- # wait 1607661 00:20:09.021 16:06:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:09.021 16:06:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:09.021 16:06:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:09.021 16:06:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:09.021 16:06:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:09.021 16:06:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:09.021 16:06:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:09.021 16:06:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:10.922 16:06:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:10.922 00:20:10.922 real 0m6.605s 00:20:10.922 user 0m11.286s 00:20:10.922 sys 0m2.503s 00:20:10.922 16:06:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:10.922 16:06:34 -- common/autotest_common.sh@10 -- # set +x 00:20:10.922 ************************************ 00:20:10.922 END TEST nvmf_bdevio_no_huge 00:20:10.922 ************************************ 00:20:10.922 16:06:34 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:10.922 16:06:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:10.922 16:06:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:10.922 16:06:34 -- common/autotest_common.sh@10 -- # set +x 00:20:10.922 ************************************ 00:20:10.922 START TEST nvmf_tls 00:20:10.922 ************************************ 00:20:10.922 16:06:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:10.922 * Looking for test storage... 00:20:10.922 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:10.922 16:06:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:10.922 16:06:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:10.922 16:06:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:10.922 16:06:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:10.922 16:06:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:10.922 16:06:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:10.922 16:06:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:10.922 16:06:34 -- scripts/common.sh@335 -- # IFS=.-: 00:20:10.922 16:06:34 -- scripts/common.sh@335 -- # read -ra ver1 00:20:10.922 16:06:34 -- scripts/common.sh@336 -- # IFS=.-: 00:20:10.922 16:06:34 -- scripts/common.sh@336 -- # read -ra ver2 00:20:10.922 16:06:34 -- scripts/common.sh@337 -- # local 'op=<' 00:20:10.922 16:06:34 -- scripts/common.sh@339 -- # ver1_l=2 00:20:10.922 16:06:34 -- scripts/common.sh@340 -- # ver2_l=1 00:20:10.922 16:06:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:10.922 16:06:34 -- scripts/common.sh@343 -- # case "$op" in 00:20:10.922 16:06:34 -- scripts/common.sh@344 -- # : 1 00:20:10.922 16:06:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:10.922 16:06:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:10.922 16:06:34 -- scripts/common.sh@364 -- # decimal 1 00:20:10.922 16:06:34 -- scripts/common.sh@352 -- # local d=1 00:20:10.922 16:06:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:10.922 16:06:34 -- scripts/common.sh@354 -- # echo 1 00:20:10.922 16:06:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:10.922 16:06:34 -- scripts/common.sh@365 -- # decimal 2 00:20:10.922 16:06:34 -- scripts/common.sh@352 -- # local d=2 00:20:10.922 16:06:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:10.922 16:06:34 -- scripts/common.sh@354 -- # echo 2 00:20:10.922 16:06:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:10.922 16:06:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:10.922 16:06:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:10.922 16:06:34 -- scripts/common.sh@367 -- # return 0 00:20:10.922 16:06:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:10.922 16:06:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:10.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:10.922 --rc genhtml_branch_coverage=1 00:20:10.922 --rc genhtml_function_coverage=1 00:20:10.922 --rc genhtml_legend=1 00:20:10.922 --rc geninfo_all_blocks=1 00:20:10.922 --rc geninfo_unexecuted_blocks=1 00:20:10.922 00:20:10.922 ' 00:20:10.922 16:06:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:10.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:10.922 --rc genhtml_branch_coverage=1 00:20:10.922 --rc genhtml_function_coverage=1 00:20:10.922 --rc genhtml_legend=1 00:20:10.922 --rc geninfo_all_blocks=1 00:20:10.922 --rc geninfo_unexecuted_blocks=1 00:20:10.922 00:20:10.922 ' 00:20:10.922 16:06:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:10.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:10.922 --rc genhtml_branch_coverage=1 00:20:10.922 --rc genhtml_function_coverage=1 00:20:10.922 --rc genhtml_legend=1 00:20:10.922 --rc geninfo_all_blocks=1 00:20:10.922 --rc geninfo_unexecuted_blocks=1 00:20:10.922 00:20:10.922 ' 00:20:10.922 16:06:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:10.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:10.922 --rc genhtml_branch_coverage=1 00:20:10.922 --rc genhtml_function_coverage=1 00:20:10.922 --rc genhtml_legend=1 00:20:10.922 --rc geninfo_all_blocks=1 00:20:10.922 --rc geninfo_unexecuted_blocks=1 00:20:10.922 00:20:10.923 ' 00:20:10.923 16:06:34 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:10.923 16:06:34 -- nvmf/common.sh@7 -- # uname -s 00:20:10.923 16:06:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:10.923 16:06:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:10.923 16:06:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:10.923 16:06:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:10.923 16:06:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:10.923 16:06:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:10.923 16:06:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:10.923 16:06:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:10.923 16:06:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:10.923 16:06:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:11.182 16:06:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:11.182 16:06:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:11.182 16:06:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:11.182 16:06:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:11.182 16:06:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:11.182 16:06:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:11.182 16:06:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:11.182 16:06:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:11.182 16:06:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:11.182 16:06:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:11.182 16:06:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:11.183 16:06:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:11.183 16:06:34 -- paths/export.sh@5 -- # export PATH 00:20:11.183 16:06:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:11.183 16:06:34 -- nvmf/common.sh@46 -- # : 0 00:20:11.183 16:06:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:11.183 16:06:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:11.183 16:06:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:11.183 16:06:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:11.183 16:06:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:11.183 16:06:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:11.183 16:06:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:11.183 16:06:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:11.183 16:06:34 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:11.183 16:06:34 -- target/tls.sh@71 -- # nvmftestinit 00:20:11.183 16:06:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:11.183 16:06:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:11.183 16:06:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:11.183 16:06:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:11.183 16:06:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:11.183 16:06:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:11.183 16:06:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:11.183 16:06:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:11.183 16:06:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:11.183 16:06:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:11.183 16:06:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:11.183 16:06:34 -- common/autotest_common.sh@10 -- # set +x 00:20:13.084 16:06:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:13.084 16:06:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:13.084 16:06:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:13.084 16:06:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:13.084 16:06:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:13.084 16:06:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:13.084 16:06:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:13.084 16:06:36 -- nvmf/common.sh@294 -- # net_devs=() 00:20:13.084 16:06:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:13.084 16:06:36 -- nvmf/common.sh@295 -- # e810=() 00:20:13.084 16:06:36 -- nvmf/common.sh@295 -- # local -ga e810 00:20:13.084 16:06:36 -- nvmf/common.sh@296 -- # x722=() 00:20:13.084 16:06:36 -- nvmf/common.sh@296 -- # local -ga x722 00:20:13.084 16:06:36 -- nvmf/common.sh@297 -- # mlx=() 00:20:13.084 16:06:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:13.084 16:06:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:13.084 16:06:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:13.084 16:06:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:13.084 16:06:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:13.084 16:06:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:13.084 16:06:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:13.084 16:06:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:13.084 16:06:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:13.084 16:06:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:13.084 16:06:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:13.084 16:06:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:13.084 16:06:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:13.084 16:06:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:13.084 16:06:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:13.084 16:06:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:13.084 16:06:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:13.084 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:13.084 16:06:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:13.084 16:06:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:13.084 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:13.084 16:06:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:13.084 16:06:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:13.084 16:06:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:13.084 16:06:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:13.084 16:06:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:13.084 16:06:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:13.084 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:13.084 16:06:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:13.084 16:06:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:13.084 16:06:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:13.084 16:06:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:13.084 16:06:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:13.084 16:06:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:13.084 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:13.084 16:06:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:13.084 16:06:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:13.084 16:06:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:13.084 16:06:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:13.084 16:06:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:13.084 16:06:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:13.084 16:06:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:13.084 16:06:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:13.084 16:06:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:13.084 16:06:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:13.084 16:06:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:13.084 16:06:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:13.084 16:06:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:13.084 16:06:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:13.084 16:06:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:13.084 16:06:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:13.084 16:06:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:13.084 16:06:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:13.084 16:06:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:13.084 16:06:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:13.084 16:06:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:13.084 16:06:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:13.084 16:06:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:13.084 16:06:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:13.084 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:13.084 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.311 ms 00:20:13.084 00:20:13.084 --- 10.0.0.2 ping statistics --- 00:20:13.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:13.084 rtt min/avg/max/mdev = 0.311/0.311/0.311/0.000 ms 00:20:13.084 16:06:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:13.084 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:13.084 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:20:13.084 00:20:13.084 --- 10.0.0.1 ping statistics --- 00:20:13.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:13.084 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:20:13.084 16:06:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:13.084 16:06:36 -- nvmf/common.sh@410 -- # return 0 00:20:13.084 16:06:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:13.084 16:06:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:13.084 16:06:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:13.084 16:06:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:13.084 16:06:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:13.084 16:06:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:13.084 16:06:36 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:13.084 16:06:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:13.084 16:06:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:13.084 16:06:36 -- common/autotest_common.sh@10 -- # set +x 00:20:13.084 16:06:36 -- nvmf/common.sh@469 -- # nvmfpid=1609916 00:20:13.084 16:06:36 -- nvmf/common.sh@470 -- # waitforlisten 1609916 00:20:13.084 16:06:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:13.084 16:06:36 -- common/autotest_common.sh@829 -- # '[' -z 1609916 ']' 00:20:13.084 16:06:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:13.084 16:06:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:13.084 16:06:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:13.084 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:13.084 16:06:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:13.084 16:06:36 -- common/autotest_common.sh@10 -- # set +x 00:20:13.084 [2024-11-18 16:06:36.599713] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:13.084 [2024-11-18 16:06:36.599785] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:13.084 EAL: No free 2048 kB hugepages reported on node 1 00:20:13.084 [2024-11-18 16:06:36.664584] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:13.343 [2024-11-18 16:06:36.749385] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:13.343 [2024-11-18 16:06:36.749535] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:13.343 [2024-11-18 16:06:36.749561] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:13.343 [2024-11-18 16:06:36.749581] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:13.343 [2024-11-18 16:06:36.749657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:13.343 16:06:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:13.343 16:06:36 -- common/autotest_common.sh@862 -- # return 0 00:20:13.343 16:06:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:13.343 16:06:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:13.343 16:06:36 -- common/autotest_common.sh@10 -- # set +x 00:20:13.343 16:06:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:13.343 16:06:36 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:13.343 16:06:36 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:13.601 true 00:20:13.601 16:06:37 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:13.601 16:06:37 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:13.859 16:06:37 -- target/tls.sh@82 -- # version=0 00:20:13.859 16:06:37 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:13.859 16:06:37 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:14.118 16:06:37 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:14.118 16:06:37 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:14.377 16:06:37 -- target/tls.sh@90 -- # version=13 00:20:14.377 16:06:37 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:14.377 16:06:37 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:14.635 16:06:38 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:14.635 16:06:38 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:14.894 16:06:38 -- target/tls.sh@98 -- # version=7 00:20:14.894 16:06:38 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:14.894 16:06:38 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:14.894 16:06:38 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:15.152 16:06:38 -- target/tls.sh@105 -- # ktls=false 00:20:15.152 16:06:38 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:15.152 16:06:38 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:15.410 16:06:38 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:15.410 16:06:38 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:15.668 16:06:39 -- target/tls.sh@113 -- # ktls=true 00:20:15.668 16:06:39 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:15.668 16:06:39 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:15.925 16:06:39 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:15.925 16:06:39 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:16.183 16:06:39 -- target/tls.sh@121 -- # ktls=false 00:20:16.183 16:06:39 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:16.183 16:06:39 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:16.183 16:06:39 -- target/tls.sh@49 -- # local key hash crc 00:20:16.183 16:06:39 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:16.183 16:06:39 -- target/tls.sh@51 -- # hash=01 00:20:16.183 16:06:39 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:16.183 16:06:39 -- target/tls.sh@52 -- # gzip -1 -c 00:20:16.183 16:06:39 -- target/tls.sh@52 -- # tail -c8 00:20:16.183 16:06:39 -- target/tls.sh@52 -- # head -c 4 00:20:16.183 16:06:39 -- target/tls.sh@52 -- # crc='p$H�' 00:20:16.183 16:06:39 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:16.183 16:06:39 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:16.183 16:06:39 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:16.183 16:06:39 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:16.183 16:06:39 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:16.183 16:06:39 -- target/tls.sh@49 -- # local key hash crc 00:20:16.183 16:06:39 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:16.183 16:06:39 -- target/tls.sh@51 -- # hash=01 00:20:16.183 16:06:39 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:16.183 16:06:39 -- target/tls.sh@52 -- # gzip -1 -c 00:20:16.184 16:06:39 -- target/tls.sh@52 -- # tail -c8 00:20:16.184 16:06:39 -- target/tls.sh@52 -- # head -c 4 00:20:16.184 16:06:39 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:16.184 16:06:39 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:16.184 16:06:39 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:16.184 16:06:39 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:16.184 16:06:39 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:16.184 16:06:39 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:16.184 16:06:39 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:16.184 16:06:39 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:16.184 16:06:39 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:16.184 16:06:39 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:16.184 16:06:39 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:16.184 16:06:39 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:16.442 16:06:39 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:17.007 16:06:40 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:17.007 16:06:40 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:17.007 16:06:40 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:17.008 [2024-11-18 16:06:40.579023] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:17.008 16:06:40 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:17.574 16:06:40 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:17.574 [2024-11-18 16:06:41.112448] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:17.574 [2024-11-18 16:06:41.112774] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:17.574 16:06:41 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:17.832 malloc0 00:20:17.832 16:06:41 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:18.091 16:06:41 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:18.350 16:06:41 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:18.350 EAL: No free 2048 kB hugepages reported on node 1 00:20:30.546 Initializing NVMe Controllers 00:20:30.546 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:30.546 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:30.546 Initialization complete. Launching workers. 00:20:30.546 ======================================================== 00:20:30.546 Latency(us) 00:20:30.546 Device Information : IOPS MiB/s Average min max 00:20:30.546 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7837.54 30.62 8168.41 1223.82 9365.40 00:20:30.546 ======================================================== 00:20:30.546 Total : 7837.54 30.62 8168.41 1223.82 9365.40 00:20:30.546 00:20:30.546 16:06:52 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:30.546 16:06:52 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:30.546 16:06:52 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:30.546 16:06:52 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:30.546 16:06:52 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:30.546 16:06:52 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:30.546 16:06:52 -- target/tls.sh@28 -- # bdevperf_pid=1611866 00:20:30.546 16:06:52 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:30.546 16:06:52 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:30.546 16:06:52 -- target/tls.sh@31 -- # waitforlisten 1611866 /var/tmp/bdevperf.sock 00:20:30.546 16:06:52 -- common/autotest_common.sh@829 -- # '[' -z 1611866 ']' 00:20:30.546 16:06:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:30.546 16:06:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:30.546 16:06:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:30.546 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:30.546 16:06:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:30.546 16:06:52 -- common/autotest_common.sh@10 -- # set +x 00:20:30.546 [2024-11-18 16:06:52.050980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:30.546 [2024-11-18 16:06:52.051068] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1611866 ] 00:20:30.547 EAL: No free 2048 kB hugepages reported on node 1 00:20:30.547 [2024-11-18 16:06:52.116371] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:30.547 [2024-11-18 16:06:52.206185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:30.547 16:06:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:30.547 16:06:53 -- common/autotest_common.sh@862 -- # return 0 00:20:30.547 16:06:53 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:30.547 [2024-11-18 16:06:53.331378] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:30.547 TLSTESTn1 00:20:30.547 16:06:53 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:30.547 Running I/O for 10 seconds... 00:20:40.516 00:20:40.516 Latency(us) 00:20:40.516 [2024-11-18T15:07:04.107Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:40.516 [2024-11-18T15:07:04.107Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:40.516 Verification LBA range: start 0x0 length 0x2000 00:20:40.516 TLSTESTn1 : 10.01 4647.85 18.16 0.00 0.00 27503.15 3907.89 45632.47 00:20:40.516 [2024-11-18T15:07:04.107Z] =================================================================================================================== 00:20:40.516 [2024-11-18T15:07:04.107Z] Total : 4647.85 18.16 0.00 0.00 27503.15 3907.89 45632.47 00:20:40.516 0 00:20:40.516 16:07:03 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:40.516 16:07:03 -- target/tls.sh@45 -- # killprocess 1611866 00:20:40.516 16:07:03 -- common/autotest_common.sh@936 -- # '[' -z 1611866 ']' 00:20:40.516 16:07:03 -- common/autotest_common.sh@940 -- # kill -0 1611866 00:20:40.516 16:07:03 -- common/autotest_common.sh@941 -- # uname 00:20:40.516 16:07:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:40.516 16:07:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1611866 00:20:40.516 16:07:03 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:40.516 16:07:03 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:40.516 16:07:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1611866' 00:20:40.516 killing process with pid 1611866 00:20:40.516 16:07:03 -- common/autotest_common.sh@955 -- # kill 1611866 00:20:40.516 Received shutdown signal, test time was about 10.000000 seconds 00:20:40.516 00:20:40.516 Latency(us) 00:20:40.516 [2024-11-18T15:07:04.107Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:40.516 [2024-11-18T15:07:04.107Z] =================================================================================================================== 00:20:40.516 [2024-11-18T15:07:04.107Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:40.516 16:07:03 -- common/autotest_common.sh@960 -- # wait 1611866 00:20:40.517 16:07:03 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:40.517 16:07:03 -- common/autotest_common.sh@650 -- # local es=0 00:20:40.517 16:07:03 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:40.517 16:07:03 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:40.517 16:07:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:40.517 16:07:03 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:40.517 16:07:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:40.517 16:07:03 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:40.517 16:07:03 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:40.517 16:07:03 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:40.517 16:07:03 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:40.517 16:07:03 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:40.517 16:07:03 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:40.517 16:07:03 -- target/tls.sh@28 -- # bdevperf_pid=1613243 00:20:40.517 16:07:03 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:40.517 16:07:03 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:40.517 16:07:03 -- target/tls.sh@31 -- # waitforlisten 1613243 /var/tmp/bdevperf.sock 00:20:40.517 16:07:03 -- common/autotest_common.sh@829 -- # '[' -z 1613243 ']' 00:20:40.517 16:07:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:40.517 16:07:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:40.517 16:07:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:40.517 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:40.517 16:07:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:40.517 16:07:03 -- common/autotest_common.sh@10 -- # set +x 00:20:40.517 [2024-11-18 16:07:03.874202] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:40.517 [2024-11-18 16:07:03.874278] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1613243 ] 00:20:40.517 EAL: No free 2048 kB hugepages reported on node 1 00:20:40.517 [2024-11-18 16:07:03.931075] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:40.517 [2024-11-18 16:07:04.010249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:41.452 16:07:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:41.452 16:07:04 -- common/autotest_common.sh@862 -- # return 0 00:20:41.452 16:07:04 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:41.710 [2024-11-18 16:07:05.101359] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:41.710 [2024-11-18 16:07:05.108663] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:41.710 [2024-11-18 16:07:05.109250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20cecf0 (107): Transport endpoint is not connected 00:20:41.710 [2024-11-18 16:07:05.110241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20cecf0 (9): Bad file descriptor 00:20:41.710 [2024-11-18 16:07:05.111240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:41.710 [2024-11-18 16:07:05.111261] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:41.710 [2024-11-18 16:07:05.111275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:41.710 request: 00:20:41.710 { 00:20:41.710 "name": "TLSTEST", 00:20:41.710 "trtype": "tcp", 00:20:41.710 "traddr": "10.0.0.2", 00:20:41.710 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:41.710 "adrfam": "ipv4", 00:20:41.710 "trsvcid": "4420", 00:20:41.710 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:41.710 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:41.710 "method": "bdev_nvme_attach_controller", 00:20:41.710 "req_id": 1 00:20:41.710 } 00:20:41.710 Got JSON-RPC error response 00:20:41.710 response: 00:20:41.710 { 00:20:41.710 "code": -32602, 00:20:41.710 "message": "Invalid parameters" 00:20:41.710 } 00:20:41.710 16:07:05 -- target/tls.sh@36 -- # killprocess 1613243 00:20:41.710 16:07:05 -- common/autotest_common.sh@936 -- # '[' -z 1613243 ']' 00:20:41.710 16:07:05 -- common/autotest_common.sh@940 -- # kill -0 1613243 00:20:41.710 16:07:05 -- common/autotest_common.sh@941 -- # uname 00:20:41.710 16:07:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:41.710 16:07:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1613243 00:20:41.710 16:07:05 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:41.710 16:07:05 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:41.710 16:07:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1613243' 00:20:41.710 killing process with pid 1613243 00:20:41.710 16:07:05 -- common/autotest_common.sh@955 -- # kill 1613243 00:20:41.710 Received shutdown signal, test time was about 10.000000 seconds 00:20:41.710 00:20:41.710 Latency(us) 00:20:41.710 [2024-11-18T15:07:05.301Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:41.710 [2024-11-18T15:07:05.302Z] =================================================================================================================== 00:20:41.711 [2024-11-18T15:07:05.302Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:41.711 16:07:05 -- common/autotest_common.sh@960 -- # wait 1613243 00:20:41.969 16:07:05 -- target/tls.sh@37 -- # return 1 00:20:41.969 16:07:05 -- common/autotest_common.sh@653 -- # es=1 00:20:41.969 16:07:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:41.969 16:07:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:41.969 16:07:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:41.969 16:07:05 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:41.969 16:07:05 -- common/autotest_common.sh@650 -- # local es=0 00:20:41.969 16:07:05 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:41.969 16:07:05 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:41.969 16:07:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:41.969 16:07:05 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:41.969 16:07:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:41.969 16:07:05 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:41.969 16:07:05 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:41.969 16:07:05 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:41.969 16:07:05 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:41.969 16:07:05 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:41.969 16:07:05 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:41.969 16:07:05 -- target/tls.sh@28 -- # bdevperf_pid=1613446 00:20:41.969 16:07:05 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:41.969 16:07:05 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:41.969 16:07:05 -- target/tls.sh@31 -- # waitforlisten 1613446 /var/tmp/bdevperf.sock 00:20:41.969 16:07:05 -- common/autotest_common.sh@829 -- # '[' -z 1613446 ']' 00:20:41.969 16:07:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:41.969 16:07:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:41.969 16:07:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:41.969 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:41.969 16:07:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:41.969 16:07:05 -- common/autotest_common.sh@10 -- # set +x 00:20:41.969 [2024-11-18 16:07:05.437812] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:41.969 [2024-11-18 16:07:05.437899] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1613446 ] 00:20:41.969 EAL: No free 2048 kB hugepages reported on node 1 00:20:41.969 [2024-11-18 16:07:05.507436] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:42.228 [2024-11-18 16:07:05.597602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:43.162 16:07:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:43.162 16:07:06 -- common/autotest_common.sh@862 -- # return 0 00:20:43.162 16:07:06 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:43.162 [2024-11-18 16:07:06.715374] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:43.162 [2024-11-18 16:07:06.722684] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:43.162 [2024-11-18 16:07:06.722716] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:43.162 [2024-11-18 16:07:06.722782] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:43.162 [2024-11-18 16:07:06.723198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5ddcf0 (107): Transport endpoint is not connected 00:20:43.162 [2024-11-18 16:07:06.724190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5ddcf0 (9): Bad file descriptor 00:20:43.162 [2024-11-18 16:07:06.725190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:43.162 [2024-11-18 16:07:06.725209] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:43.162 [2024-11-18 16:07:06.725222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:43.162 request: 00:20:43.162 { 00:20:43.162 "name": "TLSTEST", 00:20:43.162 "trtype": "tcp", 00:20:43.162 "traddr": "10.0.0.2", 00:20:43.162 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:43.162 "adrfam": "ipv4", 00:20:43.162 "trsvcid": "4420", 00:20:43.162 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:43.162 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:43.162 "method": "bdev_nvme_attach_controller", 00:20:43.162 "req_id": 1 00:20:43.162 } 00:20:43.162 Got JSON-RPC error response 00:20:43.162 response: 00:20:43.162 { 00:20:43.162 "code": -32602, 00:20:43.162 "message": "Invalid parameters" 00:20:43.162 } 00:20:43.162 16:07:06 -- target/tls.sh@36 -- # killprocess 1613446 00:20:43.162 16:07:06 -- common/autotest_common.sh@936 -- # '[' -z 1613446 ']' 00:20:43.162 16:07:06 -- common/autotest_common.sh@940 -- # kill -0 1613446 00:20:43.162 16:07:06 -- common/autotest_common.sh@941 -- # uname 00:20:43.162 16:07:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:43.162 16:07:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1613446 00:20:43.421 16:07:06 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:43.421 16:07:06 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:43.421 16:07:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1613446' 00:20:43.421 killing process with pid 1613446 00:20:43.421 16:07:06 -- common/autotest_common.sh@955 -- # kill 1613446 00:20:43.421 Received shutdown signal, test time was about 10.000000 seconds 00:20:43.421 00:20:43.421 Latency(us) 00:20:43.421 [2024-11-18T15:07:07.012Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:43.421 [2024-11-18T15:07:07.012Z] =================================================================================================================== 00:20:43.421 [2024-11-18T15:07:07.012Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:43.421 16:07:06 -- common/autotest_common.sh@960 -- # wait 1613446 00:20:43.421 16:07:06 -- target/tls.sh@37 -- # return 1 00:20:43.421 16:07:06 -- common/autotest_common.sh@653 -- # es=1 00:20:43.421 16:07:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:43.421 16:07:06 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:43.421 16:07:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:43.421 16:07:06 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:43.421 16:07:06 -- common/autotest_common.sh@650 -- # local es=0 00:20:43.421 16:07:06 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:43.421 16:07:06 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:43.421 16:07:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:43.421 16:07:06 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:43.421 16:07:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:43.421 16:07:06 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:43.421 16:07:06 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:43.421 16:07:06 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:43.421 16:07:06 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:43.421 16:07:06 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:43.421 16:07:06 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:43.421 16:07:06 -- target/tls.sh@28 -- # bdevperf_pid=1613678 00:20:43.421 16:07:06 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:43.421 16:07:06 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:43.421 16:07:06 -- target/tls.sh@31 -- # waitforlisten 1613678 /var/tmp/bdevperf.sock 00:20:43.421 16:07:06 -- common/autotest_common.sh@829 -- # '[' -z 1613678 ']' 00:20:43.421 16:07:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:43.421 16:07:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:43.421 16:07:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:43.421 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:43.421 16:07:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:43.421 16:07:06 -- common/autotest_common.sh@10 -- # set +x 00:20:43.421 [2024-11-18 16:07:07.007142] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:43.421 [2024-11-18 16:07:07.007219] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1613678 ] 00:20:43.679 EAL: No free 2048 kB hugepages reported on node 1 00:20:43.680 [2024-11-18 16:07:07.065442] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:43.680 [2024-11-18 16:07:07.152047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:44.613 16:07:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:44.613 16:07:08 -- common/autotest_common.sh@862 -- # return 0 00:20:44.613 16:07:08 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:44.872 [2024-11-18 16:07:08.265526] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:44.872 [2024-11-18 16:07:08.276776] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:44.872 [2024-11-18 16:07:08.276809] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:44.872 [2024-11-18 16:07:08.276878] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:44.872 [2024-11-18 16:07:08.277407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19d7cf0 (107): Transport endpoint is not connected 00:20:44.872 [2024-11-18 16:07:08.278397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19d7cf0 (9): Bad file descriptor 00:20:44.872 [2024-11-18 16:07:08.279396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:44.872 [2024-11-18 16:07:08.279416] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:44.872 [2024-11-18 16:07:08.279440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:44.872 request: 00:20:44.872 { 00:20:44.872 "name": "TLSTEST", 00:20:44.872 "trtype": "tcp", 00:20:44.872 "traddr": "10.0.0.2", 00:20:44.872 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:44.872 "adrfam": "ipv4", 00:20:44.872 "trsvcid": "4420", 00:20:44.872 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:44.872 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:44.872 "method": "bdev_nvme_attach_controller", 00:20:44.872 "req_id": 1 00:20:44.872 } 00:20:44.872 Got JSON-RPC error response 00:20:44.872 response: 00:20:44.872 { 00:20:44.872 "code": -32602, 00:20:44.872 "message": "Invalid parameters" 00:20:44.872 } 00:20:44.872 16:07:08 -- target/tls.sh@36 -- # killprocess 1613678 00:20:44.872 16:07:08 -- common/autotest_common.sh@936 -- # '[' -z 1613678 ']' 00:20:44.872 16:07:08 -- common/autotest_common.sh@940 -- # kill -0 1613678 00:20:44.872 16:07:08 -- common/autotest_common.sh@941 -- # uname 00:20:44.872 16:07:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:44.872 16:07:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1613678 00:20:44.872 16:07:08 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:44.872 16:07:08 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:44.872 16:07:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1613678' 00:20:44.872 killing process with pid 1613678 00:20:44.872 16:07:08 -- common/autotest_common.sh@955 -- # kill 1613678 00:20:44.872 Received shutdown signal, test time was about 10.000000 seconds 00:20:44.872 00:20:44.872 Latency(us) 00:20:44.872 [2024-11-18T15:07:08.463Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:44.872 [2024-11-18T15:07:08.463Z] =================================================================================================================== 00:20:44.872 [2024-11-18T15:07:08.463Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:44.872 16:07:08 -- common/autotest_common.sh@960 -- # wait 1613678 00:20:45.132 16:07:08 -- target/tls.sh@37 -- # return 1 00:20:45.132 16:07:08 -- common/autotest_common.sh@653 -- # es=1 00:20:45.132 16:07:08 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:45.132 16:07:08 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:45.132 16:07:08 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:45.132 16:07:08 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:45.132 16:07:08 -- common/autotest_common.sh@650 -- # local es=0 00:20:45.132 16:07:08 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:45.132 16:07:08 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:45.132 16:07:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:45.132 16:07:08 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:45.132 16:07:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:45.132 16:07:08 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:45.132 16:07:08 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:45.132 16:07:08 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:45.132 16:07:08 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:45.132 16:07:08 -- target/tls.sh@23 -- # psk= 00:20:45.132 16:07:08 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:45.132 16:07:08 -- target/tls.sh@28 -- # bdevperf_pid=1613829 00:20:45.132 16:07:08 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:45.132 16:07:08 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:45.132 16:07:08 -- target/tls.sh@31 -- # waitforlisten 1613829 /var/tmp/bdevperf.sock 00:20:45.132 16:07:08 -- common/autotest_common.sh@829 -- # '[' -z 1613829 ']' 00:20:45.132 16:07:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:45.132 16:07:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:45.132 16:07:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:45.132 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:45.132 16:07:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:45.132 16:07:08 -- common/autotest_common.sh@10 -- # set +x 00:20:45.132 [2024-11-18 16:07:08.600808] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:45.132 [2024-11-18 16:07:08.600901] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1613829 ] 00:20:45.132 EAL: No free 2048 kB hugepages reported on node 1 00:20:45.132 [2024-11-18 16:07:08.658735] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:45.390 [2024-11-18 16:07:08.742501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:46.324 16:07:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:46.324 16:07:09 -- common/autotest_common.sh@862 -- # return 0 00:20:46.324 16:07:09 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:46.324 [2024-11-18 16:07:09.810834] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:46.324 [2024-11-18 16:07:09.812361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1520720 (9): Bad file descriptor 00:20:46.324 [2024-11-18 16:07:09.813357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:46.324 [2024-11-18 16:07:09.813379] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:46.324 [2024-11-18 16:07:09.813394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:46.324 request: 00:20:46.324 { 00:20:46.324 "name": "TLSTEST", 00:20:46.324 "trtype": "tcp", 00:20:46.324 "traddr": "10.0.0.2", 00:20:46.324 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:46.324 "adrfam": "ipv4", 00:20:46.324 "trsvcid": "4420", 00:20:46.324 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:46.324 "method": "bdev_nvme_attach_controller", 00:20:46.324 "req_id": 1 00:20:46.324 } 00:20:46.324 Got JSON-RPC error response 00:20:46.324 response: 00:20:46.324 { 00:20:46.324 "code": -32602, 00:20:46.324 "message": "Invalid parameters" 00:20:46.324 } 00:20:46.324 16:07:09 -- target/tls.sh@36 -- # killprocess 1613829 00:20:46.324 16:07:09 -- common/autotest_common.sh@936 -- # '[' -z 1613829 ']' 00:20:46.324 16:07:09 -- common/autotest_common.sh@940 -- # kill -0 1613829 00:20:46.324 16:07:09 -- common/autotest_common.sh@941 -- # uname 00:20:46.324 16:07:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:46.324 16:07:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1613829 00:20:46.324 16:07:09 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:46.324 16:07:09 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:46.324 16:07:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1613829' 00:20:46.324 killing process with pid 1613829 00:20:46.324 16:07:09 -- common/autotest_common.sh@955 -- # kill 1613829 00:20:46.324 Received shutdown signal, test time was about 10.000000 seconds 00:20:46.324 00:20:46.324 Latency(us) 00:20:46.324 [2024-11-18T15:07:09.915Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:46.324 [2024-11-18T15:07:09.915Z] =================================================================================================================== 00:20:46.324 [2024-11-18T15:07:09.915Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:46.324 16:07:09 -- common/autotest_common.sh@960 -- # wait 1613829 00:20:46.582 16:07:10 -- target/tls.sh@37 -- # return 1 00:20:46.582 16:07:10 -- common/autotest_common.sh@653 -- # es=1 00:20:46.582 16:07:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:46.582 16:07:10 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:46.582 16:07:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:46.582 16:07:10 -- target/tls.sh@167 -- # killprocess 1609916 00:20:46.582 16:07:10 -- common/autotest_common.sh@936 -- # '[' -z 1609916 ']' 00:20:46.582 16:07:10 -- common/autotest_common.sh@940 -- # kill -0 1609916 00:20:46.582 16:07:10 -- common/autotest_common.sh@941 -- # uname 00:20:46.582 16:07:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:46.582 16:07:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1609916 00:20:46.582 16:07:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:46.582 16:07:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:46.582 16:07:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1609916' 00:20:46.582 killing process with pid 1609916 00:20:46.582 16:07:10 -- common/autotest_common.sh@955 -- # kill 1609916 00:20:46.582 16:07:10 -- common/autotest_common.sh@960 -- # wait 1609916 00:20:46.840 16:07:10 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:46.840 16:07:10 -- target/tls.sh@49 -- # local key hash crc 00:20:46.840 16:07:10 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:46.840 16:07:10 -- target/tls.sh@51 -- # hash=02 00:20:46.840 16:07:10 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:46.840 16:07:10 -- target/tls.sh@52 -- # gzip -1 -c 00:20:46.840 16:07:10 -- target/tls.sh@52 -- # tail -c8 00:20:46.840 16:07:10 -- target/tls.sh@52 -- # head -c 4 00:20:46.840 16:07:10 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:46.840 16:07:10 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:46.840 16:07:10 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:46.840 16:07:10 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:46.840 16:07:10 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:46.840 16:07:10 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:46.840 16:07:10 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:46.840 16:07:10 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:46.840 16:07:10 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:46.840 16:07:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:46.840 16:07:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:46.840 16:07:10 -- common/autotest_common.sh@10 -- # set +x 00:20:46.840 16:07:10 -- nvmf/common.sh@469 -- # nvmfpid=1614117 00:20:46.840 16:07:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:46.840 16:07:10 -- nvmf/common.sh@470 -- # waitforlisten 1614117 00:20:46.840 16:07:10 -- common/autotest_common.sh@829 -- # '[' -z 1614117 ']' 00:20:46.840 16:07:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:46.840 16:07:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:46.840 16:07:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:46.840 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:46.840 16:07:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:46.840 16:07:10 -- common/autotest_common.sh@10 -- # set +x 00:20:47.099 [2024-11-18 16:07:10.455119] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:47.099 [2024-11-18 16:07:10.455202] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:47.099 EAL: No free 2048 kB hugepages reported on node 1 00:20:47.099 [2024-11-18 16:07:10.525185] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:47.099 [2024-11-18 16:07:10.610694] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:47.099 [2024-11-18 16:07:10.610857] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:47.099 [2024-11-18 16:07:10.610882] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:47.099 [2024-11-18 16:07:10.610918] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:47.099 [2024-11-18 16:07:10.610951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:48.032 16:07:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:48.032 16:07:11 -- common/autotest_common.sh@862 -- # return 0 00:20:48.032 16:07:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:48.032 16:07:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:48.032 16:07:11 -- common/autotest_common.sh@10 -- # set +x 00:20:48.032 16:07:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:48.032 16:07:11 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:48.032 16:07:11 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:48.032 16:07:11 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:48.291 [2024-11-18 16:07:11.719971] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:48.291 16:07:11 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:48.553 16:07:11 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:48.811 [2024-11-18 16:07:12.233360] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:48.811 [2024-11-18 16:07:12.233676] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:48.811 16:07:12 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:49.070 malloc0 00:20:49.070 16:07:12 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:49.328 16:07:12 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:49.586 16:07:13 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:49.586 16:07:13 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:49.586 16:07:13 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:49.586 16:07:13 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:49.586 16:07:13 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:49.586 16:07:13 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:49.586 16:07:13 -- target/tls.sh@28 -- # bdevperf_pid=1614428 00:20:49.586 16:07:13 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:49.586 16:07:13 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:49.586 16:07:13 -- target/tls.sh@31 -- # waitforlisten 1614428 /var/tmp/bdevperf.sock 00:20:49.586 16:07:13 -- common/autotest_common.sh@829 -- # '[' -z 1614428 ']' 00:20:49.586 16:07:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:49.586 16:07:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:49.586 16:07:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:49.586 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:49.586 16:07:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:49.586 16:07:13 -- common/autotest_common.sh@10 -- # set +x 00:20:49.586 [2024-11-18 16:07:13.051277] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:49.586 [2024-11-18 16:07:13.051352] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1614428 ] 00:20:49.586 EAL: No free 2048 kB hugepages reported on node 1 00:20:49.586 [2024-11-18 16:07:13.108549] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:49.845 [2024-11-18 16:07:13.193312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:50.412 16:07:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:50.412 16:07:13 -- common/autotest_common.sh@862 -- # return 0 00:20:50.412 16:07:13 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:50.671 [2024-11-18 16:07:14.226446] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:50.928 TLSTESTn1 00:20:50.928 16:07:14 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:50.928 Running I/O for 10 seconds... 00:21:00.944 00:21:00.944 Latency(us) 00:21:00.944 [2024-11-18T15:07:24.535Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:00.944 [2024-11-18T15:07:24.535Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:00.944 Verification LBA range: start 0x0 length 0x2000 00:21:00.944 TLSTESTn1 : 10.01 4761.08 18.60 0.00 0.00 26850.50 4053.52 44079.03 00:21:00.944 [2024-11-18T15:07:24.535Z] =================================================================================================================== 00:21:00.944 [2024-11-18T15:07:24.535Z] Total : 4761.08 18.60 0.00 0.00 26850.50 4053.52 44079.03 00:21:00.944 0 00:21:00.944 16:07:24 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:00.944 16:07:24 -- target/tls.sh@45 -- # killprocess 1614428 00:21:00.944 16:07:24 -- common/autotest_common.sh@936 -- # '[' -z 1614428 ']' 00:21:00.944 16:07:24 -- common/autotest_common.sh@940 -- # kill -0 1614428 00:21:00.944 16:07:24 -- common/autotest_common.sh@941 -- # uname 00:21:00.944 16:07:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:00.944 16:07:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1614428 00:21:00.944 16:07:24 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:00.944 16:07:24 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:00.944 16:07:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1614428' 00:21:00.944 killing process with pid 1614428 00:21:00.944 16:07:24 -- common/autotest_common.sh@955 -- # kill 1614428 00:21:00.944 Received shutdown signal, test time was about 10.000000 seconds 00:21:00.944 00:21:00.944 Latency(us) 00:21:00.944 [2024-11-18T15:07:24.535Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:00.944 [2024-11-18T15:07:24.535Z] =================================================================================================================== 00:21:00.944 [2024-11-18T15:07:24.535Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:00.944 16:07:24 -- common/autotest_common.sh@960 -- # wait 1614428 00:21:01.204 16:07:24 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:01.204 16:07:24 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:01.204 16:07:24 -- common/autotest_common.sh@650 -- # local es=0 00:21:01.204 16:07:24 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:01.204 16:07:24 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:21:01.204 16:07:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:01.204 16:07:24 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:21:01.204 16:07:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:01.204 16:07:24 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:01.204 16:07:24 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:21:01.204 16:07:24 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:21:01.204 16:07:24 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:21:01.204 16:07:24 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:21:01.204 16:07:24 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:01.204 16:07:24 -- target/tls.sh@28 -- # bdevperf_pid=1615887 00:21:01.204 16:07:24 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:01.204 16:07:24 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:01.204 16:07:24 -- target/tls.sh@31 -- # waitforlisten 1615887 /var/tmp/bdevperf.sock 00:21:01.204 16:07:24 -- common/autotest_common.sh@829 -- # '[' -z 1615887 ']' 00:21:01.204 16:07:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:01.204 16:07:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:01.204 16:07:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:01.204 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:01.204 16:07:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:01.204 16:07:24 -- common/autotest_common.sh@10 -- # set +x 00:21:01.204 [2024-11-18 16:07:24.764850] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:01.204 [2024-11-18 16:07:24.764970] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1615887 ] 00:21:01.463 EAL: No free 2048 kB hugepages reported on node 1 00:21:01.463 [2024-11-18 16:07:24.825305] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:01.463 [2024-11-18 16:07:24.909834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:02.398 16:07:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:02.398 16:07:25 -- common/autotest_common.sh@862 -- # return 0 00:21:02.398 16:07:25 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:02.657 [2024-11-18 16:07:26.015492] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:02.657 [2024-11-18 16:07:26.015540] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:02.657 request: 00:21:02.657 { 00:21:02.657 "name": "TLSTEST", 00:21:02.657 "trtype": "tcp", 00:21:02.657 "traddr": "10.0.0.2", 00:21:02.657 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:02.657 "adrfam": "ipv4", 00:21:02.657 "trsvcid": "4420", 00:21:02.657 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:02.657 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:02.657 "method": "bdev_nvme_attach_controller", 00:21:02.657 "req_id": 1 00:21:02.657 } 00:21:02.657 Got JSON-RPC error response 00:21:02.657 response: 00:21:02.657 { 00:21:02.657 "code": -22, 00:21:02.657 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:02.657 } 00:21:02.657 16:07:26 -- target/tls.sh@36 -- # killprocess 1615887 00:21:02.657 16:07:26 -- common/autotest_common.sh@936 -- # '[' -z 1615887 ']' 00:21:02.657 16:07:26 -- common/autotest_common.sh@940 -- # kill -0 1615887 00:21:02.657 16:07:26 -- common/autotest_common.sh@941 -- # uname 00:21:02.657 16:07:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:02.657 16:07:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1615887 00:21:02.657 16:07:26 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:02.657 16:07:26 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:02.657 16:07:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1615887' 00:21:02.657 killing process with pid 1615887 00:21:02.657 16:07:26 -- common/autotest_common.sh@955 -- # kill 1615887 00:21:02.657 Received shutdown signal, test time was about 10.000000 seconds 00:21:02.657 00:21:02.657 Latency(us) 00:21:02.657 [2024-11-18T15:07:26.248Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:02.657 [2024-11-18T15:07:26.248Z] =================================================================================================================== 00:21:02.657 [2024-11-18T15:07:26.248Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:02.657 16:07:26 -- common/autotest_common.sh@960 -- # wait 1615887 00:21:02.916 16:07:26 -- target/tls.sh@37 -- # return 1 00:21:02.916 16:07:26 -- common/autotest_common.sh@653 -- # es=1 00:21:02.916 16:07:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:02.916 16:07:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:02.916 16:07:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:02.916 16:07:26 -- target/tls.sh@183 -- # killprocess 1614117 00:21:02.916 16:07:26 -- common/autotest_common.sh@936 -- # '[' -z 1614117 ']' 00:21:02.916 16:07:26 -- common/autotest_common.sh@940 -- # kill -0 1614117 00:21:02.916 16:07:26 -- common/autotest_common.sh@941 -- # uname 00:21:02.916 16:07:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:02.916 16:07:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1614117 00:21:02.916 16:07:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:02.916 16:07:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:02.916 16:07:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1614117' 00:21:02.916 killing process with pid 1614117 00:21:02.916 16:07:26 -- common/autotest_common.sh@955 -- # kill 1614117 00:21:02.916 16:07:26 -- common/autotest_common.sh@960 -- # wait 1614117 00:21:03.174 16:07:26 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:21:03.174 16:07:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:03.174 16:07:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:03.174 16:07:26 -- common/autotest_common.sh@10 -- # set +x 00:21:03.174 16:07:26 -- nvmf/common.sh@469 -- # nvmfpid=1616075 00:21:03.174 16:07:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:03.174 16:07:26 -- nvmf/common.sh@470 -- # waitforlisten 1616075 00:21:03.174 16:07:26 -- common/autotest_common.sh@829 -- # '[' -z 1616075 ']' 00:21:03.174 16:07:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:03.174 16:07:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:03.174 16:07:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:03.175 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:03.175 16:07:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:03.175 16:07:26 -- common/autotest_common.sh@10 -- # set +x 00:21:03.175 [2024-11-18 16:07:26.647533] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:03.175 [2024-11-18 16:07:26.647631] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:03.175 EAL: No free 2048 kB hugepages reported on node 1 00:21:03.175 [2024-11-18 16:07:26.712394] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:03.433 [2024-11-18 16:07:26.801540] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:03.433 [2024-11-18 16:07:26.801751] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:03.433 [2024-11-18 16:07:26.801778] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:03.433 [2024-11-18 16:07:26.801797] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:03.433 [2024-11-18 16:07:26.801835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:04.368 16:07:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:04.368 16:07:27 -- common/autotest_common.sh@862 -- # return 0 00:21:04.368 16:07:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:04.368 16:07:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:04.368 16:07:27 -- common/autotest_common.sh@10 -- # set +x 00:21:04.368 16:07:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:04.368 16:07:27 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:04.368 16:07:27 -- common/autotest_common.sh@650 -- # local es=0 00:21:04.368 16:07:27 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:04.368 16:07:27 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:21:04.368 16:07:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:04.368 16:07:27 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:21:04.368 16:07:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:04.368 16:07:27 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:04.368 16:07:27 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:04.368 16:07:27 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:04.368 [2024-11-18 16:07:27.927922] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:04.368 16:07:27 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:04.627 16:07:28 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:04.885 [2024-11-18 16:07:28.421243] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:04.885 [2024-11-18 16:07:28.421568] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:04.885 16:07:28 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:05.143 malloc0 00:21:05.143 16:07:28 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:05.401 16:07:28 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:05.660 [2024-11-18 16:07:29.171013] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:21:05.660 [2024-11-18 16:07:29.171053] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:21:05.660 [2024-11-18 16:07:29.171087] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:21:05.660 request: 00:21:05.660 { 00:21:05.660 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:05.660 "host": "nqn.2016-06.io.spdk:host1", 00:21:05.660 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:05.660 "method": "nvmf_subsystem_add_host", 00:21:05.660 "req_id": 1 00:21:05.660 } 00:21:05.660 Got JSON-RPC error response 00:21:05.660 response: 00:21:05.660 { 00:21:05.660 "code": -32603, 00:21:05.660 "message": "Internal error" 00:21:05.660 } 00:21:05.660 16:07:29 -- common/autotest_common.sh@653 -- # es=1 00:21:05.660 16:07:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:05.660 16:07:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:05.660 16:07:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:05.660 16:07:29 -- target/tls.sh@189 -- # killprocess 1616075 00:21:05.660 16:07:29 -- common/autotest_common.sh@936 -- # '[' -z 1616075 ']' 00:21:05.660 16:07:29 -- common/autotest_common.sh@940 -- # kill -0 1616075 00:21:05.660 16:07:29 -- common/autotest_common.sh@941 -- # uname 00:21:05.660 16:07:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:05.660 16:07:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1616075 00:21:05.660 16:07:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:05.660 16:07:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:05.660 16:07:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1616075' 00:21:05.660 killing process with pid 1616075 00:21:05.660 16:07:29 -- common/autotest_common.sh@955 -- # kill 1616075 00:21:05.660 16:07:29 -- common/autotest_common.sh@960 -- # wait 1616075 00:21:05.918 16:07:29 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:05.918 16:07:29 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:21:05.918 16:07:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:05.918 16:07:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:05.918 16:07:29 -- common/autotest_common.sh@10 -- # set +x 00:21:05.918 16:07:29 -- nvmf/common.sh@469 -- # nvmfpid=1616511 00:21:05.918 16:07:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:05.918 16:07:29 -- nvmf/common.sh@470 -- # waitforlisten 1616511 00:21:05.918 16:07:29 -- common/autotest_common.sh@829 -- # '[' -z 1616511 ']' 00:21:05.918 16:07:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:05.918 16:07:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:05.918 16:07:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:05.918 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:05.918 16:07:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:05.918 16:07:29 -- common/autotest_common.sh@10 -- # set +x 00:21:05.918 [2024-11-18 16:07:29.505897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:05.918 [2024-11-18 16:07:29.505971] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:06.176 EAL: No free 2048 kB hugepages reported on node 1 00:21:06.176 [2024-11-18 16:07:29.572454] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:06.176 [2024-11-18 16:07:29.661970] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:06.176 [2024-11-18 16:07:29.662130] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:06.176 [2024-11-18 16:07:29.662157] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:06.176 [2024-11-18 16:07:29.662177] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:06.176 [2024-11-18 16:07:29.662214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:07.111 16:07:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:07.111 16:07:30 -- common/autotest_common.sh@862 -- # return 0 00:21:07.111 16:07:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:07.111 16:07:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:07.111 16:07:30 -- common/autotest_common.sh@10 -- # set +x 00:21:07.111 16:07:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:07.111 16:07:30 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:07.111 16:07:30 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:07.111 16:07:30 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:07.369 [2024-11-18 16:07:30.784066] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:07.369 16:07:30 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:07.627 16:07:31 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:07.885 [2024-11-18 16:07:31.297485] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:07.885 [2024-11-18 16:07:31.297811] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:07.885 16:07:31 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:08.143 malloc0 00:21:08.143 16:07:31 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:08.402 16:07:31 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:08.659 16:07:32 -- target/tls.sh@197 -- # bdevperf_pid=1616806 00:21:08.659 16:07:32 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:08.659 16:07:32 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:08.659 16:07:32 -- target/tls.sh@200 -- # waitforlisten 1616806 /var/tmp/bdevperf.sock 00:21:08.659 16:07:32 -- common/autotest_common.sh@829 -- # '[' -z 1616806 ']' 00:21:08.659 16:07:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:08.659 16:07:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:08.659 16:07:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:08.659 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:08.659 16:07:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:08.659 16:07:32 -- common/autotest_common.sh@10 -- # set +x 00:21:08.659 [2024-11-18 16:07:32.233892] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:08.659 [2024-11-18 16:07:32.233964] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1616806 ] 00:21:08.917 EAL: No free 2048 kB hugepages reported on node 1 00:21:08.917 [2024-11-18 16:07:32.293346] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:08.917 [2024-11-18 16:07:32.376255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:09.851 16:07:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:09.851 16:07:33 -- common/autotest_common.sh@862 -- # return 0 00:21:09.851 16:07:33 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:09.851 [2024-11-18 16:07:33.410957] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:10.109 TLSTESTn1 00:21:10.109 16:07:33 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:21:10.367 16:07:33 -- target/tls.sh@205 -- # tgtconf='{ 00:21:10.367 "subsystems": [ 00:21:10.367 { 00:21:10.367 "subsystem": "iobuf", 00:21:10.367 "config": [ 00:21:10.367 { 00:21:10.367 "method": "iobuf_set_options", 00:21:10.367 "params": { 00:21:10.367 "small_pool_count": 8192, 00:21:10.367 "large_pool_count": 1024, 00:21:10.367 "small_bufsize": 8192, 00:21:10.367 "large_bufsize": 135168 00:21:10.367 } 00:21:10.367 } 00:21:10.367 ] 00:21:10.367 }, 00:21:10.367 { 00:21:10.367 "subsystem": "sock", 00:21:10.367 "config": [ 00:21:10.367 { 00:21:10.367 "method": "sock_impl_set_options", 00:21:10.367 "params": { 00:21:10.367 "impl_name": "posix", 00:21:10.367 "recv_buf_size": 2097152, 00:21:10.367 "send_buf_size": 2097152, 00:21:10.367 "enable_recv_pipe": true, 00:21:10.367 "enable_quickack": false, 00:21:10.367 "enable_placement_id": 0, 00:21:10.367 "enable_zerocopy_send_server": true, 00:21:10.367 "enable_zerocopy_send_client": false, 00:21:10.367 "zerocopy_threshold": 0, 00:21:10.367 "tls_version": 0, 00:21:10.367 "enable_ktls": false 00:21:10.367 } 00:21:10.367 }, 00:21:10.367 { 00:21:10.367 "method": "sock_impl_set_options", 00:21:10.367 "params": { 00:21:10.367 "impl_name": "ssl", 00:21:10.367 "recv_buf_size": 4096, 00:21:10.367 "send_buf_size": 4096, 00:21:10.367 "enable_recv_pipe": true, 00:21:10.367 "enable_quickack": false, 00:21:10.367 "enable_placement_id": 0, 00:21:10.367 "enable_zerocopy_send_server": true, 00:21:10.367 "enable_zerocopy_send_client": false, 00:21:10.367 "zerocopy_threshold": 0, 00:21:10.367 "tls_version": 0, 00:21:10.367 "enable_ktls": false 00:21:10.367 } 00:21:10.367 } 00:21:10.367 ] 00:21:10.367 }, 00:21:10.367 { 00:21:10.367 "subsystem": "vmd", 00:21:10.367 "config": [] 00:21:10.367 }, 00:21:10.367 { 00:21:10.367 "subsystem": "accel", 00:21:10.367 "config": [ 00:21:10.367 { 00:21:10.367 "method": "accel_set_options", 00:21:10.367 "params": { 00:21:10.367 "small_cache_size": 128, 00:21:10.367 "large_cache_size": 16, 00:21:10.367 "task_count": 2048, 00:21:10.367 "sequence_count": 2048, 00:21:10.367 "buf_count": 2048 00:21:10.367 } 00:21:10.367 } 00:21:10.367 ] 00:21:10.367 }, 00:21:10.367 { 00:21:10.367 "subsystem": "bdev", 00:21:10.367 "config": [ 00:21:10.367 { 00:21:10.367 "method": "bdev_set_options", 00:21:10.367 "params": { 00:21:10.367 "bdev_io_pool_size": 65535, 00:21:10.367 "bdev_io_cache_size": 256, 00:21:10.367 "bdev_auto_examine": true, 00:21:10.368 "iobuf_small_cache_size": 128, 00:21:10.368 "iobuf_large_cache_size": 16 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "bdev_raid_set_options", 00:21:10.368 "params": { 00:21:10.368 "process_window_size_kb": 1024 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "bdev_iscsi_set_options", 00:21:10.368 "params": { 00:21:10.368 "timeout_sec": 30 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "bdev_nvme_set_options", 00:21:10.368 "params": { 00:21:10.368 "action_on_timeout": "none", 00:21:10.368 "timeout_us": 0, 00:21:10.368 "timeout_admin_us": 0, 00:21:10.368 "keep_alive_timeout_ms": 10000, 00:21:10.368 "transport_retry_count": 4, 00:21:10.368 "arbitration_burst": 0, 00:21:10.368 "low_priority_weight": 0, 00:21:10.368 "medium_priority_weight": 0, 00:21:10.368 "high_priority_weight": 0, 00:21:10.368 "nvme_adminq_poll_period_us": 10000, 00:21:10.368 "nvme_ioq_poll_period_us": 0, 00:21:10.368 "io_queue_requests": 0, 00:21:10.368 "delay_cmd_submit": true, 00:21:10.368 "bdev_retry_count": 3, 00:21:10.368 "transport_ack_timeout": 0, 00:21:10.368 "ctrlr_loss_timeout_sec": 0, 00:21:10.368 "reconnect_delay_sec": 0, 00:21:10.368 "fast_io_fail_timeout_sec": 0, 00:21:10.368 "generate_uuids": false, 00:21:10.368 "transport_tos": 0, 00:21:10.368 "io_path_stat": false, 00:21:10.368 "allow_accel_sequence": false 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "bdev_nvme_set_hotplug", 00:21:10.368 "params": { 00:21:10.368 "period_us": 100000, 00:21:10.368 "enable": false 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "bdev_malloc_create", 00:21:10.368 "params": { 00:21:10.368 "name": "malloc0", 00:21:10.368 "num_blocks": 8192, 00:21:10.368 "block_size": 4096, 00:21:10.368 "physical_block_size": 4096, 00:21:10.368 "uuid": "da92c105-36fb-4638-81fa-2e036c340759", 00:21:10.368 "optimal_io_boundary": 0 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "bdev_wait_for_examine" 00:21:10.368 } 00:21:10.368 ] 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "subsystem": "nbd", 00:21:10.368 "config": [] 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "subsystem": "scheduler", 00:21:10.368 "config": [ 00:21:10.368 { 00:21:10.368 "method": "framework_set_scheduler", 00:21:10.368 "params": { 00:21:10.368 "name": "static" 00:21:10.368 } 00:21:10.368 } 00:21:10.368 ] 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "subsystem": "nvmf", 00:21:10.368 "config": [ 00:21:10.368 { 00:21:10.368 "method": "nvmf_set_config", 00:21:10.368 "params": { 00:21:10.368 "discovery_filter": "match_any", 00:21:10.368 "admin_cmd_passthru": { 00:21:10.368 "identify_ctrlr": false 00:21:10.368 } 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "nvmf_set_max_subsystems", 00:21:10.368 "params": { 00:21:10.368 "max_subsystems": 1024 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "nvmf_set_crdt", 00:21:10.368 "params": { 00:21:10.368 "crdt1": 0, 00:21:10.368 "crdt2": 0, 00:21:10.368 "crdt3": 0 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "nvmf_create_transport", 00:21:10.368 "params": { 00:21:10.368 "trtype": "TCP", 00:21:10.368 "max_queue_depth": 128, 00:21:10.368 "max_io_qpairs_per_ctrlr": 127, 00:21:10.368 "in_capsule_data_size": 4096, 00:21:10.368 "max_io_size": 131072, 00:21:10.368 "io_unit_size": 131072, 00:21:10.368 "max_aq_depth": 128, 00:21:10.368 "num_shared_buffers": 511, 00:21:10.368 "buf_cache_size": 4294967295, 00:21:10.368 "dif_insert_or_strip": false, 00:21:10.368 "zcopy": false, 00:21:10.368 "c2h_success": false, 00:21:10.368 "sock_priority": 0, 00:21:10.368 "abort_timeout_sec": 1 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "nvmf_create_subsystem", 00:21:10.368 "params": { 00:21:10.368 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:10.368 "allow_any_host": false, 00:21:10.368 "serial_number": "SPDK00000000000001", 00:21:10.368 "model_number": "SPDK bdev Controller", 00:21:10.368 "max_namespaces": 10, 00:21:10.368 "min_cntlid": 1, 00:21:10.368 "max_cntlid": 65519, 00:21:10.368 "ana_reporting": false 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "nvmf_subsystem_add_host", 00:21:10.368 "params": { 00:21:10.368 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:10.368 "host": "nqn.2016-06.io.spdk:host1", 00:21:10.368 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "nvmf_subsystem_add_ns", 00:21:10.368 "params": { 00:21:10.368 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:10.368 "namespace": { 00:21:10.368 "nsid": 1, 00:21:10.368 "bdev_name": "malloc0", 00:21:10.368 "nguid": "DA92C10536FB463881FA2E036C340759", 00:21:10.368 "uuid": "da92c105-36fb-4638-81fa-2e036c340759" 00:21:10.368 } 00:21:10.368 } 00:21:10.368 }, 00:21:10.368 { 00:21:10.368 "method": "nvmf_subsystem_add_listener", 00:21:10.368 "params": { 00:21:10.368 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:10.368 "listen_address": { 00:21:10.368 "trtype": "TCP", 00:21:10.368 "adrfam": "IPv4", 00:21:10.368 "traddr": "10.0.0.2", 00:21:10.368 "trsvcid": "4420" 00:21:10.368 }, 00:21:10.368 "secure_channel": true 00:21:10.368 } 00:21:10.368 } 00:21:10.368 ] 00:21:10.368 } 00:21:10.368 ] 00:21:10.368 }' 00:21:10.368 16:07:33 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:21:10.626 16:07:34 -- target/tls.sh@206 -- # bdevperfconf='{ 00:21:10.626 "subsystems": [ 00:21:10.626 { 00:21:10.626 "subsystem": "iobuf", 00:21:10.626 "config": [ 00:21:10.626 { 00:21:10.626 "method": "iobuf_set_options", 00:21:10.626 "params": { 00:21:10.626 "small_pool_count": 8192, 00:21:10.626 "large_pool_count": 1024, 00:21:10.626 "small_bufsize": 8192, 00:21:10.626 "large_bufsize": 135168 00:21:10.626 } 00:21:10.626 } 00:21:10.626 ] 00:21:10.626 }, 00:21:10.626 { 00:21:10.626 "subsystem": "sock", 00:21:10.626 "config": [ 00:21:10.626 { 00:21:10.626 "method": "sock_impl_set_options", 00:21:10.626 "params": { 00:21:10.626 "impl_name": "posix", 00:21:10.626 "recv_buf_size": 2097152, 00:21:10.626 "send_buf_size": 2097152, 00:21:10.626 "enable_recv_pipe": true, 00:21:10.626 "enable_quickack": false, 00:21:10.626 "enable_placement_id": 0, 00:21:10.627 "enable_zerocopy_send_server": true, 00:21:10.627 "enable_zerocopy_send_client": false, 00:21:10.627 "zerocopy_threshold": 0, 00:21:10.627 "tls_version": 0, 00:21:10.627 "enable_ktls": false 00:21:10.627 } 00:21:10.627 }, 00:21:10.627 { 00:21:10.627 "method": "sock_impl_set_options", 00:21:10.627 "params": { 00:21:10.627 "impl_name": "ssl", 00:21:10.627 "recv_buf_size": 4096, 00:21:10.627 "send_buf_size": 4096, 00:21:10.627 "enable_recv_pipe": true, 00:21:10.627 "enable_quickack": false, 00:21:10.627 "enable_placement_id": 0, 00:21:10.627 "enable_zerocopy_send_server": true, 00:21:10.627 "enable_zerocopy_send_client": false, 00:21:10.627 "zerocopy_threshold": 0, 00:21:10.627 "tls_version": 0, 00:21:10.627 "enable_ktls": false 00:21:10.627 } 00:21:10.627 } 00:21:10.627 ] 00:21:10.627 }, 00:21:10.627 { 00:21:10.627 "subsystem": "vmd", 00:21:10.627 "config": [] 00:21:10.627 }, 00:21:10.627 { 00:21:10.627 "subsystem": "accel", 00:21:10.627 "config": [ 00:21:10.627 { 00:21:10.627 "method": "accel_set_options", 00:21:10.627 "params": { 00:21:10.627 "small_cache_size": 128, 00:21:10.627 "large_cache_size": 16, 00:21:10.627 "task_count": 2048, 00:21:10.627 "sequence_count": 2048, 00:21:10.627 "buf_count": 2048 00:21:10.627 } 00:21:10.627 } 00:21:10.627 ] 00:21:10.627 }, 00:21:10.627 { 00:21:10.627 "subsystem": "bdev", 00:21:10.627 "config": [ 00:21:10.627 { 00:21:10.627 "method": "bdev_set_options", 00:21:10.627 "params": { 00:21:10.627 "bdev_io_pool_size": 65535, 00:21:10.627 "bdev_io_cache_size": 256, 00:21:10.627 "bdev_auto_examine": true, 00:21:10.627 "iobuf_small_cache_size": 128, 00:21:10.627 "iobuf_large_cache_size": 16 00:21:10.627 } 00:21:10.627 }, 00:21:10.627 { 00:21:10.627 "method": "bdev_raid_set_options", 00:21:10.627 "params": { 00:21:10.627 "process_window_size_kb": 1024 00:21:10.627 } 00:21:10.627 }, 00:21:10.627 { 00:21:10.627 "method": "bdev_iscsi_set_options", 00:21:10.627 "params": { 00:21:10.627 "timeout_sec": 30 00:21:10.627 } 00:21:10.627 }, 00:21:10.627 { 00:21:10.627 "method": "bdev_nvme_set_options", 00:21:10.627 "params": { 00:21:10.627 "action_on_timeout": "none", 00:21:10.627 "timeout_us": 0, 00:21:10.627 "timeout_admin_us": 0, 00:21:10.627 "keep_alive_timeout_ms": 10000, 00:21:10.627 "transport_retry_count": 4, 00:21:10.627 "arbitration_burst": 0, 00:21:10.627 "low_priority_weight": 0, 00:21:10.627 "medium_priority_weight": 0, 00:21:10.627 "high_priority_weight": 0, 00:21:10.627 "nvme_adminq_poll_period_us": 10000, 00:21:10.627 "nvme_ioq_poll_period_us": 0, 00:21:10.627 "io_queue_requests": 512, 00:21:10.627 "delay_cmd_submit": true, 00:21:10.627 "bdev_retry_count": 3, 00:21:10.627 "transport_ack_timeout": 0, 00:21:10.627 "ctrlr_loss_timeout_sec": 0, 00:21:10.627 "reconnect_delay_sec": 0, 00:21:10.627 "fast_io_fail_timeout_sec": 0, 00:21:10.627 "generate_uuids": false, 00:21:10.627 "transport_tos": 0, 00:21:10.627 "io_path_stat": false, 00:21:10.627 "allow_accel_sequence": false 00:21:10.627 } 00:21:10.627 }, 00:21:10.627 { 00:21:10.627 "method": "bdev_nvme_attach_controller", 00:21:10.627 "params": { 00:21:10.627 "name": "TLSTEST", 00:21:10.627 "trtype": "TCP", 00:21:10.627 "adrfam": "IPv4", 00:21:10.627 "traddr": "10.0.0.2", 00:21:10.627 "trsvcid": "4420", 00:21:10.627 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:10.627 "prchk_reftag": false, 00:21:10.627 "prchk_guard": false, 00:21:10.627 "ctrlr_loss_timeout_sec": 0, 00:21:10.627 "reconnect_delay_sec": 0, 00:21:10.627 "fast_io_fail_timeout_sec": 0, 00:21:10.627 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:10.627 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:10.627 "hdgst": false, 00:21:10.627 "ddgst": false 00:21:10.627 } 00:21:10.627 }, 00:21:10.627 { 00:21:10.627 "method": "bdev_nvme_set_hotplug", 00:21:10.627 "params": { 00:21:10.627 "period_us": 100000, 00:21:10.627 "enable": false 00:21:10.627 } 00:21:10.627 }, 00:21:10.627 { 00:21:10.627 "method": "bdev_wait_for_examine" 00:21:10.627 } 00:21:10.627 ] 00:21:10.627 }, 00:21:10.627 { 00:21:10.627 "subsystem": "nbd", 00:21:10.627 "config": [] 00:21:10.627 } 00:21:10.627 ] 00:21:10.627 }' 00:21:10.627 16:07:34 -- target/tls.sh@208 -- # killprocess 1616806 00:21:10.627 16:07:34 -- common/autotest_common.sh@936 -- # '[' -z 1616806 ']' 00:21:10.627 16:07:34 -- common/autotest_common.sh@940 -- # kill -0 1616806 00:21:10.627 16:07:34 -- common/autotest_common.sh@941 -- # uname 00:21:10.627 16:07:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:10.627 16:07:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1616806 00:21:10.627 16:07:34 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:10.627 16:07:34 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:10.627 16:07:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1616806' 00:21:10.627 killing process with pid 1616806 00:21:10.627 16:07:34 -- common/autotest_common.sh@955 -- # kill 1616806 00:21:10.627 Received shutdown signal, test time was about 10.000000 seconds 00:21:10.627 00:21:10.627 Latency(us) 00:21:10.627 [2024-11-18T15:07:34.218Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:10.627 [2024-11-18T15:07:34.218Z] =================================================================================================================== 00:21:10.627 [2024-11-18T15:07:34.218Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:10.627 16:07:34 -- common/autotest_common.sh@960 -- # wait 1616806 00:21:10.885 16:07:34 -- target/tls.sh@209 -- # killprocess 1616511 00:21:10.885 16:07:34 -- common/autotest_common.sh@936 -- # '[' -z 1616511 ']' 00:21:10.885 16:07:34 -- common/autotest_common.sh@940 -- # kill -0 1616511 00:21:10.885 16:07:34 -- common/autotest_common.sh@941 -- # uname 00:21:10.885 16:07:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:10.885 16:07:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1616511 00:21:10.885 16:07:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:10.885 16:07:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:10.885 16:07:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1616511' 00:21:10.885 killing process with pid 1616511 00:21:10.885 16:07:34 -- common/autotest_common.sh@955 -- # kill 1616511 00:21:10.885 16:07:34 -- common/autotest_common.sh@960 -- # wait 1616511 00:21:11.143 16:07:34 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:21:11.143 16:07:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:11.143 16:07:34 -- target/tls.sh@212 -- # echo '{ 00:21:11.143 "subsystems": [ 00:21:11.143 { 00:21:11.143 "subsystem": "iobuf", 00:21:11.143 "config": [ 00:21:11.143 { 00:21:11.143 "method": "iobuf_set_options", 00:21:11.143 "params": { 00:21:11.143 "small_pool_count": 8192, 00:21:11.143 "large_pool_count": 1024, 00:21:11.143 "small_bufsize": 8192, 00:21:11.143 "large_bufsize": 135168 00:21:11.143 } 00:21:11.143 } 00:21:11.143 ] 00:21:11.143 }, 00:21:11.143 { 00:21:11.143 "subsystem": "sock", 00:21:11.143 "config": [ 00:21:11.143 { 00:21:11.143 "method": "sock_impl_set_options", 00:21:11.143 "params": { 00:21:11.143 "impl_name": "posix", 00:21:11.143 "recv_buf_size": 2097152, 00:21:11.143 "send_buf_size": 2097152, 00:21:11.143 "enable_recv_pipe": true, 00:21:11.143 "enable_quickack": false, 00:21:11.143 "enable_placement_id": 0, 00:21:11.143 "enable_zerocopy_send_server": true, 00:21:11.143 "enable_zerocopy_send_client": false, 00:21:11.143 "zerocopy_threshold": 0, 00:21:11.143 "tls_version": 0, 00:21:11.143 "enable_ktls": false 00:21:11.143 } 00:21:11.143 }, 00:21:11.143 { 00:21:11.143 "method": "sock_impl_set_options", 00:21:11.143 "params": { 00:21:11.143 "impl_name": "ssl", 00:21:11.143 "recv_buf_size": 4096, 00:21:11.143 "send_buf_size": 4096, 00:21:11.143 "enable_recv_pipe": true, 00:21:11.143 "enable_quickack": false, 00:21:11.143 "enable_placement_id": 0, 00:21:11.143 "enable_zerocopy_send_server": true, 00:21:11.143 "enable_zerocopy_send_client": false, 00:21:11.143 "zerocopy_threshold": 0, 00:21:11.143 "tls_version": 0, 00:21:11.143 "enable_ktls": false 00:21:11.143 } 00:21:11.143 } 00:21:11.143 ] 00:21:11.143 }, 00:21:11.143 { 00:21:11.143 "subsystem": "vmd", 00:21:11.143 "config": [] 00:21:11.143 }, 00:21:11.143 { 00:21:11.143 "subsystem": "accel", 00:21:11.143 "config": [ 00:21:11.143 { 00:21:11.143 "method": "accel_set_options", 00:21:11.143 "params": { 00:21:11.143 "small_cache_size": 128, 00:21:11.143 "large_cache_size": 16, 00:21:11.143 "task_count": 2048, 00:21:11.143 "sequence_count": 2048, 00:21:11.143 "buf_count": 2048 00:21:11.143 } 00:21:11.143 } 00:21:11.143 ] 00:21:11.143 }, 00:21:11.143 { 00:21:11.143 "subsystem": "bdev", 00:21:11.143 "config": [ 00:21:11.143 { 00:21:11.143 "method": "bdev_set_options", 00:21:11.143 "params": { 00:21:11.143 "bdev_io_pool_size": 65535, 00:21:11.143 "bdev_io_cache_size": 256, 00:21:11.143 "bdev_auto_examine": true, 00:21:11.143 "iobuf_small_cache_size": 128, 00:21:11.143 "iobuf_large_cache_size": 16 00:21:11.143 } 00:21:11.143 }, 00:21:11.143 { 00:21:11.143 "method": "bdev_raid_set_options", 00:21:11.143 "params": { 00:21:11.143 "process_window_size_kb": 1024 00:21:11.143 } 00:21:11.143 }, 00:21:11.143 { 00:21:11.143 "method": "bdev_iscsi_set_options", 00:21:11.143 "params": { 00:21:11.143 "timeout_sec": 30 00:21:11.143 } 00:21:11.143 }, 00:21:11.143 { 00:21:11.143 "method": "bdev_nvme_set_options", 00:21:11.143 "params": { 00:21:11.143 "action_on_timeout": "none", 00:21:11.143 "timeout_us": 0, 00:21:11.143 "timeout_admin_us": 0, 00:21:11.143 "keep_alive_timeout_ms": 10000, 00:21:11.143 "transport_retry_count": 4, 00:21:11.143 "arbitration_burst": 0, 00:21:11.143 "low_priority_weight": 0, 00:21:11.143 "medium_priority_weight": 0, 00:21:11.143 "high_priority_weight": 0, 00:21:11.143 "nvme_adminq_poll_period_us": 10000, 00:21:11.144 "nvme_ioq_poll_period_us": 0, 00:21:11.144 "io_queue_requests": 0, 00:21:11.144 "delay_cmd_submit": true, 00:21:11.144 "bdev_retry_count": 3, 00:21:11.144 "transport_ack_timeout": 0, 00:21:11.144 "ctrlr_loss_timeout_sec": 0, 00:21:11.144 "reconnect_delay_sec": 0, 00:21:11.144 "fast_io_fail_timeout_sec": 0, 00:21:11.144 "generate_uuids": false, 00:21:11.144 "transport_tos": 0, 00:21:11.144 "io_path_stat": false, 00:21:11.144 "allow_accel_sequence": false 00:21:11.144 } 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "method": "bdev_nvme_set_hotplug", 00:21:11.144 "params": { 00:21:11.144 "period_us": 100000, 00:21:11.144 "enable": false 00:21:11.144 } 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "method": "bdev_malloc_create", 00:21:11.144 "params": { 00:21:11.144 "name": "malloc0", 00:21:11.144 "num_blocks": 8192, 00:21:11.144 "block_size": 4096, 00:21:11.144 "physical_block_size": 4096, 00:21:11.144 "uuid": "da92c105-36fb-4638-81fa-2e036c340759", 00:21:11.144 "optimal_io_boundary": 0 00:21:11.144 } 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "method": "bdev_wait_for_examine" 00:21:11.144 } 00:21:11.144 ] 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "subsystem": "nbd", 00:21:11.144 "config": [] 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "subsystem": "scheduler", 00:21:11.144 "config": [ 00:21:11.144 { 00:21:11.144 "method": "framework_set_scheduler", 00:21:11.144 "params": { 00:21:11.144 "name": "static" 00:21:11.144 } 00:21:11.144 } 00:21:11.144 ] 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "subsystem": "nvmf", 00:21:11.144 "config": [ 00:21:11.144 { 00:21:11.144 "method": "nvmf_set_config", 00:21:11.144 "params": { 00:21:11.144 "discovery_filter": "match_any", 00:21:11.144 "admin_cmd_passthru": { 00:21:11.144 "identify_ctrlr": false 00:21:11.144 } 00:21:11.144 } 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "method": "nvmf_set_max_subsystems", 00:21:11.144 "params": { 00:21:11.144 "max_subsystems": 1024 00:21:11.144 } 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "method": "nvmf_set_crdt", 00:21:11.144 "params": { 00:21:11.144 "crdt1": 0, 00:21:11.144 "crdt2": 0, 00:21:11.144 "crdt3": 0 00:21:11.144 } 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "method": "nvmf_create_transport", 00:21:11.144 "params": { 00:21:11.144 "trtype": "TCP", 00:21:11.144 "max_queue_depth": 128, 00:21:11.144 "max_io_qpairs_per_ctrlr": 127, 00:21:11.144 "in_capsule_data_size": 4096, 00:21:11.144 "max_io_size": 131072, 00:21:11.144 "io_unit_size": 131072, 00:21:11.144 "max_aq_depth": 128, 00:21:11.144 "num_shared_buffers": 511, 00:21:11.144 "buf_cache_size": 4294967295, 00:21:11.144 "dif_insert_or_strip": false, 00:21:11.144 "zcopy": false, 00:21:11.144 "c2h_success": false, 00:21:11.144 "sock_priority": 0, 00:21:11.144 "abort_timeout_sec": 1 00:21:11.144 } 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "method": "nvmf_create_subsystem", 00:21:11.144 "params": { 00:21:11.144 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:11.144 "allow_any_host": false, 00:21:11.144 "serial_number": "SPDK00000000000001", 00:21:11.144 "model_number": "SPDK bdev Controller", 00:21:11.144 "max_namespaces": 10, 00:21:11.144 "min_cntlid": 1, 00:21:11.144 "max_cntlid": 65519, 00:21:11.144 "ana_reporting": false 00:21:11.144 } 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "method": "nvmf_subsystem_add_host", 00:21:11.144 "params": { 00:21:11.144 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:11.144 "host": "nqn.2016-06.io.spdk:host1", 00:21:11.144 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:11.144 } 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "method": "nvmf_subsystem_add_ns", 00:21:11.144 "params": { 00:21:11.144 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:11.144 "namespace": { 00:21:11.144 "nsid": 1, 00:21:11.144 "bdev_name": "malloc0", 00:21:11.144 "nguid": "DA92C10536FB463881FA2E036C340759", 00:21:11.144 "uuid": "da92c105-36fb-4638-81fa-2e036c340759" 00:21:11.144 } 00:21:11.144 } 00:21:11.144 }, 00:21:11.144 { 00:21:11.144 "method": "nvmf_subsystem_add_listener", 00:21:11.144 "params": { 00:21:11.144 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:11.144 "listen_address": { 00:21:11.144 "trtype": "TCP", 00:21:11.144 "adrfam": "IPv4", 00:21:11.144 "traddr": "10.0.0.2", 00:21:11.144 "trsvcid": "4420" 00:21:11.144 }, 00:21:11.144 "secure_channel": true 00:21:11.144 } 00:21:11.144 } 00:21:11.144 ] 00:21:11.144 } 00:21:11.144 ] 00:21:11.144 }' 00:21:11.144 16:07:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:11.144 16:07:34 -- common/autotest_common.sh@10 -- # set +x 00:21:11.144 16:07:34 -- nvmf/common.sh@469 -- # nvmfpid=1617109 00:21:11.144 16:07:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:21:11.144 16:07:34 -- nvmf/common.sh@470 -- # waitforlisten 1617109 00:21:11.144 16:07:34 -- common/autotest_common.sh@829 -- # '[' -z 1617109 ']' 00:21:11.144 16:07:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:11.144 16:07:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:11.144 16:07:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:11.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:11.144 16:07:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:11.144 16:07:34 -- common/autotest_common.sh@10 -- # set +x 00:21:11.144 [2024-11-18 16:07:34.674603] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:11.144 [2024-11-18 16:07:34.674716] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:11.144 EAL: No free 2048 kB hugepages reported on node 1 00:21:11.403 [2024-11-18 16:07:34.748982] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:11.403 [2024-11-18 16:07:34.841199] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:11.403 [2024-11-18 16:07:34.841385] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:11.403 [2024-11-18 16:07:34.841414] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:11.403 [2024-11-18 16:07:34.841437] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:11.403 [2024-11-18 16:07:34.841478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:11.660 [2024-11-18 16:07:35.071245] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:11.660 [2024-11-18 16:07:35.103267] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:11.661 [2024-11-18 16:07:35.103582] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:12.226 16:07:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:12.226 16:07:35 -- common/autotest_common.sh@862 -- # return 0 00:21:12.226 16:07:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:12.226 16:07:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:12.226 16:07:35 -- common/autotest_common.sh@10 -- # set +x 00:21:12.226 16:07:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:12.226 16:07:35 -- target/tls.sh@216 -- # bdevperf_pid=1617262 00:21:12.226 16:07:35 -- target/tls.sh@217 -- # waitforlisten 1617262 /var/tmp/bdevperf.sock 00:21:12.226 16:07:35 -- common/autotest_common.sh@829 -- # '[' -z 1617262 ']' 00:21:12.226 16:07:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:12.226 16:07:35 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:12.226 16:07:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:12.226 16:07:35 -- target/tls.sh@213 -- # echo '{ 00:21:12.226 "subsystems": [ 00:21:12.226 { 00:21:12.226 "subsystem": "iobuf", 00:21:12.226 "config": [ 00:21:12.226 { 00:21:12.226 "method": "iobuf_set_options", 00:21:12.226 "params": { 00:21:12.226 "small_pool_count": 8192, 00:21:12.226 "large_pool_count": 1024, 00:21:12.226 "small_bufsize": 8192, 00:21:12.226 "large_bufsize": 135168 00:21:12.226 } 00:21:12.226 } 00:21:12.226 ] 00:21:12.226 }, 00:21:12.226 { 00:21:12.226 "subsystem": "sock", 00:21:12.226 "config": [ 00:21:12.226 { 00:21:12.226 "method": "sock_impl_set_options", 00:21:12.226 "params": { 00:21:12.226 "impl_name": "posix", 00:21:12.226 "recv_buf_size": 2097152, 00:21:12.226 "send_buf_size": 2097152, 00:21:12.226 "enable_recv_pipe": true, 00:21:12.226 "enable_quickack": false, 00:21:12.226 "enable_placement_id": 0, 00:21:12.226 "enable_zerocopy_send_server": true, 00:21:12.226 "enable_zerocopy_send_client": false, 00:21:12.226 "zerocopy_threshold": 0, 00:21:12.226 "tls_version": 0, 00:21:12.226 "enable_ktls": false 00:21:12.226 } 00:21:12.226 }, 00:21:12.226 { 00:21:12.226 "method": "sock_impl_set_options", 00:21:12.226 "params": { 00:21:12.226 "impl_name": "ssl", 00:21:12.226 "recv_buf_size": 4096, 00:21:12.226 "send_buf_size": 4096, 00:21:12.226 "enable_recv_pipe": true, 00:21:12.226 "enable_quickack": false, 00:21:12.226 "enable_placement_id": 0, 00:21:12.226 "enable_zerocopy_send_server": true, 00:21:12.226 "enable_zerocopy_send_client": false, 00:21:12.226 "zerocopy_threshold": 0, 00:21:12.226 "tls_version": 0, 00:21:12.226 "enable_ktls": false 00:21:12.226 } 00:21:12.226 } 00:21:12.226 ] 00:21:12.226 }, 00:21:12.226 { 00:21:12.226 "subsystem": "vmd", 00:21:12.226 "config": [] 00:21:12.226 }, 00:21:12.226 { 00:21:12.226 "subsystem": "accel", 00:21:12.226 "config": [ 00:21:12.226 { 00:21:12.226 "method": "accel_set_options", 00:21:12.226 "params": { 00:21:12.226 "small_cache_size": 128, 00:21:12.226 "large_cache_size": 16, 00:21:12.226 "task_count": 2048, 00:21:12.226 "sequence_count": 2048, 00:21:12.226 "buf_count": 2048 00:21:12.226 } 00:21:12.226 } 00:21:12.226 ] 00:21:12.226 }, 00:21:12.226 { 00:21:12.226 "subsystem": "bdev", 00:21:12.226 "config": [ 00:21:12.226 { 00:21:12.226 "method": "bdev_set_options", 00:21:12.226 "params": { 00:21:12.226 "bdev_io_pool_size": 65535, 00:21:12.226 "bdev_io_cache_size": 256, 00:21:12.226 "bdev_auto_examine": true, 00:21:12.226 "iobuf_small_cache_size": 128, 00:21:12.226 "iobuf_large_cache_size": 16 00:21:12.226 } 00:21:12.226 }, 00:21:12.226 { 00:21:12.227 "method": "bdev_raid_set_options", 00:21:12.227 "params": { 00:21:12.227 "process_window_size_kb": 1024 00:21:12.227 } 00:21:12.227 }, 00:21:12.227 { 00:21:12.227 "method": "bdev_iscsi_set_options", 00:21:12.227 "params": { 00:21:12.227 "timeout_sec": 30 00:21:12.227 } 00:21:12.227 }, 00:21:12.227 { 00:21:12.227 "method": "bdev_nvme_set_options", 00:21:12.227 "params": { 00:21:12.227 "action_on_timeout": "none", 00:21:12.227 "timeout_us": 0, 00:21:12.227 "timeout_admin_us": 0, 00:21:12.227 "keep_alive_timeout_ms": 10000, 00:21:12.227 "transport_retry_count": 4, 00:21:12.227 "arbitration_burst": 0, 00:21:12.227 "low_priority_weight": 0, 00:21:12.227 "medium_priority_weight": 0, 00:21:12.227 "high_priority_weight": 0, 00:21:12.227 "nvme_adminq_poll_period_us": 10000, 00:21:12.227 "nvme_ioq_poll_period_us": 0, 00:21:12.227 "io_queue_requests": 512, 00:21:12.227 "delay_cmd_submit": true, 00:21:12.227 "bdev_retry_count": 3, 00:21:12.227 "transport_ack_timeout": 0, 00:21:12.227 "ctrlr_loss_timeout_sec": 0, 00:21:12.227 "reconnect_delay_sec": 0, 00:21:12.227 "fast_io_fail_timeout_sec": 0, 00:21:12.227 "generate_uuids": false, 00:21:12.227 "transport_tos": 0, 00:21:12.227 "io_path_stat": false, 00:21:12.227 "allow_accel_sequence": false 00:21:12.227 } 00:21:12.227 }, 00:21:12.227 { 00:21:12.227 "method": "bdev_nvme_attach_controller", 00:21:12.227 "params": { 00:21:12.227 "name": "TLSTEST", 00:21:12.227 "trtype": "TCP", 00:21:12.227 "adrfam": "IPv4", 00:21:12.227 "traddr": "10.0.0.2", 00:21:12.227 "trsvcid": "4420", 00:21:12.227 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:12.227 "prchk_reftag": false, 00:21:12.227 "prchk_guard": false, 00:21:12.227 "ctrlr_loss_timeout_sec": 0, 00:21:12.227 "reconnect_delay_sec": 0, 00:21:12.227 "fast_io_fail_timeout_sec": 0, 00:21:12.227 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:12.227 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:12.227 "hdgst": false, 00:21:12.227 "ddgst": false 00:21:12.227 } 00:21:12.227 }, 00:21:12.227 { 00:21:12.227 "method": "bdev_nvme_set_hotplug", 00:21:12.227 "params": { 00:21:12.227 "period_us": 100000, 00:21:12.227 "enable": false 00:21:12.227 } 00:21:12.227 }, 00:21:12.227 { 00:21:12.227 "method": "bdev_wait_for_examine" 00:21:12.227 } 00:21:12.227 ] 00:21:12.227 }, 00:21:12.227 { 00:21:12.227 "subsystem": "nbd", 00:21:12.227 "config": [] 00:21:12.227 } 00:21:12.227 ] 00:21:12.227 }' 00:21:12.227 16:07:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:12.227 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:12.227 16:07:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:12.227 16:07:35 -- common/autotest_common.sh@10 -- # set +x 00:21:12.227 [2024-11-18 16:07:35.742185] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:12.227 [2024-11-18 16:07:35.742266] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1617262 ] 00:21:12.227 EAL: No free 2048 kB hugepages reported on node 1 00:21:12.227 [2024-11-18 16:07:35.802168] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:12.485 [2024-11-18 16:07:35.888923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:12.485 [2024-11-18 16:07:36.049174] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:13.419 16:07:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:13.419 16:07:36 -- common/autotest_common.sh@862 -- # return 0 00:21:13.419 16:07:36 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:13.419 Running I/O for 10 seconds... 00:21:23.387 00:21:23.387 Latency(us) 00:21:23.387 [2024-11-18T15:07:46.978Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:23.387 [2024-11-18T15:07:46.978Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:23.387 Verification LBA range: start 0x0 length 0x2000 00:21:23.387 TLSTESTn1 : 10.01 4377.00 17.10 0.00 0.00 29203.44 4344.79 47574.28 00:21:23.387 [2024-11-18T15:07:46.978Z] =================================================================================================================== 00:21:23.387 [2024-11-18T15:07:46.978Z] Total : 4377.00 17.10 0.00 0.00 29203.44 4344.79 47574.28 00:21:23.387 0 00:21:23.387 16:07:46 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:23.387 16:07:46 -- target/tls.sh@223 -- # killprocess 1617262 00:21:23.387 16:07:46 -- common/autotest_common.sh@936 -- # '[' -z 1617262 ']' 00:21:23.387 16:07:46 -- common/autotest_common.sh@940 -- # kill -0 1617262 00:21:23.387 16:07:46 -- common/autotest_common.sh@941 -- # uname 00:21:23.387 16:07:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:23.387 16:07:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1617262 00:21:23.387 16:07:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:23.387 16:07:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:23.387 16:07:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1617262' 00:21:23.387 killing process with pid 1617262 00:21:23.387 16:07:46 -- common/autotest_common.sh@955 -- # kill 1617262 00:21:23.387 Received shutdown signal, test time was about 10.000000 seconds 00:21:23.387 00:21:23.387 Latency(us) 00:21:23.387 [2024-11-18T15:07:46.978Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:23.387 [2024-11-18T15:07:46.978Z] =================================================================================================================== 00:21:23.387 [2024-11-18T15:07:46.978Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:23.387 16:07:46 -- common/autotest_common.sh@960 -- # wait 1617262 00:21:23.645 16:07:47 -- target/tls.sh@224 -- # killprocess 1617109 00:21:23.645 16:07:47 -- common/autotest_common.sh@936 -- # '[' -z 1617109 ']' 00:21:23.645 16:07:47 -- common/autotest_common.sh@940 -- # kill -0 1617109 00:21:23.645 16:07:47 -- common/autotest_common.sh@941 -- # uname 00:21:23.645 16:07:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:23.645 16:07:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1617109 00:21:23.645 16:07:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:23.645 16:07:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:23.645 16:07:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1617109' 00:21:23.645 killing process with pid 1617109 00:21:23.645 16:07:47 -- common/autotest_common.sh@955 -- # kill 1617109 00:21:23.645 16:07:47 -- common/autotest_common.sh@960 -- # wait 1617109 00:21:23.904 16:07:47 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:23.904 16:07:47 -- target/tls.sh@227 -- # cleanup 00:21:23.904 16:07:47 -- target/tls.sh@15 -- # process_shm --id 0 00:21:23.904 16:07:47 -- common/autotest_common.sh@806 -- # type=--id 00:21:23.904 16:07:47 -- common/autotest_common.sh@807 -- # id=0 00:21:23.904 16:07:47 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:23.904 16:07:47 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:23.904 16:07:47 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:23.904 16:07:47 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:23.904 16:07:47 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:23.904 16:07:47 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:23.904 nvmf_trace.0 00:21:24.162 16:07:47 -- common/autotest_common.sh@821 -- # return 0 00:21:24.162 16:07:47 -- target/tls.sh@16 -- # killprocess 1617262 00:21:24.162 16:07:47 -- common/autotest_common.sh@936 -- # '[' -z 1617262 ']' 00:21:24.162 16:07:47 -- common/autotest_common.sh@940 -- # kill -0 1617262 00:21:24.162 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1617262) - No such process 00:21:24.162 16:07:47 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1617262 is not found' 00:21:24.162 Process with pid 1617262 is not found 00:21:24.162 16:07:47 -- target/tls.sh@17 -- # nvmftestfini 00:21:24.162 16:07:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:24.162 16:07:47 -- nvmf/common.sh@116 -- # sync 00:21:24.162 16:07:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:24.162 16:07:47 -- nvmf/common.sh@119 -- # set +e 00:21:24.162 16:07:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:24.162 16:07:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:24.162 rmmod nvme_tcp 00:21:24.162 rmmod nvme_fabrics 00:21:24.162 rmmod nvme_keyring 00:21:24.162 16:07:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:24.162 16:07:47 -- nvmf/common.sh@123 -- # set -e 00:21:24.162 16:07:47 -- nvmf/common.sh@124 -- # return 0 00:21:24.162 16:07:47 -- nvmf/common.sh@477 -- # '[' -n 1617109 ']' 00:21:24.162 16:07:47 -- nvmf/common.sh@478 -- # killprocess 1617109 00:21:24.162 16:07:47 -- common/autotest_common.sh@936 -- # '[' -z 1617109 ']' 00:21:24.162 16:07:47 -- common/autotest_common.sh@940 -- # kill -0 1617109 00:21:24.162 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1617109) - No such process 00:21:24.162 16:07:47 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1617109 is not found' 00:21:24.162 Process with pid 1617109 is not found 00:21:24.162 16:07:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:24.163 16:07:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:24.163 16:07:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:24.163 16:07:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:24.163 16:07:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:24.163 16:07:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:24.163 16:07:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:24.163 16:07:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:26.065 16:07:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:26.065 16:07:49 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:26.065 00:21:26.065 real 1m15.232s 00:21:26.065 user 2m3.774s 00:21:26.065 sys 0m22.298s 00:21:26.065 16:07:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:26.065 16:07:49 -- common/autotest_common.sh@10 -- # set +x 00:21:26.065 ************************************ 00:21:26.065 END TEST nvmf_tls 00:21:26.065 ************************************ 00:21:26.065 16:07:49 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:26.065 16:07:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:26.065 16:07:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:26.065 16:07:49 -- common/autotest_common.sh@10 -- # set +x 00:21:26.065 ************************************ 00:21:26.065 START TEST nvmf_fips 00:21:26.065 ************************************ 00:21:26.066 16:07:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:26.324 * Looking for test storage... 00:21:26.324 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:26.324 16:07:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:26.324 16:07:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:26.324 16:07:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:26.324 16:07:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:26.324 16:07:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:26.324 16:07:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:26.324 16:07:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:26.324 16:07:49 -- scripts/common.sh@335 -- # IFS=.-: 00:21:26.324 16:07:49 -- scripts/common.sh@335 -- # read -ra ver1 00:21:26.324 16:07:49 -- scripts/common.sh@336 -- # IFS=.-: 00:21:26.324 16:07:49 -- scripts/common.sh@336 -- # read -ra ver2 00:21:26.324 16:07:49 -- scripts/common.sh@337 -- # local 'op=<' 00:21:26.324 16:07:49 -- scripts/common.sh@339 -- # ver1_l=2 00:21:26.324 16:07:49 -- scripts/common.sh@340 -- # ver2_l=1 00:21:26.324 16:07:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:26.324 16:07:49 -- scripts/common.sh@343 -- # case "$op" in 00:21:26.324 16:07:49 -- scripts/common.sh@344 -- # : 1 00:21:26.324 16:07:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:26.324 16:07:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:26.324 16:07:49 -- scripts/common.sh@364 -- # decimal 1 00:21:26.324 16:07:49 -- scripts/common.sh@352 -- # local d=1 00:21:26.324 16:07:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:26.324 16:07:49 -- scripts/common.sh@354 -- # echo 1 00:21:26.324 16:07:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:26.324 16:07:49 -- scripts/common.sh@365 -- # decimal 2 00:21:26.324 16:07:49 -- scripts/common.sh@352 -- # local d=2 00:21:26.324 16:07:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:26.324 16:07:49 -- scripts/common.sh@354 -- # echo 2 00:21:26.324 16:07:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:26.324 16:07:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:26.325 16:07:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:26.325 16:07:49 -- scripts/common.sh@367 -- # return 0 00:21:26.325 16:07:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:26.325 16:07:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:26.325 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:26.325 --rc genhtml_branch_coverage=1 00:21:26.325 --rc genhtml_function_coverage=1 00:21:26.325 --rc genhtml_legend=1 00:21:26.325 --rc geninfo_all_blocks=1 00:21:26.325 --rc geninfo_unexecuted_blocks=1 00:21:26.325 00:21:26.325 ' 00:21:26.325 16:07:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:26.325 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:26.325 --rc genhtml_branch_coverage=1 00:21:26.325 --rc genhtml_function_coverage=1 00:21:26.325 --rc genhtml_legend=1 00:21:26.325 --rc geninfo_all_blocks=1 00:21:26.325 --rc geninfo_unexecuted_blocks=1 00:21:26.325 00:21:26.325 ' 00:21:26.325 16:07:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:26.325 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:26.325 --rc genhtml_branch_coverage=1 00:21:26.325 --rc genhtml_function_coverage=1 00:21:26.325 --rc genhtml_legend=1 00:21:26.325 --rc geninfo_all_blocks=1 00:21:26.325 --rc geninfo_unexecuted_blocks=1 00:21:26.325 00:21:26.325 ' 00:21:26.325 16:07:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:26.325 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:26.325 --rc genhtml_branch_coverage=1 00:21:26.325 --rc genhtml_function_coverage=1 00:21:26.325 --rc genhtml_legend=1 00:21:26.325 --rc geninfo_all_blocks=1 00:21:26.325 --rc geninfo_unexecuted_blocks=1 00:21:26.325 00:21:26.325 ' 00:21:26.325 16:07:49 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:26.325 16:07:49 -- nvmf/common.sh@7 -- # uname -s 00:21:26.325 16:07:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:26.325 16:07:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:26.325 16:07:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:26.325 16:07:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:26.325 16:07:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:26.325 16:07:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:26.325 16:07:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:26.325 16:07:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:26.325 16:07:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:26.325 16:07:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:26.325 16:07:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:26.325 16:07:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:26.325 16:07:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:26.325 16:07:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:26.325 16:07:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:26.325 16:07:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:26.325 16:07:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:26.325 16:07:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:26.325 16:07:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:26.325 16:07:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:26.325 16:07:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:26.325 16:07:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:26.325 16:07:49 -- paths/export.sh@5 -- # export PATH 00:21:26.325 16:07:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:26.325 16:07:49 -- nvmf/common.sh@46 -- # : 0 00:21:26.325 16:07:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:26.325 16:07:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:26.325 16:07:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:26.325 16:07:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:26.325 16:07:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:26.325 16:07:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:26.325 16:07:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:26.325 16:07:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:26.325 16:07:49 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:26.325 16:07:49 -- fips/fips.sh@89 -- # check_openssl_version 00:21:26.325 16:07:49 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:26.325 16:07:49 -- fips/fips.sh@85 -- # openssl version 00:21:26.325 16:07:49 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:26.325 16:07:49 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:26.325 16:07:49 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:26.325 16:07:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:26.325 16:07:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:26.325 16:07:49 -- scripts/common.sh@335 -- # IFS=.-: 00:21:26.325 16:07:49 -- scripts/common.sh@335 -- # read -ra ver1 00:21:26.325 16:07:49 -- scripts/common.sh@336 -- # IFS=.-: 00:21:26.325 16:07:49 -- scripts/common.sh@336 -- # read -ra ver2 00:21:26.325 16:07:49 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:26.325 16:07:49 -- scripts/common.sh@339 -- # ver1_l=3 00:21:26.325 16:07:49 -- scripts/common.sh@340 -- # ver2_l=3 00:21:26.325 16:07:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:26.325 16:07:49 -- scripts/common.sh@343 -- # case "$op" in 00:21:26.325 16:07:49 -- scripts/common.sh@347 -- # : 1 00:21:26.325 16:07:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:26.325 16:07:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:26.325 16:07:49 -- scripts/common.sh@364 -- # decimal 3 00:21:26.325 16:07:49 -- scripts/common.sh@352 -- # local d=3 00:21:26.325 16:07:49 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:26.325 16:07:49 -- scripts/common.sh@354 -- # echo 3 00:21:26.325 16:07:49 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:26.325 16:07:49 -- scripts/common.sh@365 -- # decimal 3 00:21:26.325 16:07:49 -- scripts/common.sh@352 -- # local d=3 00:21:26.325 16:07:49 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:26.325 16:07:49 -- scripts/common.sh@354 -- # echo 3 00:21:26.325 16:07:49 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:26.325 16:07:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:26.325 16:07:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:26.325 16:07:49 -- scripts/common.sh@363 -- # (( v++ )) 00:21:26.325 16:07:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:26.325 16:07:49 -- scripts/common.sh@364 -- # decimal 1 00:21:26.325 16:07:49 -- scripts/common.sh@352 -- # local d=1 00:21:26.325 16:07:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:26.325 16:07:49 -- scripts/common.sh@354 -- # echo 1 00:21:26.325 16:07:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:26.325 16:07:49 -- scripts/common.sh@365 -- # decimal 0 00:21:26.325 16:07:49 -- scripts/common.sh@352 -- # local d=0 00:21:26.325 16:07:49 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:26.325 16:07:49 -- scripts/common.sh@354 -- # echo 0 00:21:26.325 16:07:49 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:26.325 16:07:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:26.325 16:07:49 -- scripts/common.sh@366 -- # return 0 00:21:26.325 16:07:49 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:26.325 16:07:49 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:26.325 16:07:49 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:26.325 16:07:49 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:26.325 16:07:49 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:26.325 16:07:49 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:26.325 16:07:49 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:26.325 16:07:49 -- fips/fips.sh@113 -- # build_openssl_config 00:21:26.325 16:07:49 -- fips/fips.sh@37 -- # cat 00:21:26.325 16:07:49 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:26.325 16:07:49 -- fips/fips.sh@58 -- # cat - 00:21:26.325 16:07:49 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:26.325 16:07:49 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:26.325 16:07:49 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:26.325 16:07:49 -- fips/fips.sh@116 -- # openssl list -providers 00:21:26.325 16:07:49 -- fips/fips.sh@116 -- # grep name 00:21:26.325 16:07:49 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:26.325 16:07:49 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:26.325 16:07:49 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:26.325 16:07:49 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:26.325 16:07:49 -- fips/fips.sh@127 -- # : 00:21:26.325 16:07:49 -- common/autotest_common.sh@650 -- # local es=0 00:21:26.325 16:07:49 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:26.326 16:07:49 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:26.326 16:07:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:26.326 16:07:49 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:26.326 16:07:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:26.326 16:07:49 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:26.326 16:07:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:26.326 16:07:49 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:26.326 16:07:49 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:26.326 16:07:49 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:26.584 Error setting digest 00:21:26.584 4062CFB3297F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:26.584 4062CFB3297F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:26.584 16:07:49 -- common/autotest_common.sh@653 -- # es=1 00:21:26.584 16:07:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:26.584 16:07:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:26.584 16:07:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:26.584 16:07:49 -- fips/fips.sh@130 -- # nvmftestinit 00:21:26.584 16:07:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:26.584 16:07:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:26.584 16:07:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:26.584 16:07:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:26.584 16:07:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:26.584 16:07:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:26.584 16:07:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:26.584 16:07:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:26.584 16:07:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:26.584 16:07:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:26.584 16:07:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:26.584 16:07:49 -- common/autotest_common.sh@10 -- # set +x 00:21:28.498 16:07:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:28.498 16:07:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:28.498 16:07:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:28.498 16:07:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:28.498 16:07:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:28.498 16:07:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:28.498 16:07:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:28.498 16:07:51 -- nvmf/common.sh@294 -- # net_devs=() 00:21:28.498 16:07:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:28.498 16:07:51 -- nvmf/common.sh@295 -- # e810=() 00:21:28.498 16:07:51 -- nvmf/common.sh@295 -- # local -ga e810 00:21:28.498 16:07:51 -- nvmf/common.sh@296 -- # x722=() 00:21:28.498 16:07:51 -- nvmf/common.sh@296 -- # local -ga x722 00:21:28.498 16:07:51 -- nvmf/common.sh@297 -- # mlx=() 00:21:28.498 16:07:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:28.498 16:07:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:28.498 16:07:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:28.498 16:07:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:28.498 16:07:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:28.498 16:07:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:28.498 16:07:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:28.498 16:07:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:28.498 16:07:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:28.498 16:07:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:28.498 16:07:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:28.498 16:07:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:28.498 16:07:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:28.498 16:07:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:28.498 16:07:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:28.498 16:07:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:28.498 16:07:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:28.498 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:28.498 16:07:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:28.498 16:07:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:28.498 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:28.498 16:07:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:28.498 16:07:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:28.498 16:07:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:28.498 16:07:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:28.498 16:07:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:28.498 16:07:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:28.498 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:28.498 16:07:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:28.498 16:07:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:28.498 16:07:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:28.498 16:07:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:28.498 16:07:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:28.498 16:07:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:28.498 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:28.498 16:07:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:28.498 16:07:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:28.498 16:07:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:28.498 16:07:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:28.498 16:07:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:28.498 16:07:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:28.498 16:07:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:28.498 16:07:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:28.498 16:07:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:28.498 16:07:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:28.498 16:07:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:28.498 16:07:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:28.498 16:07:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:28.498 16:07:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:28.498 16:07:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:28.498 16:07:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:28.498 16:07:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:28.498 16:07:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:28.499 16:07:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:28.499 16:07:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:28.499 16:07:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:28.499 16:07:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:28.499 16:07:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:28.499 16:07:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:28.757 16:07:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:28.757 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:28.757 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:21:28.757 00:21:28.757 --- 10.0.0.2 ping statistics --- 00:21:28.757 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:28.757 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:21:28.757 16:07:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:28.757 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:28.757 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.149 ms 00:21:28.757 00:21:28.757 --- 10.0.0.1 ping statistics --- 00:21:28.757 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:28.757 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:21:28.757 16:07:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:28.757 16:07:52 -- nvmf/common.sh@410 -- # return 0 00:21:28.757 16:07:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:28.757 16:07:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:28.757 16:07:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:28.757 16:07:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:28.757 16:07:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:28.757 16:07:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:28.757 16:07:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:28.757 16:07:52 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:28.757 16:07:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:28.757 16:07:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:28.757 16:07:52 -- common/autotest_common.sh@10 -- # set +x 00:21:28.757 16:07:52 -- nvmf/common.sh@469 -- # nvmfpid=1620720 00:21:28.757 16:07:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:28.757 16:07:52 -- nvmf/common.sh@470 -- # waitforlisten 1620720 00:21:28.757 16:07:52 -- common/autotest_common.sh@829 -- # '[' -z 1620720 ']' 00:21:28.757 16:07:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:28.757 16:07:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:28.757 16:07:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:28.757 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:28.757 16:07:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:28.757 16:07:52 -- common/autotest_common.sh@10 -- # set +x 00:21:28.757 [2024-11-18 16:07:52.203034] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:28.757 [2024-11-18 16:07:52.203126] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:28.757 EAL: No free 2048 kB hugepages reported on node 1 00:21:28.757 [2024-11-18 16:07:52.276762] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:29.016 [2024-11-18 16:07:52.368987] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:29.016 [2024-11-18 16:07:52.369168] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:29.016 [2024-11-18 16:07:52.369199] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:29.016 [2024-11-18 16:07:52.369221] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:29.016 [2024-11-18 16:07:52.369260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:29.949 16:07:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:29.949 16:07:53 -- common/autotest_common.sh@862 -- # return 0 00:21:29.949 16:07:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:29.949 16:07:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:29.949 16:07:53 -- common/autotest_common.sh@10 -- # set +x 00:21:29.949 16:07:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:29.949 16:07:53 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:29.949 16:07:53 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:29.949 16:07:53 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:29.949 16:07:53 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:29.950 16:07:53 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:29.950 16:07:53 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:29.950 16:07:53 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:29.950 16:07:53 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:29.950 [2024-11-18 16:07:53.535318] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:30.208 [2024-11-18 16:07:53.551320] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:30.208 [2024-11-18 16:07:53.551625] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:30.208 malloc0 00:21:30.208 16:07:53 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:30.208 16:07:53 -- fips/fips.sh@147 -- # bdevperf_pid=1620885 00:21:30.208 16:07:53 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:30.208 16:07:53 -- fips/fips.sh@148 -- # waitforlisten 1620885 /var/tmp/bdevperf.sock 00:21:30.208 16:07:53 -- common/autotest_common.sh@829 -- # '[' -z 1620885 ']' 00:21:30.208 16:07:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:30.208 16:07:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:30.208 16:07:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:30.208 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:30.208 16:07:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:30.208 16:07:53 -- common/autotest_common.sh@10 -- # set +x 00:21:30.208 [2024-11-18 16:07:53.669204] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:30.208 [2024-11-18 16:07:53.669281] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1620885 ] 00:21:30.208 EAL: No free 2048 kB hugepages reported on node 1 00:21:30.208 [2024-11-18 16:07:53.727165] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:30.466 [2024-11-18 16:07:53.813023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:31.399 16:07:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:31.399 16:07:54 -- common/autotest_common.sh@862 -- # return 0 00:21:31.399 16:07:54 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:31.399 [2024-11-18 16:07:54.969229] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:31.657 TLSTESTn1 00:21:31.657 16:07:55 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:31.657 Running I/O for 10 seconds... 00:21:43.854 00:21:43.854 Latency(us) 00:21:43.854 [2024-11-18T15:08:07.445Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:43.854 [2024-11-18T15:08:07.445Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:43.854 Verification LBA range: start 0x0 length 0x2000 00:21:43.854 TLSTESTn1 : 10.01 4588.08 17.92 0.00 0.00 27863.70 5631.24 78837.38 00:21:43.854 [2024-11-18T15:08:07.445Z] =================================================================================================================== 00:21:43.854 [2024-11-18T15:08:07.445Z] Total : 4588.08 17.92 0.00 0.00 27863.70 5631.24 78837.38 00:21:43.854 0 00:21:43.854 16:08:05 -- fips/fips.sh@1 -- # cleanup 00:21:43.854 16:08:05 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:43.854 16:08:05 -- common/autotest_common.sh@806 -- # type=--id 00:21:43.854 16:08:05 -- common/autotest_common.sh@807 -- # id=0 00:21:43.855 16:08:05 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:43.855 16:08:05 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:43.855 16:08:05 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:43.855 16:08:05 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:43.855 16:08:05 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:43.855 16:08:05 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:43.855 nvmf_trace.0 00:21:43.855 16:08:05 -- common/autotest_common.sh@821 -- # return 0 00:21:43.855 16:08:05 -- fips/fips.sh@16 -- # killprocess 1620885 00:21:43.855 16:08:05 -- common/autotest_common.sh@936 -- # '[' -z 1620885 ']' 00:21:43.855 16:08:05 -- common/autotest_common.sh@940 -- # kill -0 1620885 00:21:43.855 16:08:05 -- common/autotest_common.sh@941 -- # uname 00:21:43.855 16:08:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:43.855 16:08:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1620885 00:21:43.855 16:08:05 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:43.855 16:08:05 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:43.855 16:08:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1620885' 00:21:43.855 killing process with pid 1620885 00:21:43.855 16:08:05 -- common/autotest_common.sh@955 -- # kill 1620885 00:21:43.855 Received shutdown signal, test time was about 10.000000 seconds 00:21:43.855 00:21:43.855 Latency(us) 00:21:43.855 [2024-11-18T15:08:07.446Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:43.855 [2024-11-18T15:08:07.446Z] =================================================================================================================== 00:21:43.855 [2024-11-18T15:08:07.446Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:43.855 16:08:05 -- common/autotest_common.sh@960 -- # wait 1620885 00:21:43.855 16:08:05 -- fips/fips.sh@17 -- # nvmftestfini 00:21:43.855 16:08:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:43.855 16:08:05 -- nvmf/common.sh@116 -- # sync 00:21:43.855 16:08:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:43.855 16:08:05 -- nvmf/common.sh@119 -- # set +e 00:21:43.855 16:08:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:43.855 16:08:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:43.855 rmmod nvme_tcp 00:21:43.855 rmmod nvme_fabrics 00:21:43.855 rmmod nvme_keyring 00:21:43.855 16:08:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:43.855 16:08:05 -- nvmf/common.sh@123 -- # set -e 00:21:43.855 16:08:05 -- nvmf/common.sh@124 -- # return 0 00:21:43.855 16:08:05 -- nvmf/common.sh@477 -- # '[' -n 1620720 ']' 00:21:43.855 16:08:05 -- nvmf/common.sh@478 -- # killprocess 1620720 00:21:43.855 16:08:05 -- common/autotest_common.sh@936 -- # '[' -z 1620720 ']' 00:21:43.855 16:08:05 -- common/autotest_common.sh@940 -- # kill -0 1620720 00:21:43.855 16:08:05 -- common/autotest_common.sh@941 -- # uname 00:21:43.855 16:08:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:43.855 16:08:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1620720 00:21:43.855 16:08:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:43.855 16:08:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:43.855 16:08:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1620720' 00:21:43.855 killing process with pid 1620720 00:21:43.855 16:08:05 -- common/autotest_common.sh@955 -- # kill 1620720 00:21:43.855 16:08:05 -- common/autotest_common.sh@960 -- # wait 1620720 00:21:43.855 16:08:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:43.855 16:08:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:43.855 16:08:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:43.855 16:08:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:43.855 16:08:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:43.855 16:08:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:43.855 16:08:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:43.855 16:08:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:44.423 16:08:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:44.423 16:08:07 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:44.423 00:21:44.423 real 0m18.283s 00:21:44.423 user 0m24.358s 00:21:44.423 sys 0m5.733s 00:21:44.423 16:08:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:44.423 16:08:07 -- common/autotest_common.sh@10 -- # set +x 00:21:44.423 ************************************ 00:21:44.423 END TEST nvmf_fips 00:21:44.423 ************************************ 00:21:44.423 16:08:07 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:44.423 16:08:07 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:44.423 16:08:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:44.423 16:08:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:44.423 16:08:07 -- common/autotest_common.sh@10 -- # set +x 00:21:44.423 ************************************ 00:21:44.423 START TEST nvmf_fuzz 00:21:44.423 ************************************ 00:21:44.423 16:08:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:44.423 * Looking for test storage... 00:21:44.423 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:44.423 16:08:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:44.423 16:08:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:44.423 16:08:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:44.682 16:08:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:44.682 16:08:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:44.682 16:08:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:44.682 16:08:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:44.682 16:08:08 -- scripts/common.sh@335 -- # IFS=.-: 00:21:44.682 16:08:08 -- scripts/common.sh@335 -- # read -ra ver1 00:21:44.682 16:08:08 -- scripts/common.sh@336 -- # IFS=.-: 00:21:44.682 16:08:08 -- scripts/common.sh@336 -- # read -ra ver2 00:21:44.682 16:08:08 -- scripts/common.sh@337 -- # local 'op=<' 00:21:44.682 16:08:08 -- scripts/common.sh@339 -- # ver1_l=2 00:21:44.682 16:08:08 -- scripts/common.sh@340 -- # ver2_l=1 00:21:44.682 16:08:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:44.682 16:08:08 -- scripts/common.sh@343 -- # case "$op" in 00:21:44.682 16:08:08 -- scripts/common.sh@344 -- # : 1 00:21:44.682 16:08:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:44.682 16:08:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:44.682 16:08:08 -- scripts/common.sh@364 -- # decimal 1 00:21:44.682 16:08:08 -- scripts/common.sh@352 -- # local d=1 00:21:44.682 16:08:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:44.682 16:08:08 -- scripts/common.sh@354 -- # echo 1 00:21:44.682 16:08:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:44.682 16:08:08 -- scripts/common.sh@365 -- # decimal 2 00:21:44.682 16:08:08 -- scripts/common.sh@352 -- # local d=2 00:21:44.682 16:08:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:44.682 16:08:08 -- scripts/common.sh@354 -- # echo 2 00:21:44.682 16:08:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:44.682 16:08:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:44.682 16:08:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:44.682 16:08:08 -- scripts/common.sh@367 -- # return 0 00:21:44.682 16:08:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:44.682 16:08:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:44.682 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.682 --rc genhtml_branch_coverage=1 00:21:44.682 --rc genhtml_function_coverage=1 00:21:44.682 --rc genhtml_legend=1 00:21:44.682 --rc geninfo_all_blocks=1 00:21:44.682 --rc geninfo_unexecuted_blocks=1 00:21:44.682 00:21:44.682 ' 00:21:44.682 16:08:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:44.682 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.682 --rc genhtml_branch_coverage=1 00:21:44.682 --rc genhtml_function_coverage=1 00:21:44.682 --rc genhtml_legend=1 00:21:44.682 --rc geninfo_all_blocks=1 00:21:44.682 --rc geninfo_unexecuted_blocks=1 00:21:44.682 00:21:44.682 ' 00:21:44.682 16:08:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:44.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.683 --rc genhtml_branch_coverage=1 00:21:44.683 --rc genhtml_function_coverage=1 00:21:44.683 --rc genhtml_legend=1 00:21:44.683 --rc geninfo_all_blocks=1 00:21:44.683 --rc geninfo_unexecuted_blocks=1 00:21:44.683 00:21:44.683 ' 00:21:44.683 16:08:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:44.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:44.683 --rc genhtml_branch_coverage=1 00:21:44.683 --rc genhtml_function_coverage=1 00:21:44.683 --rc genhtml_legend=1 00:21:44.683 --rc geninfo_all_blocks=1 00:21:44.683 --rc geninfo_unexecuted_blocks=1 00:21:44.683 00:21:44.683 ' 00:21:44.683 16:08:08 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:44.683 16:08:08 -- nvmf/common.sh@7 -- # uname -s 00:21:44.683 16:08:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:44.683 16:08:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:44.683 16:08:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:44.683 16:08:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:44.683 16:08:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:44.683 16:08:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:44.683 16:08:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:44.683 16:08:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:44.683 16:08:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:44.683 16:08:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:44.683 16:08:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:44.683 16:08:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:44.683 16:08:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:44.683 16:08:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:44.683 16:08:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:44.683 16:08:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:44.683 16:08:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:44.683 16:08:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:44.683 16:08:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:44.683 16:08:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.683 16:08:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.683 16:08:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.683 16:08:08 -- paths/export.sh@5 -- # export PATH 00:21:44.683 16:08:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:44.683 16:08:08 -- nvmf/common.sh@46 -- # : 0 00:21:44.683 16:08:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:44.683 16:08:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:44.683 16:08:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:44.683 16:08:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:44.683 16:08:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:44.683 16:08:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:44.683 16:08:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:44.683 16:08:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:44.683 16:08:08 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:44.683 16:08:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:44.683 16:08:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:44.683 16:08:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:44.683 16:08:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:44.683 16:08:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:44.683 16:08:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:44.683 16:08:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:44.683 16:08:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:44.683 16:08:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:44.683 16:08:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:44.683 16:08:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:44.683 16:08:08 -- common/autotest_common.sh@10 -- # set +x 00:21:46.661 16:08:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:46.661 16:08:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:46.661 16:08:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:46.661 16:08:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:46.661 16:08:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:46.661 16:08:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:46.661 16:08:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:46.661 16:08:10 -- nvmf/common.sh@294 -- # net_devs=() 00:21:46.661 16:08:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:46.661 16:08:10 -- nvmf/common.sh@295 -- # e810=() 00:21:46.661 16:08:10 -- nvmf/common.sh@295 -- # local -ga e810 00:21:46.661 16:08:10 -- nvmf/common.sh@296 -- # x722=() 00:21:46.661 16:08:10 -- nvmf/common.sh@296 -- # local -ga x722 00:21:46.661 16:08:10 -- nvmf/common.sh@297 -- # mlx=() 00:21:46.661 16:08:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:46.661 16:08:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:46.661 16:08:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:46.661 16:08:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:46.661 16:08:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:46.661 16:08:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:46.661 16:08:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:46.661 16:08:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:46.661 16:08:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:46.661 16:08:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:46.661 16:08:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:46.661 16:08:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:46.661 16:08:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:46.661 16:08:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:46.661 16:08:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:46.661 16:08:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:46.661 16:08:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:46.661 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:46.661 16:08:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:46.661 16:08:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:46.661 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:46.661 16:08:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:46.661 16:08:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:46.661 16:08:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:46.661 16:08:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:46.661 16:08:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:46.661 16:08:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:46.661 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:46.661 16:08:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:46.661 16:08:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:46.661 16:08:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:46.661 16:08:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:46.661 16:08:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:46.661 16:08:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:46.661 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:46.661 16:08:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:46.661 16:08:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:46.661 16:08:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:46.661 16:08:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:46.661 16:08:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:46.661 16:08:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:46.661 16:08:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:46.661 16:08:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:46.661 16:08:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:46.661 16:08:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:46.661 16:08:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:46.661 16:08:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:46.661 16:08:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:46.661 16:08:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:46.661 16:08:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:46.661 16:08:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:46.661 16:08:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:46.661 16:08:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:46.920 16:08:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:46.920 16:08:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:46.920 16:08:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:46.920 16:08:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:46.920 16:08:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:46.920 16:08:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:46.920 16:08:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:46.920 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:46.920 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:21:46.920 00:21:46.920 --- 10.0.0.2 ping statistics --- 00:21:46.920 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:46.920 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:21:46.920 16:08:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:46.920 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:46.920 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:21:46.920 00:21:46.920 --- 10.0.0.1 ping statistics --- 00:21:46.920 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:46.920 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:21:46.920 16:08:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:46.920 16:08:10 -- nvmf/common.sh@410 -- # return 0 00:21:46.920 16:08:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:46.920 16:08:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:46.920 16:08:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:46.920 16:08:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:46.920 16:08:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:46.920 16:08:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:46.920 16:08:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:46.921 16:08:10 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1624327 00:21:46.921 16:08:10 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:46.921 16:08:10 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:46.921 16:08:10 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1624327 00:21:46.921 16:08:10 -- common/autotest_common.sh@829 -- # '[' -z 1624327 ']' 00:21:46.921 16:08:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:46.921 16:08:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:46.921 16:08:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:46.921 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:46.921 16:08:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:46.921 16:08:10 -- common/autotest_common.sh@10 -- # set +x 00:21:47.856 16:08:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:47.856 16:08:11 -- common/autotest_common.sh@862 -- # return 0 00:21:47.856 16:08:11 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:47.856 16:08:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:47.856 16:08:11 -- common/autotest_common.sh@10 -- # set +x 00:21:48.114 16:08:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.114 16:08:11 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:48.114 16:08:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.114 16:08:11 -- common/autotest_common.sh@10 -- # set +x 00:21:48.114 Malloc0 00:21:48.114 16:08:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.114 16:08:11 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:48.114 16:08:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.114 16:08:11 -- common/autotest_common.sh@10 -- # set +x 00:21:48.114 16:08:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.114 16:08:11 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:48.114 16:08:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.114 16:08:11 -- common/autotest_common.sh@10 -- # set +x 00:21:48.114 16:08:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.114 16:08:11 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:48.114 16:08:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.114 16:08:11 -- common/autotest_common.sh@10 -- # set +x 00:21:48.114 16:08:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.114 16:08:11 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:48.114 16:08:11 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:20.175 Fuzzing completed. Shutting down the fuzz application 00:22:20.175 00:22:20.175 Dumping successful admin opcodes: 00:22:20.175 8, 9, 10, 24, 00:22:20.175 Dumping successful io opcodes: 00:22:20.175 0, 9, 00:22:20.175 NS: 0x200003aeff00 I/O qp, Total commands completed: 473571, total successful commands: 2737, random_seed: 4014206208 00:22:20.175 NS: 0x200003aeff00 admin qp, Total commands completed: 56384, total successful commands: 447, random_seed: 2842133696 00:22:20.175 16:08:42 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:20.175 Fuzzing completed. Shutting down the fuzz application 00:22:20.175 00:22:20.175 Dumping successful admin opcodes: 00:22:20.175 24, 00:22:20.175 Dumping successful io opcodes: 00:22:20.175 00:22:20.175 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3098383416 00:22:20.175 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3098506136 00:22:20.175 16:08:43 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:20.175 16:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.175 16:08:43 -- common/autotest_common.sh@10 -- # set +x 00:22:20.175 16:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.175 16:08:43 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:20.175 16:08:43 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:20.175 16:08:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:20.175 16:08:43 -- nvmf/common.sh@116 -- # sync 00:22:20.175 16:08:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:20.175 16:08:43 -- nvmf/common.sh@119 -- # set +e 00:22:20.175 16:08:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:20.175 16:08:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:20.175 rmmod nvme_tcp 00:22:20.175 rmmod nvme_fabrics 00:22:20.175 rmmod nvme_keyring 00:22:20.175 16:08:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:20.175 16:08:43 -- nvmf/common.sh@123 -- # set -e 00:22:20.175 16:08:43 -- nvmf/common.sh@124 -- # return 0 00:22:20.175 16:08:43 -- nvmf/common.sh@477 -- # '[' -n 1624327 ']' 00:22:20.176 16:08:43 -- nvmf/common.sh@478 -- # killprocess 1624327 00:22:20.176 16:08:43 -- common/autotest_common.sh@936 -- # '[' -z 1624327 ']' 00:22:20.176 16:08:43 -- common/autotest_common.sh@940 -- # kill -0 1624327 00:22:20.176 16:08:43 -- common/autotest_common.sh@941 -- # uname 00:22:20.176 16:08:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:20.176 16:08:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1624327 00:22:20.176 16:08:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:20.176 16:08:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:20.176 16:08:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1624327' 00:22:20.176 killing process with pid 1624327 00:22:20.176 16:08:43 -- common/autotest_common.sh@955 -- # kill 1624327 00:22:20.176 16:08:43 -- common/autotest_common.sh@960 -- # wait 1624327 00:22:20.434 16:08:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:20.434 16:08:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:20.434 16:08:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:20.434 16:08:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:20.434 16:08:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:20.434 16:08:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:20.434 16:08:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:20.434 16:08:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:22.335 16:08:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:22.335 16:08:45 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:22.335 00:22:22.335 real 0m37.928s 00:22:22.335 user 0m52.465s 00:22:22.335 sys 0m14.643s 00:22:22.335 16:08:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:22.335 16:08:45 -- common/autotest_common.sh@10 -- # set +x 00:22:22.335 ************************************ 00:22:22.335 END TEST nvmf_fuzz 00:22:22.335 ************************************ 00:22:22.335 16:08:45 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:22.335 16:08:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:22.335 16:08:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:22.335 16:08:45 -- common/autotest_common.sh@10 -- # set +x 00:22:22.335 ************************************ 00:22:22.335 START TEST nvmf_multiconnection 00:22:22.335 ************************************ 00:22:22.335 16:08:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:22.594 * Looking for test storage... 00:22:22.594 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:22.594 16:08:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:22.594 16:08:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:22.594 16:08:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:22.594 16:08:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:22.594 16:08:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:22.594 16:08:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:22.594 16:08:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:22.594 16:08:46 -- scripts/common.sh@335 -- # IFS=.-: 00:22:22.594 16:08:46 -- scripts/common.sh@335 -- # read -ra ver1 00:22:22.594 16:08:46 -- scripts/common.sh@336 -- # IFS=.-: 00:22:22.594 16:08:46 -- scripts/common.sh@336 -- # read -ra ver2 00:22:22.594 16:08:46 -- scripts/common.sh@337 -- # local 'op=<' 00:22:22.594 16:08:46 -- scripts/common.sh@339 -- # ver1_l=2 00:22:22.594 16:08:46 -- scripts/common.sh@340 -- # ver2_l=1 00:22:22.594 16:08:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:22.594 16:08:46 -- scripts/common.sh@343 -- # case "$op" in 00:22:22.594 16:08:46 -- scripts/common.sh@344 -- # : 1 00:22:22.594 16:08:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:22.594 16:08:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:22.594 16:08:46 -- scripts/common.sh@364 -- # decimal 1 00:22:22.594 16:08:46 -- scripts/common.sh@352 -- # local d=1 00:22:22.594 16:08:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:22.594 16:08:46 -- scripts/common.sh@354 -- # echo 1 00:22:22.594 16:08:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:22.594 16:08:46 -- scripts/common.sh@365 -- # decimal 2 00:22:22.594 16:08:46 -- scripts/common.sh@352 -- # local d=2 00:22:22.594 16:08:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:22.594 16:08:46 -- scripts/common.sh@354 -- # echo 2 00:22:22.594 16:08:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:22.594 16:08:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:22.594 16:08:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:22.594 16:08:46 -- scripts/common.sh@367 -- # return 0 00:22:22.594 16:08:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:22.594 16:08:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:22.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:22.594 --rc genhtml_branch_coverage=1 00:22:22.594 --rc genhtml_function_coverage=1 00:22:22.594 --rc genhtml_legend=1 00:22:22.594 --rc geninfo_all_blocks=1 00:22:22.594 --rc geninfo_unexecuted_blocks=1 00:22:22.594 00:22:22.594 ' 00:22:22.594 16:08:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:22.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:22.594 --rc genhtml_branch_coverage=1 00:22:22.594 --rc genhtml_function_coverage=1 00:22:22.594 --rc genhtml_legend=1 00:22:22.594 --rc geninfo_all_blocks=1 00:22:22.594 --rc geninfo_unexecuted_blocks=1 00:22:22.594 00:22:22.594 ' 00:22:22.594 16:08:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:22.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:22.594 --rc genhtml_branch_coverage=1 00:22:22.594 --rc genhtml_function_coverage=1 00:22:22.594 --rc genhtml_legend=1 00:22:22.594 --rc geninfo_all_blocks=1 00:22:22.594 --rc geninfo_unexecuted_blocks=1 00:22:22.594 00:22:22.594 ' 00:22:22.594 16:08:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:22.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:22.594 --rc genhtml_branch_coverage=1 00:22:22.594 --rc genhtml_function_coverage=1 00:22:22.594 --rc genhtml_legend=1 00:22:22.594 --rc geninfo_all_blocks=1 00:22:22.594 --rc geninfo_unexecuted_blocks=1 00:22:22.594 00:22:22.594 ' 00:22:22.594 16:08:46 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:22.594 16:08:46 -- nvmf/common.sh@7 -- # uname -s 00:22:22.594 16:08:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:22.594 16:08:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:22.594 16:08:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:22.594 16:08:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:22.594 16:08:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:22.594 16:08:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:22.594 16:08:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:22.594 16:08:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:22.594 16:08:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:22.594 16:08:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:22.594 16:08:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:22.594 16:08:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:22.594 16:08:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:22.594 16:08:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:22.594 16:08:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:22.594 16:08:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:22.594 16:08:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:22.594 16:08:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:22.594 16:08:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:22.594 16:08:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.594 16:08:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.594 16:08:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.594 16:08:46 -- paths/export.sh@5 -- # export PATH 00:22:22.594 16:08:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.594 16:08:46 -- nvmf/common.sh@46 -- # : 0 00:22:22.595 16:08:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:22.595 16:08:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:22.595 16:08:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:22.595 16:08:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:22.595 16:08:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:22.595 16:08:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:22.595 16:08:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:22.595 16:08:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:22.595 16:08:46 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:22.595 16:08:46 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:22.595 16:08:46 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:22.595 16:08:46 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:22.595 16:08:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:22.595 16:08:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:22.595 16:08:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:22.595 16:08:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:22.595 16:08:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:22.595 16:08:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:22.595 16:08:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:22.595 16:08:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:22.595 16:08:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:22.595 16:08:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:22.595 16:08:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:22.595 16:08:46 -- common/autotest_common.sh@10 -- # set +x 00:22:24.495 16:08:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:24.495 16:08:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:24.495 16:08:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:24.495 16:08:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:24.495 16:08:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:24.495 16:08:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:24.495 16:08:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:24.495 16:08:48 -- nvmf/common.sh@294 -- # net_devs=() 00:22:24.495 16:08:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:24.495 16:08:48 -- nvmf/common.sh@295 -- # e810=() 00:22:24.495 16:08:48 -- nvmf/common.sh@295 -- # local -ga e810 00:22:24.495 16:08:48 -- nvmf/common.sh@296 -- # x722=() 00:22:24.495 16:08:48 -- nvmf/common.sh@296 -- # local -ga x722 00:22:24.495 16:08:48 -- nvmf/common.sh@297 -- # mlx=() 00:22:24.495 16:08:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:24.495 16:08:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:24.495 16:08:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:24.495 16:08:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:24.495 16:08:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:24.495 16:08:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:24.495 16:08:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:24.495 16:08:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:24.495 16:08:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:24.496 16:08:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:24.496 16:08:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:24.496 16:08:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:24.496 16:08:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:24.496 16:08:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:24.496 16:08:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:24.496 16:08:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:24.496 16:08:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:24.496 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:24.496 16:08:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:24.496 16:08:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:24.496 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:24.496 16:08:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:24.496 16:08:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:24.496 16:08:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:24.496 16:08:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:24.496 16:08:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:24.496 16:08:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:24.496 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:24.496 16:08:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:24.496 16:08:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:24.496 16:08:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:24.496 16:08:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:24.496 16:08:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:24.496 16:08:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:24.496 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:24.496 16:08:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:24.496 16:08:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:24.496 16:08:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:24.496 16:08:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:24.496 16:08:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:24.496 16:08:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:24.496 16:08:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:24.496 16:08:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:24.496 16:08:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:24.496 16:08:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:24.496 16:08:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:24.496 16:08:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:24.496 16:08:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:24.496 16:08:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:24.496 16:08:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:24.496 16:08:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:24.496 16:08:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:24.754 16:08:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:24.754 16:08:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:24.754 16:08:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:24.754 16:08:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:24.754 16:08:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:24.754 16:08:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:24.754 16:08:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:24.754 16:08:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:24.754 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:24.754 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:22:24.754 00:22:24.754 --- 10.0.0.2 ping statistics --- 00:22:24.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:24.754 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:22:24.754 16:08:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:24.754 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:24.754 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:22:24.754 00:22:24.754 --- 10.0.0.1 ping statistics --- 00:22:24.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:24.754 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:22:24.754 16:08:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:24.754 16:08:48 -- nvmf/common.sh@410 -- # return 0 00:22:24.754 16:08:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:24.754 16:08:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:24.754 16:08:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:24.754 16:08:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:24.754 16:08:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:24.754 16:08:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:24.754 16:08:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:24.754 16:08:48 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:24.754 16:08:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:24.754 16:08:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:24.754 16:08:48 -- common/autotest_common.sh@10 -- # set +x 00:22:24.754 16:08:48 -- nvmf/common.sh@469 -- # nvmfpid=1630207 00:22:24.754 16:08:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:24.754 16:08:48 -- nvmf/common.sh@470 -- # waitforlisten 1630207 00:22:24.754 16:08:48 -- common/autotest_common.sh@829 -- # '[' -z 1630207 ']' 00:22:24.754 16:08:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:24.754 16:08:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:24.754 16:08:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:24.754 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:24.754 16:08:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:24.754 16:08:48 -- common/autotest_common.sh@10 -- # set +x 00:22:24.754 [2024-11-18 16:08:48.324107] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:24.754 [2024-11-18 16:08:48.324178] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:25.013 EAL: No free 2048 kB hugepages reported on node 1 00:22:25.013 [2024-11-18 16:08:48.396224] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:25.013 [2024-11-18 16:08:48.493619] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:25.013 [2024-11-18 16:08:48.493777] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:25.013 [2024-11-18 16:08:48.493797] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:25.013 [2024-11-18 16:08:48.493811] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:25.013 [2024-11-18 16:08:48.493899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:25.013 [2024-11-18 16:08:48.493975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:25.013 [2024-11-18 16:08:48.494000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:25.013 [2024-11-18 16:08:48.494005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:25.946 16:08:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:25.946 16:08:49 -- common/autotest_common.sh@862 -- # return 0 00:22:25.946 16:08:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:25.946 16:08:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:25.946 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.946 16:08:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:25.946 16:08:49 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:25.946 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.946 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.946 [2024-11-18 16:08:49.362382] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:25.946 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.946 16:08:49 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:25.947 16:08:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.947 16:08:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 Malloc1 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 [2024-11-18 16:08:49.419642] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.947 16:08:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 Malloc2 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.947 16:08:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 Malloc3 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:25.947 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.947 16:08:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.947 16:08:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:25.947 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.947 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 Malloc4 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:26.207 16:08:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 Malloc5 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:26.207 16:08:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 Malloc6 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.207 16:08:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:26.207 16:08:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:26.207 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.207 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.207 Malloc7 00:22:26.208 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.208 16:08:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:26.208 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.208 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.208 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.208 16:08:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:26.208 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.208 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.208 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.208 16:08:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:26.208 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.208 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.208 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.208 16:08:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:26.208 16:08:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:26.208 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.208 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.208 Malloc8 00:22:26.208 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.208 16:08:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:26.208 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.208 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.208 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.208 16:08:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:26.208 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.208 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.208 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.208 16:08:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:26.208 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.208 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.208 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.208 16:08:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:26.208 16:08:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:26.208 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.208 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 Malloc9 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:26.470 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.470 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:26.470 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.470 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:26.470 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.470 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:26.470 16:08:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:26.470 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.470 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 Malloc10 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:26.470 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.470 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:26.470 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.470 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:26.470 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.470 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:26.470 16:08:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:26.470 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.470 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 Malloc11 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:26.470 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.470 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:26.470 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.470 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:26.470 16:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.470 16:08:49 -- common/autotest_common.sh@10 -- # set +x 00:22:26.470 16:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.470 16:08:49 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:26.470 16:08:49 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:26.470 16:08:49 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:27.035 16:08:50 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:27.035 16:08:50 -- common/autotest_common.sh@1187 -- # local i=0 00:22:27.035 16:08:50 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:27.035 16:08:50 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:27.035 16:08:50 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:28.936 16:08:52 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:28.936 16:08:52 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:28.936 16:08:52 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:29.193 16:08:52 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:29.193 16:08:52 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:29.193 16:08:52 -- common/autotest_common.sh@1197 -- # return 0 00:22:29.193 16:08:52 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.194 16:08:52 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:29.759 16:08:53 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:29.759 16:08:53 -- common/autotest_common.sh@1187 -- # local i=0 00:22:29.759 16:08:53 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:29.759 16:08:53 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:29.759 16:08:53 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:31.657 16:08:55 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:31.657 16:08:55 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:31.657 16:08:55 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:31.657 16:08:55 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:31.657 16:08:55 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:31.657 16:08:55 -- common/autotest_common.sh@1197 -- # return 0 00:22:31.657 16:08:55 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:31.657 16:08:55 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:32.590 16:08:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:32.590 16:08:55 -- common/autotest_common.sh@1187 -- # local i=0 00:22:32.590 16:08:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:32.590 16:08:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:32.590 16:08:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:34.488 16:08:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:34.488 16:08:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:34.488 16:08:57 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:34.488 16:08:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:34.488 16:08:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:34.488 16:08:57 -- common/autotest_common.sh@1197 -- # return 0 00:22:34.488 16:08:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.488 16:08:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:35.053 16:08:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:35.053 16:08:58 -- common/autotest_common.sh@1187 -- # local i=0 00:22:35.053 16:08:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:35.053 16:08:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:35.053 16:08:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:37.578 16:09:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:37.578 16:09:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:37.578 16:09:00 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:37.578 16:09:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:37.578 16:09:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:37.578 16:09:00 -- common/autotest_common.sh@1197 -- # return 0 00:22:37.578 16:09:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:37.578 16:09:00 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:37.836 16:09:01 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:37.836 16:09:01 -- common/autotest_common.sh@1187 -- # local i=0 00:22:37.836 16:09:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:37.836 16:09:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:37.836 16:09:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:40.358 16:09:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:40.358 16:09:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:40.358 16:09:03 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:40.358 16:09:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:40.358 16:09:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:40.358 16:09:03 -- common/autotest_common.sh@1197 -- # return 0 00:22:40.358 16:09:03 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.358 16:09:03 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:40.615 16:09:04 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:40.615 16:09:04 -- common/autotest_common.sh@1187 -- # local i=0 00:22:40.615 16:09:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:40.615 16:09:04 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:40.615 16:09:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:43.140 16:09:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:43.140 16:09:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:43.140 16:09:06 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:43.140 16:09:06 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:43.140 16:09:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:43.140 16:09:06 -- common/autotest_common.sh@1197 -- # return 0 00:22:43.140 16:09:06 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:43.140 16:09:06 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:43.706 16:09:07 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:43.706 16:09:07 -- common/autotest_common.sh@1187 -- # local i=0 00:22:43.706 16:09:07 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:43.706 16:09:07 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:43.706 16:09:07 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:45.604 16:09:09 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:45.604 16:09:09 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:45.604 16:09:09 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:45.604 16:09:09 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:45.604 16:09:09 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:45.604 16:09:09 -- common/autotest_common.sh@1197 -- # return 0 00:22:45.604 16:09:09 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.604 16:09:09 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:46.536 16:09:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:46.536 16:09:09 -- common/autotest_common.sh@1187 -- # local i=0 00:22:46.536 16:09:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:46.536 16:09:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:46.536 16:09:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:48.435 16:09:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:48.435 16:09:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:48.435 16:09:11 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:48.435 16:09:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:48.435 16:09:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:48.435 16:09:11 -- common/autotest_common.sh@1197 -- # return 0 00:22:48.435 16:09:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:48.435 16:09:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:49.399 16:09:12 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:49.399 16:09:12 -- common/autotest_common.sh@1187 -- # local i=0 00:22:49.399 16:09:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:49.399 16:09:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:49.399 16:09:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:51.320 16:09:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:51.320 16:09:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:51.320 16:09:14 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:51.320 16:09:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:51.320 16:09:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:51.320 16:09:14 -- common/autotest_common.sh@1197 -- # return 0 00:22:51.320 16:09:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.320 16:09:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:52.254 16:09:15 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:52.254 16:09:15 -- common/autotest_common.sh@1187 -- # local i=0 00:22:52.254 16:09:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:52.254 16:09:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:52.254 16:09:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:54.781 16:09:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:54.781 16:09:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:54.781 16:09:17 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:54.781 16:09:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:54.781 16:09:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:54.781 16:09:17 -- common/autotest_common.sh@1197 -- # return 0 00:22:54.781 16:09:17 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:54.781 16:09:17 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:55.346 16:09:18 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:55.346 16:09:18 -- common/autotest_common.sh@1187 -- # local i=0 00:22:55.346 16:09:18 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:55.346 16:09:18 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:55.346 16:09:18 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:57.243 16:09:20 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:57.243 16:09:20 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:57.243 16:09:20 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:57.243 16:09:20 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:57.243 16:09:20 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:57.243 16:09:20 -- common/autotest_common.sh@1197 -- # return 0 00:22:57.243 16:09:20 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:57.243 [global] 00:22:57.243 thread=1 00:22:57.243 invalidate=1 00:22:57.243 rw=read 00:22:57.243 time_based=1 00:22:57.243 runtime=10 00:22:57.243 ioengine=libaio 00:22:57.243 direct=1 00:22:57.243 bs=262144 00:22:57.243 iodepth=64 00:22:57.243 norandommap=1 00:22:57.243 numjobs=1 00:22:57.243 00:22:57.243 [job0] 00:22:57.243 filename=/dev/nvme0n1 00:22:57.243 [job1] 00:22:57.243 filename=/dev/nvme10n1 00:22:57.243 [job2] 00:22:57.243 filename=/dev/nvme1n1 00:22:57.243 [job3] 00:22:57.243 filename=/dev/nvme2n1 00:22:57.243 [job4] 00:22:57.243 filename=/dev/nvme3n1 00:22:57.243 [job5] 00:22:57.243 filename=/dev/nvme4n1 00:22:57.243 [job6] 00:22:57.243 filename=/dev/nvme5n1 00:22:57.243 [job7] 00:22:57.243 filename=/dev/nvme6n1 00:22:57.243 [job8] 00:22:57.243 filename=/dev/nvme7n1 00:22:57.243 [job9] 00:22:57.243 filename=/dev/nvme8n1 00:22:57.243 [job10] 00:22:57.243 filename=/dev/nvme9n1 00:22:57.501 Could not set queue depth (nvme0n1) 00:22:57.501 Could not set queue depth (nvme10n1) 00:22:57.501 Could not set queue depth (nvme1n1) 00:22:57.501 Could not set queue depth (nvme2n1) 00:22:57.501 Could not set queue depth (nvme3n1) 00:22:57.501 Could not set queue depth (nvme4n1) 00:22:57.501 Could not set queue depth (nvme5n1) 00:22:57.501 Could not set queue depth (nvme6n1) 00:22:57.501 Could not set queue depth (nvme7n1) 00:22:57.501 Could not set queue depth (nvme8n1) 00:22:57.501 Could not set queue depth (nvme9n1) 00:22:57.501 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.501 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.501 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.501 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.501 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.501 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.501 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.501 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.501 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.501 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.501 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.501 fio-3.35 00:22:57.501 Starting 11 threads 00:23:09.703 00:23:09.703 job0: (groupid=0, jobs=1): err= 0: pid=1635318: Mon Nov 18 16:09:31 2024 00:23:09.703 read: IOPS=833, BW=208MiB/s (218MB/s)(2089MiB/10031msec) 00:23:09.704 slat (usec): min=11, max=88593, avg=1153.42, stdev=3696.67 00:23:09.704 clat (msec): min=3, max=187, avg=75.61, stdev=37.27 00:23:09.704 lat (msec): min=3, max=214, avg=76.76, stdev=37.87 00:23:09.704 clat percentiles (msec): 00:23:09.704 | 1.00th=[ 7], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 33], 00:23:09.704 | 30.00th=[ 50], 40.00th=[ 65], 50.00th=[ 74], 60.00th=[ 87], 00:23:09.704 | 70.00th=[ 101], 80.00th=[ 112], 90.00th=[ 125], 95.00th=[ 134], 00:23:09.704 | 99.00th=[ 159], 99.50th=[ 165], 99.90th=[ 176], 99.95th=[ 178], 00:23:09.704 | 99.99th=[ 188] 00:23:09.704 bw ( KiB/s): min=112640, max=445440, per=10.11%, avg=212285.05, stdev=107277.27, samples=20 00:23:09.704 iops : min= 440, max= 1740, avg=829.15, stdev=419.12, samples=20 00:23:09.704 lat (msec) : 4=0.13%, 10=1.39%, 20=0.77%, 50=27.99%, 100=39.37% 00:23:09.704 lat (msec) : 250=30.35% 00:23:09.704 cpu : usr=0.62%, sys=2.44%, ctx=1507, majf=0, minf=4097 00:23:09.704 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:09.704 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:09.704 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:09.704 issued rwts: total=8356,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:09.704 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:09.704 job1: (groupid=0, jobs=1): err= 0: pid=1635319: Mon Nov 18 16:09:31 2024 00:23:09.704 read: IOPS=742, BW=186MiB/s (195MB/s)(1865MiB/10044msec) 00:23:09.704 slat (usec): min=8, max=78025, avg=1182.09, stdev=3633.99 00:23:09.704 clat (usec): min=643, max=212491, avg=84934.48, stdev=32939.55 00:23:09.704 lat (usec): min=669, max=212507, avg=86116.58, stdev=33460.42 00:23:09.704 clat percentiles (msec): 00:23:09.704 | 1.00th=[ 7], 5.00th=[ 23], 10.00th=[ 50], 20.00th=[ 61], 00:23:09.704 | 30.00th=[ 67], 40.00th=[ 74], 50.00th=[ 83], 60.00th=[ 93], 00:23:09.704 | 70.00th=[ 105], 80.00th=[ 115], 90.00th=[ 128], 95.00th=[ 140], 00:23:09.704 | 99.00th=[ 161], 99.50th=[ 165], 99.90th=[ 171], 99.95th=[ 178], 00:23:09.704 | 99.99th=[ 213] 00:23:09.704 bw ( KiB/s): min=126464, max=251392, per=9.02%, avg=189334.30, stdev=35844.93, samples=20 00:23:09.704 iops : min= 494, max= 982, avg=739.50, stdev=140.14, samples=20 00:23:09.704 lat (usec) : 750=0.03%, 1000=0.11% 00:23:09.704 lat (msec) : 2=0.12%, 4=0.29%, 10=1.43%, 20=2.14%, 50=6.29% 00:23:09.704 lat (msec) : 100=55.27%, 250=34.32% 00:23:09.704 cpu : usr=0.44%, sys=2.32%, ctx=1532, majf=0, minf=4097 00:23:09.704 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:09.704 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:09.704 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:09.704 issued rwts: total=7460,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:09.704 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:09.704 job2: (groupid=0, jobs=1): err= 0: pid=1635336: Mon Nov 18 16:09:31 2024 00:23:09.704 read: IOPS=705, BW=176MiB/s (185MB/s)(1773MiB/10059msec) 00:23:09.704 slat (usec): min=12, max=101004, avg=1193.95, stdev=4016.42 00:23:09.704 clat (usec): min=1925, max=226148, avg=89513.01, stdev=39042.37 00:23:09.704 lat (usec): min=1943, max=236024, avg=90706.96, stdev=39633.51 00:23:09.704 clat percentiles (msec): 00:23:09.704 | 1.00th=[ 9], 5.00th=[ 27], 10.00th=[ 37], 20.00th=[ 52], 00:23:09.704 | 30.00th=[ 66], 40.00th=[ 79], 50.00th=[ 93], 60.00th=[ 104], 00:23:09.704 | 70.00th=[ 114], 80.00th=[ 128], 90.00th=[ 142], 95.00th=[ 150], 00:23:09.704 | 99.00th=[ 165], 99.50th=[ 171], 99.90th=[ 199], 99.95th=[ 205], 00:23:09.704 | 99.99th=[ 226] 00:23:09.704 bw ( KiB/s): min=106496, max=316928, per=8.57%, avg=179905.85, stdev=63204.66, samples=20 00:23:09.704 iops : min= 416, max= 1238, avg=702.70, stdev=246.90, samples=20 00:23:09.704 lat (msec) : 2=0.08%, 4=0.45%, 10=0.72%, 20=2.50%, 50=15.71% 00:23:09.704 lat (msec) : 100=36.51%, 250=44.04% 00:23:09.704 cpu : usr=0.49%, sys=2.41%, ctx=1504, majf=0, minf=4097 00:23:09.704 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:09.704 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:09.704 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:09.704 issued rwts: total=7092,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:09.704 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:09.704 job3: (groupid=0, jobs=1): err= 0: pid=1635348: Mon Nov 18 16:09:31 2024 00:23:09.704 read: IOPS=691, BW=173MiB/s (181MB/s)(1740MiB/10061msec) 00:23:09.704 slat (usec): min=12, max=87495, avg=1352.01, stdev=4117.22 00:23:09.704 clat (msec): min=6, max=225, avg=91.11, stdev=32.43 00:23:09.704 lat (msec): min=6, max=225, avg=92.47, stdev=33.01 00:23:09.704 clat percentiles (msec): 00:23:09.704 | 1.00th=[ 22], 5.00th=[ 45], 10.00th=[ 53], 20.00th=[ 62], 00:23:09.704 | 30.00th=[ 71], 40.00th=[ 80], 50.00th=[ 89], 60.00th=[ 97], 00:23:09.704 | 70.00th=[ 107], 80.00th=[ 121], 90.00th=[ 140], 95.00th=[ 148], 00:23:09.704 | 99.00th=[ 163], 99.50th=[ 171], 99.90th=[ 184], 99.95th=[ 192], 00:23:09.704 | 99.99th=[ 226] 00:23:09.704 bw ( KiB/s): min=105170, max=294912, per=8.41%, avg=176510.85, stdev=52245.33, samples=20 00:23:09.704 iops : min= 410, max= 1152, avg=689.40, stdev=204.13, samples=20 00:23:09.704 lat (msec) : 10=0.24%, 20=0.60%, 50=7.10%, 100=55.01%, 250=37.05% 00:23:09.704 cpu : usr=0.43%, sys=2.45%, ctx=1369, majf=0, minf=4097 00:23:09.704 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:09.704 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:09.704 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:09.704 issued rwts: total=6959,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:09.704 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:09.704 job4: (groupid=0, jobs=1): err= 0: pid=1635354: Mon Nov 18 16:09:31 2024 00:23:09.704 read: IOPS=716, BW=179MiB/s (188MB/s)(1806MiB/10084msec) 00:23:09.704 slat (usec): min=9, max=78764, avg=1071.65, stdev=3683.10 00:23:09.704 clat (msec): min=3, max=215, avg=88.22, stdev=34.89 00:23:09.704 lat (msec): min=3, max=215, avg=89.30, stdev=35.37 00:23:09.704 clat percentiles (msec): 00:23:09.704 | 1.00th=[ 14], 5.00th=[ 31], 10.00th=[ 41], 20.00th=[ 57], 00:23:09.704 | 30.00th=[ 68], 40.00th=[ 80], 50.00th=[ 89], 60.00th=[ 99], 00:23:09.704 | 70.00th=[ 109], 80.00th=[ 122], 90.00th=[ 136], 95.00th=[ 144], 00:23:09.704 | 99.00th=[ 159], 99.50th=[ 163], 99.90th=[ 192], 99.95th=[ 209], 00:23:09.704 | 99.99th=[ 215] 00:23:09.704 bw ( KiB/s): min=104657, max=352768, per=8.73%, avg=183224.55, stdev=61041.64, samples=20 00:23:09.704 iops : min= 408, max= 1378, avg=715.60, stdev=238.54, samples=20 00:23:09.704 lat (msec) : 4=0.01%, 10=0.58%, 20=1.11%, 50=12.03%, 100=47.77% 00:23:09.704 lat (msec) : 250=38.49% 00:23:09.704 cpu : usr=0.37%, sys=2.31%, ctx=1618, majf=0, minf=4097 00:23:09.704 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:09.704 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:09.704 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:09.704 issued rwts: total=7222,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:09.704 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:09.704 job5: (groupid=0, jobs=1): err= 0: pid=1635392: Mon Nov 18 16:09:31 2024 00:23:09.704 read: IOPS=694, BW=174MiB/s (182MB/s)(1748MiB/10061msec) 00:23:09.704 slat (usec): min=9, max=97879, avg=1069.60, stdev=3934.48 00:23:09.704 clat (usec): min=1476, max=191067, avg=90980.76, stdev=37269.51 00:23:09.704 lat (usec): min=1524, max=197696, avg=92050.35, stdev=37801.97 00:23:09.704 clat percentiles (msec): 00:23:09.704 | 1.00th=[ 3], 5.00th=[ 17], 10.00th=[ 41], 20.00th=[ 63], 00:23:09.704 | 30.00th=[ 73], 40.00th=[ 83], 50.00th=[ 95], 60.00th=[ 105], 00:23:09.704 | 70.00th=[ 112], 80.00th=[ 122], 90.00th=[ 140], 95.00th=[ 150], 00:23:09.704 | 99.00th=[ 163], 99.50th=[ 167], 99.90th=[ 178], 99.95th=[ 186], 00:23:09.704 | 99.99th=[ 192] 00:23:09.704 bw ( KiB/s): min=117760, max=278016, per=8.44%, avg=177300.85, stdev=42884.69, samples=20 00:23:09.704 iops : min= 460, max= 1086, avg=692.50, stdev=167.58, samples=20 00:23:09.704 lat (msec) : 2=0.20%, 4=1.46%, 10=1.09%, 20=3.86%, 50=6.27% 00:23:09.704 lat (msec) : 100=42.09%, 250=45.04% 00:23:09.704 cpu : usr=0.49%, sys=2.15%, ctx=1559, majf=0, minf=4098 00:23:09.704 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:09.704 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:09.704 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:09.704 issued rwts: total=6990,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:09.704 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:09.704 job6: (groupid=0, jobs=1): err= 0: pid=1635414: Mon Nov 18 16:09:31 2024 00:23:09.704 read: IOPS=853, BW=213MiB/s (224MB/s)(2152MiB/10083msec) 00:23:09.704 slat (usec): min=8, max=107067, avg=895.90, stdev=3303.20 00:23:09.704 clat (usec): min=1907, max=213891, avg=74021.62, stdev=38368.45 00:23:09.704 lat (usec): min=1931, max=213927, avg=74917.52, stdev=38749.55 00:23:09.704 clat percentiles (msec): 00:23:09.704 | 1.00th=[ 16], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 35], 00:23:09.704 | 30.00th=[ 49], 40.00th=[ 59], 50.00th=[ 68], 60.00th=[ 79], 00:23:09.704 | 70.00th=[ 93], 80.00th=[ 110], 90.00th=[ 131], 95.00th=[ 146], 00:23:09.705 | 99.00th=[ 167], 99.50th=[ 178], 99.90th=[ 192], 99.95th=[ 192], 00:23:09.705 | 99.99th=[ 213] 00:23:09.705 bw ( KiB/s): min=117248, max=496640, per=10.41%, avg=218686.30, stdev=90821.81, samples=20 00:23:09.705 iops : min= 458, max= 1940, avg=854.20, stdev=354.78, samples=20 00:23:09.705 lat (msec) : 2=0.08%, 4=0.17%, 10=0.29%, 20=1.80%, 50=29.21% 00:23:09.705 lat (msec) : 100=42.88%, 250=25.56% 00:23:09.705 cpu : usr=0.40%, sys=2.54%, ctx=1741, majf=0, minf=4097 00:23:09.705 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:23:09.705 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:09.705 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:09.705 issued rwts: total=8607,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:09.705 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:09.705 job7: (groupid=0, jobs=1): err= 0: pid=1635429: Mon Nov 18 16:09:31 2024 00:23:09.705 read: IOPS=862, BW=216MiB/s (226MB/s)(2166MiB/10043msec) 00:23:09.705 slat (usec): min=9, max=94350, avg=986.21, stdev=3189.53 00:23:09.705 clat (usec): min=764, max=194792, avg=73127.97, stdev=32199.34 00:23:09.705 lat (usec): min=821, max=227184, avg=74114.19, stdev=32619.56 00:23:09.705 clat percentiles (msec): 00:23:09.705 | 1.00th=[ 5], 5.00th=[ 16], 10.00th=[ 34], 20.00th=[ 50], 00:23:09.705 | 30.00th=[ 59], 40.00th=[ 65], 50.00th=[ 70], 60.00th=[ 77], 00:23:09.705 | 70.00th=[ 87], 80.00th=[ 100], 90.00th=[ 118], 95.00th=[ 133], 00:23:09.705 | 99.00th=[ 155], 99.50th=[ 161], 99.90th=[ 165], 99.95th=[ 167], 00:23:09.705 | 99.99th=[ 194] 00:23:09.705 bw ( KiB/s): min=137216, max=305053, per=10.48%, avg=220169.25, stdev=49248.54, samples=20 00:23:09.705 iops : min= 536, max= 1191, avg=859.95, stdev=192.29, samples=20 00:23:09.705 lat (usec) : 1000=0.05% 00:23:09.705 lat (msec) : 2=0.36%, 4=0.37%, 10=1.35%, 20=4.55%, 50=13.44% 00:23:09.705 lat (msec) : 100=60.52%, 250=19.37% 00:23:09.705 cpu : usr=0.44%, sys=2.59%, ctx=1694, majf=0, minf=4097 00:23:09.705 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:23:09.705 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:09.705 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:09.705 issued rwts: total=8665,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:09.705 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:09.705 job8: (groupid=0, jobs=1): err= 0: pid=1635476: Mon Nov 18 16:09:31 2024 00:23:09.705 read: IOPS=771, BW=193MiB/s (202MB/s)(1936MiB/10031msec) 00:23:09.705 slat (usec): min=13, max=38599, avg=1168.84, stdev=3466.21 00:23:09.705 clat (msec): min=6, max=184, avg=81.68, stdev=34.00 00:23:09.705 lat (msec): min=6, max=184, avg=82.85, stdev=34.50 00:23:09.705 clat percentiles (msec): 00:23:09.705 | 1.00th=[ 14], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 54], 00:23:09.705 | 30.00th=[ 68], 40.00th=[ 75], 50.00th=[ 84], 60.00th=[ 91], 00:23:09.705 | 70.00th=[ 100], 80.00th=[ 108], 90.00th=[ 127], 95.00th=[ 140], 00:23:09.705 | 99.00th=[ 157], 99.50th=[ 163], 99.90th=[ 171], 99.95th=[ 171], 00:23:09.705 | 99.99th=[ 184] 00:23:09.705 bw ( KiB/s): min=114176, max=408576, per=9.36%, avg=196572.75, stdev=66593.28, samples=20 00:23:09.705 iops : min= 446, max= 1596, avg=767.80, stdev=260.15, samples=20 00:23:09.705 lat (msec) : 10=0.13%, 20=2.80%, 50=15.33%, 100=52.91%, 250=28.83% 00:23:09.705 cpu : usr=0.45%, sys=2.59%, ctx=1504, majf=0, minf=4098 00:23:09.705 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:09.705 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:09.705 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:09.705 issued rwts: total=7743,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:09.705 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:09.705 job9: (groupid=0, jobs=1): err= 0: pid=1635479: Mon Nov 18 16:09:31 2024 00:23:09.705 read: IOPS=664, BW=166MiB/s (174MB/s)(1675MiB/10082msec) 00:23:09.705 slat (usec): min=9, max=66633, avg=881.91, stdev=3574.03 00:23:09.705 clat (usec): min=1645, max=198815, avg=95344.87, stdev=39243.82 00:23:09.705 lat (usec): min=1672, max=200859, avg=96226.79, stdev=39793.80 00:23:09.705 clat percentiles (msec): 00:23:09.705 | 1.00th=[ 8], 5.00th=[ 24], 10.00th=[ 45], 20.00th=[ 59], 00:23:09.705 | 30.00th=[ 71], 40.00th=[ 89], 50.00th=[ 100], 60.00th=[ 108], 00:23:09.705 | 70.00th=[ 120], 80.00th=[ 133], 90.00th=[ 144], 95.00th=[ 153], 00:23:09.705 | 99.00th=[ 174], 99.50th=[ 180], 99.90th=[ 192], 99.95th=[ 199], 00:23:09.705 | 99.99th=[ 199] 00:23:09.705 bw ( KiB/s): min=103424, max=254464, per=8.09%, avg=169896.55, stdev=46503.07, samples=20 00:23:09.705 iops : min= 404, max= 994, avg=663.60, stdev=181.65, samples=20 00:23:09.705 lat (msec) : 2=0.01%, 4=0.36%, 10=1.61%, 20=2.27%, 50=7.54% 00:23:09.705 lat (msec) : 100=39.52%, 250=48.69% 00:23:09.705 cpu : usr=0.22%, sys=2.09%, ctx=1740, majf=0, minf=4098 00:23:09.705 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:09.705 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:09.705 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:09.705 issued rwts: total=6701,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:09.705 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:09.705 job10: (groupid=0, jobs=1): err= 0: pid=1635480: Mon Nov 18 16:09:31 2024 00:23:09.705 read: IOPS=687, BW=172MiB/s (180MB/s)(1733MiB/10085msec) 00:23:09.705 slat (usec): min=9, max=66117, avg=1056.46, stdev=3665.89 00:23:09.705 clat (msec): min=4, max=190, avg=92.00, stdev=34.58 00:23:09.705 lat (msec): min=4, max=206, avg=93.06, stdev=35.08 00:23:09.705 clat percentiles (msec): 00:23:09.705 | 1.00th=[ 17], 5.00th=[ 38], 10.00th=[ 49], 20.00th=[ 63], 00:23:09.705 | 30.00th=[ 71], 40.00th=[ 81], 50.00th=[ 90], 60.00th=[ 102], 00:23:09.705 | 70.00th=[ 111], 80.00th=[ 123], 90.00th=[ 140], 95.00th=[ 153], 00:23:09.705 | 99.00th=[ 167], 99.50th=[ 171], 99.90th=[ 188], 99.95th=[ 190], 00:23:09.705 | 99.99th=[ 192] 00:23:09.705 bw ( KiB/s): min=121344, max=251904, per=8.37%, avg=175787.00, stdev=46609.09, samples=20 00:23:09.705 iops : min= 474, max= 984, avg=686.60, stdev=182.08, samples=20 00:23:09.705 lat (msec) : 10=0.46%, 20=0.74%, 50=9.54%, 100=48.33%, 250=40.93% 00:23:09.705 cpu : usr=0.50%, sys=1.90%, ctx=1535, majf=0, minf=3722 00:23:09.705 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:09.705 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:09.705 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:09.705 issued rwts: total=6931,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:09.705 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:09.705 00:23:09.705 Run status group 0 (all jobs): 00:23:09.705 READ: bw=2051MiB/s (2150MB/s), 166MiB/s-216MiB/s (174MB/s-226MB/s), io=20.2GiB (21.7GB), run=10031-10085msec 00:23:09.705 00:23:09.705 Disk stats (read/write): 00:23:09.705 nvme0n1: ios=16433/0, merge=0/0, ticks=1234158/0, in_queue=1234158, util=97.13% 00:23:09.705 nvme10n1: ios=14686/0, merge=0/0, ticks=1235422/0, in_queue=1235422, util=97.34% 00:23:09.705 nvme1n1: ios=13955/0, merge=0/0, ticks=1235611/0, in_queue=1235611, util=97.61% 00:23:09.705 nvme2n1: ios=13675/0, merge=0/0, ticks=1231896/0, in_queue=1231896, util=97.75% 00:23:09.705 nvme3n1: ios=14226/0, merge=0/0, ticks=1235555/0, in_queue=1235555, util=97.82% 00:23:09.705 nvme4n1: ios=13780/0, merge=0/0, ticks=1237876/0, in_queue=1237876, util=98.20% 00:23:09.705 nvme5n1: ios=17017/0, merge=0/0, ticks=1234842/0, in_queue=1234842, util=98.37% 00:23:09.705 nvme6n1: ios=17059/0, merge=0/0, ticks=1237269/0, in_queue=1237269, util=98.49% 00:23:09.705 nvme7n1: ios=15210/0, merge=0/0, ticks=1234947/0, in_queue=1234947, util=98.93% 00:23:09.705 nvme8n1: ios=13217/0, merge=0/0, ticks=1239317/0, in_queue=1239317, util=99.12% 00:23:09.705 nvme9n1: ios=13668/0, merge=0/0, ticks=1235824/0, in_queue=1235824, util=99.24% 00:23:09.705 16:09:31 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:23:09.705 [global] 00:23:09.705 thread=1 00:23:09.705 invalidate=1 00:23:09.705 rw=randwrite 00:23:09.705 time_based=1 00:23:09.705 runtime=10 00:23:09.705 ioengine=libaio 00:23:09.705 direct=1 00:23:09.705 bs=262144 00:23:09.705 iodepth=64 00:23:09.705 norandommap=1 00:23:09.705 numjobs=1 00:23:09.705 00:23:09.705 [job0] 00:23:09.705 filename=/dev/nvme0n1 00:23:09.705 [job1] 00:23:09.705 filename=/dev/nvme10n1 00:23:09.705 [job2] 00:23:09.705 filename=/dev/nvme1n1 00:23:09.705 [job3] 00:23:09.705 filename=/dev/nvme2n1 00:23:09.705 [job4] 00:23:09.705 filename=/dev/nvme3n1 00:23:09.705 [job5] 00:23:09.705 filename=/dev/nvme4n1 00:23:09.705 [job6] 00:23:09.705 filename=/dev/nvme5n1 00:23:09.705 [job7] 00:23:09.705 filename=/dev/nvme6n1 00:23:09.705 [job8] 00:23:09.705 filename=/dev/nvme7n1 00:23:09.705 [job9] 00:23:09.705 filename=/dev/nvme8n1 00:23:09.705 [job10] 00:23:09.705 filename=/dev/nvme9n1 00:23:09.705 Could not set queue depth (nvme0n1) 00:23:09.705 Could not set queue depth (nvme10n1) 00:23:09.705 Could not set queue depth (nvme1n1) 00:23:09.705 Could not set queue depth (nvme2n1) 00:23:09.705 Could not set queue depth (nvme3n1) 00:23:09.705 Could not set queue depth (nvme4n1) 00:23:09.705 Could not set queue depth (nvme5n1) 00:23:09.705 Could not set queue depth (nvme6n1) 00:23:09.705 Could not set queue depth (nvme7n1) 00:23:09.705 Could not set queue depth (nvme8n1) 00:23:09.705 Could not set queue depth (nvme9n1) 00:23:09.705 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:09.705 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:09.705 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:09.705 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:09.705 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:09.705 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:09.705 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:09.705 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:09.706 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:09.706 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:09.706 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:09.706 fio-3.35 00:23:09.706 Starting 11 threads 00:23:19.698 00:23:19.698 job0: (groupid=0, jobs=1): err= 0: pid=1636526: Mon Nov 18 16:09:42 2024 00:23:19.698 write: IOPS=536, BW=134MiB/s (141MB/s)(1348MiB/10040msec); 0 zone resets 00:23:19.698 slat (usec): min=24, max=83990, avg=1492.16, stdev=3827.50 00:23:19.698 clat (usec): min=1068, max=269143, avg=117635.54, stdev=57482.80 00:23:19.698 lat (usec): min=1109, max=269238, avg=119127.70, stdev=58256.15 00:23:19.698 clat percentiles (msec): 00:23:19.698 | 1.00th=[ 11], 5.00th=[ 33], 10.00th=[ 42], 20.00th=[ 58], 00:23:19.698 | 30.00th=[ 82], 40.00th=[ 100], 50.00th=[ 122], 60.00th=[ 138], 00:23:19.698 | 70.00th=[ 148], 80.00th=[ 169], 90.00th=[ 201], 95.00th=[ 211], 00:23:19.698 | 99.00th=[ 249], 99.50th=[ 255], 99.90th=[ 268], 99.95th=[ 271], 00:23:19.698 | 99.99th=[ 271] 00:23:19.698 bw ( KiB/s): min=72704, max=313344, per=9.21%, avg=136380.75, stdev=57612.17, samples=20 00:23:19.698 iops : min= 284, max= 1224, avg=532.70, stdev=225.04, samples=20 00:23:19.698 lat (msec) : 2=0.09%, 4=0.20%, 10=0.59%, 20=1.86%, 50=13.41% 00:23:19.698 lat (msec) : 100=23.95%, 250=59.07%, 500=0.82% 00:23:19.698 cpu : usr=1.69%, sys=1.78%, ctx=2390, majf=0, minf=1 00:23:19.698 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:19.698 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:19.698 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:19.698 issued rwts: total=0,5390,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:19.698 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:19.698 job1: (groupid=0, jobs=1): err= 0: pid=1636538: Mon Nov 18 16:09:42 2024 00:23:19.698 write: IOPS=575, BW=144MiB/s (151MB/s)(1450MiB/10078msec); 0 zone resets 00:23:19.698 slat (usec): min=21, max=67935, avg=1149.44, stdev=3222.84 00:23:19.698 clat (usec): min=837, max=281314, avg=109947.43, stdev=55256.98 00:23:19.698 lat (usec): min=888, max=292977, avg=111096.86, stdev=55914.84 00:23:19.698 clat percentiles (msec): 00:23:19.698 | 1.00th=[ 14], 5.00th=[ 38], 10.00th=[ 45], 20.00th=[ 59], 00:23:19.698 | 30.00th=[ 79], 40.00th=[ 84], 50.00th=[ 97], 60.00th=[ 116], 00:23:19.698 | 70.00th=[ 136], 80.00th=[ 163], 90.00th=[ 194], 95.00th=[ 209], 00:23:19.698 | 99.00th=[ 245], 99.50th=[ 251], 99.90th=[ 257], 99.95th=[ 259], 00:23:19.698 | 99.99th=[ 284] 00:23:19.698 bw ( KiB/s): min=81920, max=248304, per=9.92%, avg=146903.70, stdev=48732.11, samples=20 00:23:19.698 iops : min= 320, max= 969, avg=573.75, stdev=190.27, samples=20 00:23:19.698 lat (usec) : 1000=0.03% 00:23:19.698 lat (msec) : 2=0.03%, 4=0.16%, 10=0.41%, 20=1.09%, 50=14.08% 00:23:19.698 lat (msec) : 100=35.44%, 250=48.16%, 500=0.59% 00:23:19.698 cpu : usr=1.92%, sys=2.17%, ctx=3116, majf=0, minf=1 00:23:19.698 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:19.698 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:19.698 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:19.698 issued rwts: total=0,5801,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:19.698 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:19.698 job2: (groupid=0, jobs=1): err= 0: pid=1636539: Mon Nov 18 16:09:42 2024 00:23:19.698 write: IOPS=402, BW=101MiB/s (106MB/s)(1029MiB/10217msec); 0 zone resets 00:23:19.698 slat (usec): min=24, max=53349, avg=2268.34, stdev=4534.56 00:23:19.698 clat (usec): min=870, max=483256, avg=156505.32, stdev=57327.51 00:23:19.698 lat (usec): min=909, max=483332, avg=158773.66, stdev=58065.43 00:23:19.698 clat percentiles (msec): 00:23:19.698 | 1.00th=[ 30], 5.00th=[ 64], 10.00th=[ 78], 20.00th=[ 114], 00:23:19.698 | 30.00th=[ 129], 40.00th=[ 144], 50.00th=[ 165], 60.00th=[ 178], 00:23:19.698 | 70.00th=[ 186], 80.00th=[ 194], 90.00th=[ 215], 95.00th=[ 241], 00:23:19.698 | 99.00th=[ 330], 99.50th=[ 409], 99.90th=[ 468], 99.95th=[ 468], 00:23:19.698 | 99.99th=[ 485] 00:23:19.698 bw ( KiB/s): min=59904, max=194560, per=7.01%, avg=103735.30, stdev=32713.84, samples=20 00:23:19.698 iops : min= 234, max= 760, avg=405.20, stdev=127.80, samples=20 00:23:19.698 lat (usec) : 1000=0.02% 00:23:19.698 lat (msec) : 2=0.07%, 20=0.32%, 50=2.21%, 100=13.87%, 250=80.00% 00:23:19.698 lat (msec) : 500=3.50% 00:23:19.698 cpu : usr=1.41%, sys=1.21%, ctx=1339, majf=0, minf=1 00:23:19.698 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:23:19.698 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:19.698 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:19.698 issued rwts: total=0,4116,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:19.698 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:19.698 job3: (groupid=0, jobs=1): err= 0: pid=1636540: Mon Nov 18 16:09:42 2024 00:23:19.698 write: IOPS=712, BW=178MiB/s (187MB/s)(1820MiB/10218msec); 0 zone resets 00:23:19.698 slat (usec): min=23, max=62571, avg=1129.42, stdev=2575.13 00:23:19.698 clat (msec): min=3, max=521, avg=88.67, stdev=48.49 00:23:19.698 lat (msec): min=3, max=521, avg=89.80, stdev=48.99 00:23:19.698 clat percentiles (msec): 00:23:19.698 | 1.00th=[ 22], 5.00th=[ 43], 10.00th=[ 44], 20.00th=[ 46], 00:23:19.698 | 30.00th=[ 47], 40.00th=[ 73], 50.00th=[ 82], 60.00th=[ 95], 00:23:19.698 | 70.00th=[ 115], 80.00th=[ 123], 90.00th=[ 138], 95.00th=[ 155], 00:23:19.698 | 99.00th=[ 271], 99.50th=[ 326], 99.90th=[ 439], 99.95th=[ 456], 00:23:19.698 | 99.99th=[ 523] 00:23:19.698 bw ( KiB/s): min=77824, max=361472, per=12.48%, avg=184705.60, stdev=76764.52, samples=20 00:23:19.698 iops : min= 304, max= 1412, avg=721.50, stdev=299.86, samples=20 00:23:19.698 lat (msec) : 4=0.01%, 10=0.23%, 20=0.63%, 50=31.92%, 100=28.87% 00:23:19.698 lat (msec) : 250=37.10%, 500=1.21%, 750=0.03% 00:23:19.698 cpu : usr=2.21%, sys=2.48%, ctx=2772, majf=0, minf=1 00:23:19.698 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:19.698 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:19.698 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:19.698 issued rwts: total=0,7278,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:19.698 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:19.698 job4: (groupid=0, jobs=1): err= 0: pid=1636541: Mon Nov 18 16:09:42 2024 00:23:19.698 write: IOPS=541, BW=135MiB/s (142MB/s)(1383MiB/10219msec); 0 zone resets 00:23:19.698 slat (usec): min=18, max=55336, avg=1351.59, stdev=3334.56 00:23:19.698 clat (msec): min=3, max=472, avg=116.78, stdev=61.54 00:23:19.698 lat (msec): min=3, max=472, avg=118.13, stdev=62.18 00:23:19.698 clat percentiles (msec): 00:23:19.698 | 1.00th=[ 14], 5.00th=[ 34], 10.00th=[ 50], 20.00th=[ 55], 00:23:19.698 | 30.00th=[ 84], 40.00th=[ 99], 50.00th=[ 114], 60.00th=[ 127], 00:23:19.698 | 70.00th=[ 142], 80.00th=[ 167], 90.00th=[ 190], 95.00th=[ 209], 00:23:19.698 | 99.00th=[ 279], 99.50th=[ 409], 99.90th=[ 464], 99.95th=[ 468], 00:23:19.698 | 99.99th=[ 472] 00:23:19.698 bw ( KiB/s): min=75776, max=309760, per=9.46%, avg=140028.20, stdev=55043.27, samples=20 00:23:19.698 iops : min= 296, max= 1210, avg=546.95, stdev=214.99, samples=20 00:23:19.698 lat (msec) : 4=0.02%, 10=0.42%, 20=2.24%, 50=8.58%, 100=30.71% 00:23:19.698 lat (msec) : 250=55.25%, 500=2.78% 00:23:19.698 cpu : usr=1.78%, sys=1.90%, ctx=2592, majf=0, minf=2 00:23:19.698 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:19.698 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:19.698 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:19.698 issued rwts: total=0,5533,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:19.698 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:19.698 job5: (groupid=0, jobs=1): err= 0: pid=1636542: Mon Nov 18 16:09:42 2024 00:23:19.698 write: IOPS=450, BW=113MiB/s (118MB/s)(1136MiB/10080msec); 0 zone resets 00:23:19.698 slat (usec): min=22, max=98818, avg=1989.46, stdev=4441.14 00:23:19.698 clat (msec): min=2, max=247, avg=139.52, stdev=47.79 00:23:19.698 lat (msec): min=2, max=247, avg=141.51, stdev=48.37 00:23:19.698 clat percentiles (msec): 00:23:19.698 | 1.00th=[ 26], 5.00th=[ 46], 10.00th=[ 68], 20.00th=[ 104], 00:23:19.698 | 30.00th=[ 123], 40.00th=[ 138], 50.00th=[ 146], 60.00th=[ 150], 00:23:19.698 | 70.00th=[ 161], 80.00th=[ 182], 90.00th=[ 201], 95.00th=[ 213], 00:23:19.698 | 99.00th=[ 234], 99.50th=[ 241], 99.90th=[ 245], 99.95th=[ 247], 00:23:19.698 | 99.99th=[ 249] 00:23:19.698 bw ( KiB/s): min=77979, max=196096, per=7.74%, avg=114660.90, stdev=32420.18, samples=20 00:23:19.698 iops : min= 304, max= 766, avg=447.85, stdev=126.69, samples=20 00:23:19.698 lat (msec) : 4=0.09%, 10=0.07%, 20=0.31%, 50=6.78%, 100=11.65% 00:23:19.698 lat (msec) : 250=81.11% 00:23:19.698 cpu : usr=1.52%, sys=1.47%, ctx=1550, majf=0, minf=1 00:23:19.698 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:19.698 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:19.698 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:19.698 issued rwts: total=0,4542,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:19.698 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:19.698 job6: (groupid=0, jobs=1): err= 0: pid=1636544: Mon Nov 18 16:09:42 2024 00:23:19.698 write: IOPS=636, BW=159MiB/s (167MB/s)(1626MiB/10221msec); 0 zone resets 00:23:19.698 slat (usec): min=17, max=76473, avg=1316.98, stdev=3168.46 00:23:19.698 clat (msec): min=7, max=532, avg=99.18, stdev=55.55 00:23:19.698 lat (msec): min=7, max=533, avg=100.50, stdev=56.10 00:23:19.698 clat percentiles (msec): 00:23:19.698 | 1.00th=[ 20], 5.00th=[ 42], 10.00th=[ 43], 20.00th=[ 48], 00:23:19.698 | 30.00th=[ 78], 40.00th=[ 82], 50.00th=[ 85], 60.00th=[ 106], 00:23:19.698 | 70.00th=[ 118], 80.00th=[ 132], 90.00th=[ 150], 95.00th=[ 186], 00:23:19.699 | 99.00th=[ 309], 99.50th=[ 405], 99.90th=[ 498], 99.95th=[ 514], 00:23:19.699 | 99.99th=[ 535] 00:23:19.699 bw ( KiB/s): min=54272, max=380167, per=11.14%, avg=164889.35, stdev=70720.98, samples=20 00:23:19.699 iops : min= 212, max= 1485, avg=644.05, stdev=276.28, samples=20 00:23:19.699 lat (msec) : 10=0.02%, 20=1.09%, 50=19.69%, 100=37.46%, 250=39.92% 00:23:19.699 lat (msec) : 500=1.72%, 750=0.09% 00:23:19.699 cpu : usr=2.13%, sys=2.08%, ctx=2403, majf=0, minf=1 00:23:19.699 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:23:19.699 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:19.699 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:19.699 issued rwts: total=0,6505,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:19.699 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:19.699 job7: (groupid=0, jobs=1): err= 0: pid=1636548: Mon Nov 18 16:09:42 2024 00:23:19.699 write: IOPS=483, BW=121MiB/s (127MB/s)(1235MiB/10222msec); 0 zone resets 00:23:19.699 slat (usec): min=18, max=50775, avg=1532.15, stdev=3689.95 00:23:19.699 clat (usec): min=1415, max=474142, avg=130851.13, stdev=62289.14 00:23:19.699 lat (usec): min=1505, max=474180, avg=132383.29, stdev=63000.73 00:23:19.699 clat percentiles (msec): 00:23:19.699 | 1.00th=[ 4], 5.00th=[ 17], 10.00th=[ 30], 20.00th=[ 90], 00:23:19.699 | 30.00th=[ 111], 40.00th=[ 123], 50.00th=[ 138], 60.00th=[ 146], 00:23:19.699 | 70.00th=[ 155], 80.00th=[ 174], 90.00th=[ 201], 95.00th=[ 226], 00:23:19.699 | 99.00th=[ 288], 99.50th=[ 372], 99.90th=[ 456], 99.95th=[ 456], 00:23:19.699 | 99.99th=[ 477] 00:23:19.699 bw ( KiB/s): min=75264, max=246272, per=8.43%, avg=124811.85, stdev=39259.07, samples=20 00:23:19.699 iops : min= 294, max= 962, avg=487.50, stdev=153.34, samples=20 00:23:19.699 lat (msec) : 2=0.12%, 4=0.93%, 10=1.74%, 20=3.58%, 50=6.66% 00:23:19.699 lat (msec) : 100=12.25%, 250=72.24%, 500=2.47% 00:23:19.699 cpu : usr=1.49%, sys=1.45%, ctx=2499, majf=0, minf=1 00:23:19.699 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:19.699 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:19.699 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:19.699 issued rwts: total=0,4939,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:19.699 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:19.699 job8: (groupid=0, jobs=1): err= 0: pid=1636549: Mon Nov 18 16:09:42 2024 00:23:19.699 write: IOPS=550, BW=138MiB/s (144MB/s)(1383MiB/10045msec); 0 zone resets 00:23:19.699 slat (usec): min=23, max=85480, avg=1575.28, stdev=3454.31 00:23:19.699 clat (msec): min=3, max=224, avg=114.59, stdev=41.67 00:23:19.699 lat (msec): min=3, max=224, avg=116.16, stdev=42.29 00:23:19.699 clat percentiles (msec): 00:23:19.699 | 1.00th=[ 13], 5.00th=[ 50], 10.00th=[ 70], 20.00th=[ 80], 00:23:19.699 | 30.00th=[ 84], 40.00th=[ 99], 50.00th=[ 117], 60.00th=[ 131], 00:23:19.699 | 70.00th=[ 144], 80.00th=[ 148], 90.00th=[ 165], 95.00th=[ 186], 00:23:19.699 | 99.00th=[ 213], 99.50th=[ 218], 99.90th=[ 224], 99.95th=[ 224], 00:23:19.699 | 99.99th=[ 226] 00:23:19.699 bw ( KiB/s): min=79872, max=215552, per=9.46%, avg=140007.10, stdev=37090.00, samples=20 00:23:19.699 iops : min= 312, max= 842, avg=546.90, stdev=144.88, samples=20 00:23:19.699 lat (msec) : 4=0.11%, 10=0.61%, 20=0.70%, 50=4.01%, 100=35.21% 00:23:19.699 lat (msec) : 250=59.35% 00:23:19.699 cpu : usr=1.87%, sys=1.90%, ctx=2133, majf=0, minf=1 00:23:19.699 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:19.699 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:19.699 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:19.699 issued rwts: total=0,5532,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:19.699 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:19.699 job9: (groupid=0, jobs=1): err= 0: pid=1636550: Mon Nov 18 16:09:42 2024 00:23:19.699 write: IOPS=398, BW=99.7MiB/s (105MB/s)(1018MiB/10214msec); 0 zone resets 00:23:19.699 slat (usec): min=26, max=73521, avg=1997.56, stdev=4800.01 00:23:19.699 clat (msec): min=3, max=482, avg=158.35, stdev=63.99 00:23:19.699 lat (msec): min=3, max=482, avg=160.34, stdev=64.92 00:23:19.699 clat percentiles (msec): 00:23:19.699 | 1.00th=[ 19], 5.00th=[ 39], 10.00th=[ 63], 20.00th=[ 112], 00:23:19.699 | 30.00th=[ 133], 40.00th=[ 148], 50.00th=[ 167], 60.00th=[ 182], 00:23:19.699 | 70.00th=[ 192], 80.00th=[ 203], 90.00th=[ 228], 95.00th=[ 257], 00:23:19.699 | 99.00th=[ 300], 99.50th=[ 376], 99.90th=[ 460], 99.95th=[ 460], 00:23:19.699 | 99.99th=[ 481] 00:23:19.699 bw ( KiB/s): min=62976, max=156672, per=6.93%, avg=102657.05, stdev=25387.42, samples=20 00:23:19.699 iops : min= 246, max= 612, avg=400.95, stdev=99.19, samples=20 00:23:19.699 lat (msec) : 4=0.02%, 10=0.25%, 20=0.93%, 50=6.46%, 100=9.77% 00:23:19.699 lat (msec) : 250=76.55%, 500=6.02% 00:23:19.699 cpu : usr=1.24%, sys=1.42%, ctx=1859, majf=0, minf=1 00:23:19.699 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:23:19.699 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:19.699 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:19.699 issued rwts: total=0,4073,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:19.699 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:19.699 job10: (groupid=0, jobs=1): err= 0: pid=1636551: Mon Nov 18 16:09:42 2024 00:23:19.699 write: IOPS=529, BW=132MiB/s (139MB/s)(1352MiB/10216msec); 0 zone resets 00:23:19.699 slat (usec): min=24, max=93556, avg=1360.18, stdev=3592.31 00:23:19.699 clat (msec): min=3, max=518, avg=119.49, stdev=58.41 00:23:19.699 lat (msec): min=4, max=518, avg=120.85, stdev=59.09 00:23:19.699 clat percentiles (msec): 00:23:19.699 | 1.00th=[ 13], 5.00th=[ 29], 10.00th=[ 48], 20.00th=[ 80], 00:23:19.699 | 30.00th=[ 84], 40.00th=[ 101], 50.00th=[ 115], 60.00th=[ 123], 00:23:19.699 | 70.00th=[ 148], 80.00th=[ 171], 90.00th=[ 186], 95.00th=[ 194], 00:23:19.699 | 99.00th=[ 288], 99.50th=[ 355], 99.90th=[ 514], 99.95th=[ 518], 00:23:19.699 | 99.99th=[ 518] 00:23:19.699 bw ( KiB/s): min=90112, max=203264, per=9.24%, avg=136802.45, stdev=35484.27, samples=20 00:23:19.699 iops : min= 352, max= 794, avg=534.35, stdev=138.65, samples=20 00:23:19.699 lat (msec) : 4=0.02%, 10=0.43%, 20=2.03%, 50=8.36%, 100=29.05% 00:23:19.699 lat (msec) : 250=58.28%, 500=1.59%, 750=0.24% 00:23:19.699 cpu : usr=1.67%, sys=2.14%, ctx=2670, majf=0, minf=1 00:23:19.699 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:19.699 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:19.699 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:19.699 issued rwts: total=0,5407,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:19.699 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:19.699 00:23:19.699 Run status group 0 (all jobs): 00:23:19.699 WRITE: bw=1446MiB/s (1516MB/s), 99.7MiB/s-178MiB/s (105MB/s-187MB/s), io=14.4GiB (15.5GB), run=10040-10222msec 00:23:19.699 00:23:19.699 Disk stats (read/write): 00:23:19.699 nvme0n1: ios=50/10461, merge=0/0, ticks=2285/1211971, in_queue=1214256, util=100.00% 00:23:19.699 nvme10n1: ios=36/11281, merge=0/0, ticks=849/1225130, in_queue=1225979, util=99.89% 00:23:19.699 nvme1n1: ios=40/8206, merge=0/0, ticks=366/1233933, in_queue=1234299, util=99.14% 00:23:19.699 nvme2n1: ios=42/14536, merge=0/0, ticks=149/1240215, in_queue=1240364, util=98.78% 00:23:19.699 nvme3n1: ios=0/11045, merge=0/0, ticks=0/1243742, in_queue=1243742, util=97.92% 00:23:19.699 nvme4n1: ios=45/8867, merge=0/0, ticks=1971/1207453, in_queue=1209424, util=100.00% 00:23:19.699 nvme5n1: ios=39/12989, merge=0/0, ticks=70/1238185, in_queue=1238255, util=98.80% 00:23:19.699 nvme6n1: ios=45/9854, merge=0/0, ticks=196/1243308, in_queue=1243504, util=100.00% 00:23:19.699 nvme7n1: ios=43/10835, merge=0/0, ticks=1906/1211761, in_queue=1213667, util=100.00% 00:23:19.699 nvme8n1: ios=41/8129, merge=0/0, ticks=1539/1237373, in_queue=1238912, util=100.00% 00:23:19.699 nvme9n1: ios=42/10790, merge=0/0, ticks=2165/1237622, in_queue=1239787, util=100.00% 00:23:19.699 16:09:42 -- target/multiconnection.sh@36 -- # sync 00:23:19.699 16:09:42 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:19.699 16:09:42 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:19.699 16:09:42 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:19.699 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:19.699 16:09:42 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:19.699 16:09:42 -- common/autotest_common.sh@1208 -- # local i=0 00:23:19.699 16:09:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:19.699 16:09:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:23:19.699 16:09:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:19.699 16:09:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:23:19.699 16:09:42 -- common/autotest_common.sh@1220 -- # return 0 00:23:19.699 16:09:42 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:19.699 16:09:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.699 16:09:42 -- common/autotest_common.sh@10 -- # set +x 00:23:19.699 16:09:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.699 16:09:42 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:19.699 16:09:42 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:19.699 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:19.699 16:09:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:19.699 16:09:43 -- common/autotest_common.sh@1208 -- # local i=0 00:23:19.699 16:09:43 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:19.699 16:09:43 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:23:19.699 16:09:43 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:19.699 16:09:43 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:23:19.699 16:09:43 -- common/autotest_common.sh@1220 -- # return 0 00:23:19.699 16:09:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:19.699 16:09:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.699 16:09:43 -- common/autotest_common.sh@10 -- # set +x 00:23:19.699 16:09:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.699 16:09:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:19.699 16:09:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:19.958 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:19.958 16:09:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:19.958 16:09:43 -- common/autotest_common.sh@1208 -- # local i=0 00:23:19.958 16:09:43 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:19.958 16:09:43 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:23:19.958 16:09:43 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:19.958 16:09:43 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:23:19.958 16:09:43 -- common/autotest_common.sh@1220 -- # return 0 00:23:19.958 16:09:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:19.958 16:09:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.958 16:09:43 -- common/autotest_common.sh@10 -- # set +x 00:23:19.958 16:09:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.958 16:09:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:19.958 16:09:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:20.524 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:20.524 16:09:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:20.524 16:09:43 -- common/autotest_common.sh@1208 -- # local i=0 00:23:20.524 16:09:43 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:20.524 16:09:43 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:23:20.524 16:09:43 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:20.524 16:09:43 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:23:20.524 16:09:43 -- common/autotest_common.sh@1220 -- # return 0 00:23:20.524 16:09:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:20.524 16:09:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.524 16:09:43 -- common/autotest_common.sh@10 -- # set +x 00:23:20.524 16:09:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.524 16:09:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:20.524 16:09:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:20.782 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:20.782 16:09:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:20.782 16:09:44 -- common/autotest_common.sh@1208 -- # local i=0 00:23:20.782 16:09:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:20.782 16:09:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:23:20.782 16:09:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:20.782 16:09:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:23:20.782 16:09:44 -- common/autotest_common.sh@1220 -- # return 0 00:23:20.782 16:09:44 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:20.782 16:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.782 16:09:44 -- common/autotest_common.sh@10 -- # set +x 00:23:20.782 16:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.782 16:09:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:20.782 16:09:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:20.782 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:20.782 16:09:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:20.782 16:09:44 -- common/autotest_common.sh@1208 -- # local i=0 00:23:20.782 16:09:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:20.782 16:09:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:23:20.782 16:09:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:20.782 16:09:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:23:20.782 16:09:44 -- common/autotest_common.sh@1220 -- # return 0 00:23:20.782 16:09:44 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:20.782 16:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.782 16:09:44 -- common/autotest_common.sh@10 -- # set +x 00:23:20.782 16:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.782 16:09:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:20.782 16:09:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:21.040 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:21.041 16:09:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:21.041 16:09:44 -- common/autotest_common.sh@1208 -- # local i=0 00:23:21.041 16:09:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:21.041 16:09:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:23:21.041 16:09:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:21.041 16:09:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:23:21.041 16:09:44 -- common/autotest_common.sh@1220 -- # return 0 00:23:21.041 16:09:44 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:21.041 16:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.041 16:09:44 -- common/autotest_common.sh@10 -- # set +x 00:23:21.041 16:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.041 16:09:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:21.041 16:09:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:21.299 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:21.299 16:09:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:21.299 16:09:44 -- common/autotest_common.sh@1208 -- # local i=0 00:23:21.299 16:09:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:21.299 16:09:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:23:21.299 16:09:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:21.299 16:09:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:23:21.299 16:09:44 -- common/autotest_common.sh@1220 -- # return 0 00:23:21.299 16:09:44 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:21.299 16:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.299 16:09:44 -- common/autotest_common.sh@10 -- # set +x 00:23:21.299 16:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.299 16:09:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:21.299 16:09:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:21.557 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:21.557 16:09:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:21.557 16:09:44 -- common/autotest_common.sh@1208 -- # local i=0 00:23:21.557 16:09:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:21.557 16:09:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:23:21.557 16:09:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:21.557 16:09:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:23:21.557 16:09:44 -- common/autotest_common.sh@1220 -- # return 0 00:23:21.557 16:09:44 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:21.557 16:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.557 16:09:44 -- common/autotest_common.sh@10 -- # set +x 00:23:21.557 16:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.557 16:09:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:21.557 16:09:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:21.557 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:21.557 16:09:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:21.557 16:09:44 -- common/autotest_common.sh@1208 -- # local i=0 00:23:21.557 16:09:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:21.557 16:09:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:23:21.557 16:09:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:21.557 16:09:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:23:21.557 16:09:45 -- common/autotest_common.sh@1220 -- # return 0 00:23:21.557 16:09:45 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:21.557 16:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.557 16:09:45 -- common/autotest_common.sh@10 -- # set +x 00:23:21.557 16:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.557 16:09:45 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:21.557 16:09:45 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:21.557 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:21.557 16:09:45 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:21.557 16:09:45 -- common/autotest_common.sh@1208 -- # local i=0 00:23:21.557 16:09:45 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:21.557 16:09:45 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:23:21.557 16:09:45 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:21.557 16:09:45 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:23:21.557 16:09:45 -- common/autotest_common.sh@1220 -- # return 0 00:23:21.557 16:09:45 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:21.557 16:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.557 16:09:45 -- common/autotest_common.sh@10 -- # set +x 00:23:21.815 16:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.815 16:09:45 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:21.815 16:09:45 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:21.815 16:09:45 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:21.815 16:09:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:21.815 16:09:45 -- nvmf/common.sh@116 -- # sync 00:23:21.815 16:09:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:21.815 16:09:45 -- nvmf/common.sh@119 -- # set +e 00:23:21.815 16:09:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:21.815 16:09:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:21.815 rmmod nvme_tcp 00:23:21.815 rmmod nvme_fabrics 00:23:21.815 rmmod nvme_keyring 00:23:21.815 16:09:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:21.815 16:09:45 -- nvmf/common.sh@123 -- # set -e 00:23:21.815 16:09:45 -- nvmf/common.sh@124 -- # return 0 00:23:21.815 16:09:45 -- nvmf/common.sh@477 -- # '[' -n 1630207 ']' 00:23:21.815 16:09:45 -- nvmf/common.sh@478 -- # killprocess 1630207 00:23:21.815 16:09:45 -- common/autotest_common.sh@936 -- # '[' -z 1630207 ']' 00:23:21.815 16:09:45 -- common/autotest_common.sh@940 -- # kill -0 1630207 00:23:21.815 16:09:45 -- common/autotest_common.sh@941 -- # uname 00:23:21.815 16:09:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:21.815 16:09:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1630207 00:23:21.815 16:09:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:21.815 16:09:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:21.815 16:09:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1630207' 00:23:21.815 killing process with pid 1630207 00:23:21.815 16:09:45 -- common/autotest_common.sh@955 -- # kill 1630207 00:23:21.815 16:09:45 -- common/autotest_common.sh@960 -- # wait 1630207 00:23:22.381 16:09:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:22.381 16:09:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:22.381 16:09:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:22.381 16:09:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:22.381 16:09:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:22.381 16:09:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:22.381 16:09:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:22.381 16:09:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:24.281 16:09:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:24.281 00:23:24.281 real 1m1.982s 00:23:24.281 user 3m32.171s 00:23:24.281 sys 0m24.811s 00:23:24.281 16:09:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:24.281 16:09:47 -- common/autotest_common.sh@10 -- # set +x 00:23:24.281 ************************************ 00:23:24.281 END TEST nvmf_multiconnection 00:23:24.281 ************************************ 00:23:24.540 16:09:47 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:24.540 16:09:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:24.540 16:09:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:24.540 16:09:47 -- common/autotest_common.sh@10 -- # set +x 00:23:24.540 ************************************ 00:23:24.540 START TEST nvmf_initiator_timeout 00:23:24.540 ************************************ 00:23:24.540 16:09:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:24.540 * Looking for test storage... 00:23:24.540 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:24.540 16:09:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:24.540 16:09:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:24.540 16:09:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:24.540 16:09:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:24.540 16:09:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:24.540 16:09:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:24.540 16:09:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:24.540 16:09:48 -- scripts/common.sh@335 -- # IFS=.-: 00:23:24.540 16:09:48 -- scripts/common.sh@335 -- # read -ra ver1 00:23:24.540 16:09:48 -- scripts/common.sh@336 -- # IFS=.-: 00:23:24.540 16:09:48 -- scripts/common.sh@336 -- # read -ra ver2 00:23:24.540 16:09:48 -- scripts/common.sh@337 -- # local 'op=<' 00:23:24.540 16:09:48 -- scripts/common.sh@339 -- # ver1_l=2 00:23:24.540 16:09:48 -- scripts/common.sh@340 -- # ver2_l=1 00:23:24.540 16:09:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:24.540 16:09:48 -- scripts/common.sh@343 -- # case "$op" in 00:23:24.540 16:09:48 -- scripts/common.sh@344 -- # : 1 00:23:24.540 16:09:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:24.540 16:09:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:24.540 16:09:48 -- scripts/common.sh@364 -- # decimal 1 00:23:24.540 16:09:48 -- scripts/common.sh@352 -- # local d=1 00:23:24.540 16:09:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:24.540 16:09:48 -- scripts/common.sh@354 -- # echo 1 00:23:24.540 16:09:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:24.540 16:09:48 -- scripts/common.sh@365 -- # decimal 2 00:23:24.540 16:09:48 -- scripts/common.sh@352 -- # local d=2 00:23:24.540 16:09:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:24.540 16:09:48 -- scripts/common.sh@354 -- # echo 2 00:23:24.540 16:09:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:24.540 16:09:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:24.540 16:09:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:24.540 16:09:48 -- scripts/common.sh@367 -- # return 0 00:23:24.540 16:09:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:24.540 16:09:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:24.540 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:24.540 --rc genhtml_branch_coverage=1 00:23:24.540 --rc genhtml_function_coverage=1 00:23:24.540 --rc genhtml_legend=1 00:23:24.540 --rc geninfo_all_blocks=1 00:23:24.540 --rc geninfo_unexecuted_blocks=1 00:23:24.540 00:23:24.540 ' 00:23:24.540 16:09:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:24.540 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:24.540 --rc genhtml_branch_coverage=1 00:23:24.540 --rc genhtml_function_coverage=1 00:23:24.540 --rc genhtml_legend=1 00:23:24.540 --rc geninfo_all_blocks=1 00:23:24.540 --rc geninfo_unexecuted_blocks=1 00:23:24.540 00:23:24.540 ' 00:23:24.540 16:09:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:24.540 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:24.540 --rc genhtml_branch_coverage=1 00:23:24.540 --rc genhtml_function_coverage=1 00:23:24.540 --rc genhtml_legend=1 00:23:24.540 --rc geninfo_all_blocks=1 00:23:24.540 --rc geninfo_unexecuted_blocks=1 00:23:24.540 00:23:24.540 ' 00:23:24.540 16:09:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:24.540 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:24.540 --rc genhtml_branch_coverage=1 00:23:24.540 --rc genhtml_function_coverage=1 00:23:24.540 --rc genhtml_legend=1 00:23:24.540 --rc geninfo_all_blocks=1 00:23:24.540 --rc geninfo_unexecuted_blocks=1 00:23:24.540 00:23:24.540 ' 00:23:24.540 16:09:48 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:24.540 16:09:48 -- nvmf/common.sh@7 -- # uname -s 00:23:24.540 16:09:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:24.540 16:09:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:24.540 16:09:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:24.540 16:09:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:24.540 16:09:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:24.540 16:09:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:24.540 16:09:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:24.540 16:09:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:24.540 16:09:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:24.540 16:09:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:24.540 16:09:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:24.540 16:09:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:24.540 16:09:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:24.540 16:09:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:24.540 16:09:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:24.540 16:09:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:24.540 16:09:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:24.540 16:09:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:24.540 16:09:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:24.540 16:09:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:24.540 16:09:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:24.540 16:09:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:24.540 16:09:48 -- paths/export.sh@5 -- # export PATH 00:23:24.540 16:09:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:24.540 16:09:48 -- nvmf/common.sh@46 -- # : 0 00:23:24.540 16:09:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:24.540 16:09:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:24.540 16:09:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:24.540 16:09:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:24.540 16:09:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:24.540 16:09:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:24.540 16:09:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:24.540 16:09:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:24.540 16:09:48 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:24.540 16:09:48 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:24.540 16:09:48 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:24.540 16:09:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:24.540 16:09:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:24.540 16:09:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:24.540 16:09:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:24.540 16:09:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:24.540 16:09:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:24.540 16:09:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:24.541 16:09:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:24.541 16:09:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:24.541 16:09:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:24.541 16:09:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:24.541 16:09:48 -- common/autotest_common.sh@10 -- # set +x 00:23:27.072 16:09:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:27.072 16:09:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:27.072 16:09:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:27.072 16:09:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:27.072 16:09:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:27.072 16:09:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:27.072 16:09:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:27.072 16:09:50 -- nvmf/common.sh@294 -- # net_devs=() 00:23:27.072 16:09:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:27.072 16:09:50 -- nvmf/common.sh@295 -- # e810=() 00:23:27.072 16:09:50 -- nvmf/common.sh@295 -- # local -ga e810 00:23:27.072 16:09:50 -- nvmf/common.sh@296 -- # x722=() 00:23:27.072 16:09:50 -- nvmf/common.sh@296 -- # local -ga x722 00:23:27.072 16:09:50 -- nvmf/common.sh@297 -- # mlx=() 00:23:27.072 16:09:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:27.072 16:09:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:27.072 16:09:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:27.072 16:09:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:27.072 16:09:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:27.072 16:09:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:27.072 16:09:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:27.072 16:09:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:27.072 16:09:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:27.072 16:09:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:27.072 16:09:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:27.072 16:09:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:27.072 16:09:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:27.072 16:09:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:27.072 16:09:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:27.072 16:09:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:27.072 16:09:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:27.072 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:27.072 16:09:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:27.072 16:09:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:27.072 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:27.072 16:09:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:27.072 16:09:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:27.072 16:09:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:27.073 16:09:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:27.073 16:09:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:27.073 16:09:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:27.073 16:09:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:27.073 16:09:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:27.073 16:09:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:27.073 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:27.073 16:09:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:27.073 16:09:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:27.073 16:09:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:27.073 16:09:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:27.073 16:09:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:27.073 16:09:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:27.073 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:27.073 16:09:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:27.073 16:09:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:27.073 16:09:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:27.073 16:09:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:27.073 16:09:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:27.073 16:09:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:27.073 16:09:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:27.073 16:09:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:27.073 16:09:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:27.073 16:09:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:27.073 16:09:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:27.073 16:09:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:27.073 16:09:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:27.073 16:09:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:27.073 16:09:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:27.073 16:09:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:27.073 16:09:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:27.073 16:09:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:27.073 16:09:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:27.073 16:09:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:27.073 16:09:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:27.073 16:09:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:27.073 16:09:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:27.073 16:09:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:27.073 16:09:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:27.073 16:09:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:27.073 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:27.073 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:23:27.073 00:23:27.073 --- 10.0.0.2 ping statistics --- 00:23:27.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:27.073 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:23:27.073 16:09:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:27.073 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:27.073 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:23:27.073 00:23:27.073 --- 10.0.0.1 ping statistics --- 00:23:27.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:27.073 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:23:27.073 16:09:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:27.073 16:09:50 -- nvmf/common.sh@410 -- # return 0 00:23:27.073 16:09:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:27.073 16:09:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:27.073 16:09:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:27.073 16:09:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:27.073 16:09:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:27.073 16:09:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:27.073 16:09:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:27.073 16:09:50 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:27.073 16:09:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:27.073 16:09:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:27.073 16:09:50 -- common/autotest_common.sh@10 -- # set +x 00:23:27.073 16:09:50 -- nvmf/common.sh@469 -- # nvmfpid=1640128 00:23:27.073 16:09:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:27.073 16:09:50 -- nvmf/common.sh@470 -- # waitforlisten 1640128 00:23:27.073 16:09:50 -- common/autotest_common.sh@829 -- # '[' -z 1640128 ']' 00:23:27.073 16:09:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:27.073 16:09:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:27.073 16:09:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:27.073 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:27.073 16:09:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:27.073 16:09:50 -- common/autotest_common.sh@10 -- # set +x 00:23:27.073 [2024-11-18 16:09:50.490826] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:27.073 [2024-11-18 16:09:50.490930] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:27.073 EAL: No free 2048 kB hugepages reported on node 1 00:23:27.073 [2024-11-18 16:09:50.561925] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:27.073 [2024-11-18 16:09:50.654157] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:27.073 [2024-11-18 16:09:50.654319] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:27.073 [2024-11-18 16:09:50.654339] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:27.073 [2024-11-18 16:09:50.654353] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:27.073 [2024-11-18 16:09:50.654411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:27.073 [2024-11-18 16:09:50.654469] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:27.073 [2024-11-18 16:09:50.654522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:27.073 [2024-11-18 16:09:50.654525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:28.007 16:09:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:28.007 16:09:51 -- common/autotest_common.sh@862 -- # return 0 00:23:28.007 16:09:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:28.007 16:09:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:28.007 16:09:51 -- common/autotest_common.sh@10 -- # set +x 00:23:28.007 16:09:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:28.007 16:09:51 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:28.007 16:09:51 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:28.007 16:09:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.007 16:09:51 -- common/autotest_common.sh@10 -- # set +x 00:23:28.007 Malloc0 00:23:28.007 16:09:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.007 16:09:51 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:28.007 16:09:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.007 16:09:51 -- common/autotest_common.sh@10 -- # set +x 00:23:28.007 Delay0 00:23:28.007 16:09:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.007 16:09:51 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:28.007 16:09:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.007 16:09:51 -- common/autotest_common.sh@10 -- # set +x 00:23:28.007 [2024-11-18 16:09:51.503990] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:28.007 16:09:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.007 16:09:51 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:28.007 16:09:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.007 16:09:51 -- common/autotest_common.sh@10 -- # set +x 00:23:28.007 16:09:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.007 16:09:51 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:28.007 16:09:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.007 16:09:51 -- common/autotest_common.sh@10 -- # set +x 00:23:28.007 16:09:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.007 16:09:51 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:28.007 16:09:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.007 16:09:51 -- common/autotest_common.sh@10 -- # set +x 00:23:28.007 [2024-11-18 16:09:51.532309] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:28.007 16:09:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.007 16:09:51 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:28.573 16:09:52 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:28.573 16:09:52 -- common/autotest_common.sh@1187 -- # local i=0 00:23:28.573 16:09:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:28.573 16:09:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:28.573 16:09:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:31.100 16:09:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:31.100 16:09:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:31.100 16:09:54 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:31.100 16:09:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:31.100 16:09:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:31.100 16:09:54 -- common/autotest_common.sh@1197 -- # return 0 00:23:31.100 16:09:54 -- target/initiator_timeout.sh@35 -- # fio_pid=1640659 00:23:31.100 16:09:54 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:31.100 16:09:54 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:31.100 [global] 00:23:31.100 thread=1 00:23:31.100 invalidate=1 00:23:31.100 rw=write 00:23:31.100 time_based=1 00:23:31.100 runtime=60 00:23:31.100 ioengine=libaio 00:23:31.100 direct=1 00:23:31.100 bs=4096 00:23:31.100 iodepth=1 00:23:31.100 norandommap=0 00:23:31.100 numjobs=1 00:23:31.100 00:23:31.100 verify_dump=1 00:23:31.100 verify_backlog=512 00:23:31.100 verify_state_save=0 00:23:31.100 do_verify=1 00:23:31.100 verify=crc32c-intel 00:23:31.100 [job0] 00:23:31.100 filename=/dev/nvme0n1 00:23:31.100 Could not set queue depth (nvme0n1) 00:23:31.100 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:31.100 fio-3.35 00:23:31.100 Starting 1 thread 00:23:33.625 16:09:57 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:33.625 16:09:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.625 16:09:57 -- common/autotest_common.sh@10 -- # set +x 00:23:33.625 true 00:23:33.625 16:09:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.625 16:09:57 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:33.625 16:09:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.625 16:09:57 -- common/autotest_common.sh@10 -- # set +x 00:23:33.625 true 00:23:33.625 16:09:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.625 16:09:57 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:33.625 16:09:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.625 16:09:57 -- common/autotest_common.sh@10 -- # set +x 00:23:33.625 true 00:23:33.625 16:09:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.625 16:09:57 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:33.625 16:09:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:33.625 16:09:57 -- common/autotest_common.sh@10 -- # set +x 00:23:33.625 true 00:23:33.625 16:09:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:33.625 16:09:57 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:36.906 16:10:00 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:36.906 16:10:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:36.906 16:10:00 -- common/autotest_common.sh@10 -- # set +x 00:23:36.906 true 00:23:36.906 16:10:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:36.906 16:10:00 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:36.906 16:10:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:36.906 16:10:00 -- common/autotest_common.sh@10 -- # set +x 00:23:36.906 true 00:23:36.906 16:10:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:36.906 16:10:00 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:36.906 16:10:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:36.906 16:10:00 -- common/autotest_common.sh@10 -- # set +x 00:23:36.906 true 00:23:36.906 16:10:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:36.906 16:10:00 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:36.906 16:10:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:36.906 16:10:00 -- common/autotest_common.sh@10 -- # set +x 00:23:36.906 true 00:23:36.906 16:10:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:36.906 16:10:00 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:36.906 16:10:00 -- target/initiator_timeout.sh@54 -- # wait 1640659 00:24:33.176 00:24:33.176 job0: (groupid=0, jobs=1): err= 0: pid=1640733: Mon Nov 18 16:10:54 2024 00:24:33.176 read: IOPS=115, BW=462KiB/s (474kB/s)(27.1MiB/60026msec) 00:24:33.176 slat (usec): min=5, max=8891, avg= 8.89, stdev=106.72 00:24:33.176 clat (usec): min=204, max=41293k, avg=8421.73, stdev=495731.67 00:24:33.176 lat (usec): min=211, max=41293k, avg=8430.62, stdev=495732.02 00:24:33.176 clat percentiles (usec): 00:24:33.176 | 1.00th=[ 215], 5.00th=[ 223], 10.00th=[ 227], 00:24:33.176 | 20.00th=[ 237], 30.00th=[ 247], 40.00th=[ 258], 00:24:33.176 | 50.00th=[ 265], 60.00th=[ 269], 70.00th=[ 277], 00:24:33.176 | 80.00th=[ 281], 90.00th=[ 314], 95.00th=[ 41157], 00:24:33.176 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:24:33.176 | 99.95th=[ 42206], 99.99th=[17112761] 00:24:33.176 write: IOPS=119, BW=478KiB/s (489kB/s)(28.0MiB/60026msec); 0 zone resets 00:24:33.176 slat (usec): min=7, max=30632, avg=12.96, stdev=361.72 00:24:33.176 clat (usec): min=161, max=979, avg=193.97, stdev=16.95 00:24:33.176 lat (usec): min=169, max=30848, avg=206.92, stdev=362.38 00:24:33.176 clat percentiles (usec): 00:24:33.176 | 1.00th=[ 169], 5.00th=[ 174], 10.00th=[ 178], 20.00th=[ 182], 00:24:33.176 | 30.00th=[ 186], 40.00th=[ 190], 50.00th=[ 194], 60.00th=[ 198], 00:24:33.176 | 70.00th=[ 200], 80.00th=[ 204], 90.00th=[ 210], 95.00th=[ 217], 00:24:33.176 | 99.00th=[ 241], 99.50th=[ 245], 99.90th=[ 269], 99.95th=[ 351], 00:24:33.176 | 99.99th=[ 979] 00:24:33.176 bw ( KiB/s): min= 3488, max= 8800, per=100.00%, avg=7168.00, stdev=2100.54, samples=8 00:24:33.176 iops : min= 872, max= 2200, avg=1792.00, stdev=525.14, samples=8 00:24:33.176 lat (usec) : 250=66.61%, 500=30.57%, 750=0.12%, 1000=0.02% 00:24:33.176 lat (msec) : 2=0.02%, 50=2.64%, >=2000=0.01% 00:24:33.176 cpu : usr=0.15%, sys=0.25%, ctx=14111, majf=0, minf=1 00:24:33.176 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:33.176 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:33.176 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:33.176 issued rwts: total=6940,7168,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:33.176 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:33.176 00:24:33.176 Run status group 0 (all jobs): 00:24:33.176 READ: bw=462KiB/s (474kB/s), 462KiB/s-462KiB/s (474kB/s-474kB/s), io=27.1MiB (28.4MB), run=60026-60026msec 00:24:33.176 WRITE: bw=478KiB/s (489kB/s), 478KiB/s-478KiB/s (489kB/s-489kB/s), io=28.0MiB (29.4MB), run=60026-60026msec 00:24:33.176 00:24:33.176 Disk stats (read/write): 00:24:33.176 nvme0n1: ios=6988/7168, merge=0/0, ticks=17895/1324, in_queue=19219, util=99.92% 00:24:33.176 16:10:54 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:33.176 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:33.176 16:10:54 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:33.176 16:10:54 -- common/autotest_common.sh@1208 -- # local i=0 00:24:33.176 16:10:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:33.176 16:10:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:33.176 16:10:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:33.176 16:10:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:33.176 16:10:54 -- common/autotest_common.sh@1220 -- # return 0 00:24:33.176 16:10:54 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:33.176 16:10:54 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:33.176 nvmf hotplug test: fio successful as expected 00:24:33.176 16:10:54 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:33.176 16:10:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:33.176 16:10:54 -- common/autotest_common.sh@10 -- # set +x 00:24:33.176 16:10:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:33.176 16:10:54 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:33.176 16:10:54 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:33.176 16:10:54 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:33.176 16:10:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:33.176 16:10:54 -- nvmf/common.sh@116 -- # sync 00:24:33.176 16:10:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:33.176 16:10:54 -- nvmf/common.sh@119 -- # set +e 00:24:33.176 16:10:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:33.176 16:10:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:33.176 rmmod nvme_tcp 00:24:33.176 rmmod nvme_fabrics 00:24:33.176 rmmod nvme_keyring 00:24:33.176 16:10:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:33.176 16:10:54 -- nvmf/common.sh@123 -- # set -e 00:24:33.176 16:10:54 -- nvmf/common.sh@124 -- # return 0 00:24:33.176 16:10:54 -- nvmf/common.sh@477 -- # '[' -n 1640128 ']' 00:24:33.176 16:10:54 -- nvmf/common.sh@478 -- # killprocess 1640128 00:24:33.176 16:10:54 -- common/autotest_common.sh@936 -- # '[' -z 1640128 ']' 00:24:33.176 16:10:54 -- common/autotest_common.sh@940 -- # kill -0 1640128 00:24:33.176 16:10:54 -- common/autotest_common.sh@941 -- # uname 00:24:33.176 16:10:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:33.176 16:10:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1640128 00:24:33.176 16:10:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:33.176 16:10:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:33.176 16:10:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1640128' 00:24:33.176 killing process with pid 1640128 00:24:33.176 16:10:54 -- common/autotest_common.sh@955 -- # kill 1640128 00:24:33.176 16:10:54 -- common/autotest_common.sh@960 -- # wait 1640128 00:24:33.176 16:10:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:33.176 16:10:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:33.176 16:10:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:33.176 16:10:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:33.176 16:10:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:33.176 16:10:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:33.176 16:10:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:33.176 16:10:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:33.743 16:10:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:33.743 00:24:33.743 real 1m9.181s 00:24:33.743 user 4m13.846s 00:24:33.743 sys 0m6.672s 00:24:33.743 16:10:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:33.743 16:10:57 -- common/autotest_common.sh@10 -- # set +x 00:24:33.743 ************************************ 00:24:33.743 END TEST nvmf_initiator_timeout 00:24:33.743 ************************************ 00:24:33.743 16:10:57 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:33.743 16:10:57 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:33.743 16:10:57 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:33.743 16:10:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:33.743 16:10:57 -- common/autotest_common.sh@10 -- # set +x 00:24:35.644 16:10:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:35.644 16:10:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:35.644 16:10:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:35.644 16:10:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:35.644 16:10:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:35.644 16:10:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:35.644 16:10:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:35.644 16:10:59 -- nvmf/common.sh@294 -- # net_devs=() 00:24:35.644 16:10:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:35.644 16:10:59 -- nvmf/common.sh@295 -- # e810=() 00:24:35.644 16:10:59 -- nvmf/common.sh@295 -- # local -ga e810 00:24:35.644 16:10:59 -- nvmf/common.sh@296 -- # x722=() 00:24:35.644 16:10:59 -- nvmf/common.sh@296 -- # local -ga x722 00:24:35.644 16:10:59 -- nvmf/common.sh@297 -- # mlx=() 00:24:35.644 16:10:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:35.644 16:10:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:35.644 16:10:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:35.644 16:10:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:35.644 16:10:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:35.644 16:10:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:35.644 16:10:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:35.644 16:10:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:35.644 16:10:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:35.644 16:10:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:35.644 16:10:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:35.644 16:10:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:35.644 16:10:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:35.644 16:10:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:35.644 16:10:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:35.644 16:10:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:35.644 16:10:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:35.644 16:10:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:35.644 16:10:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:35.644 16:10:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:35.644 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:35.644 16:10:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:35.644 16:10:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:35.644 16:10:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:35.644 16:10:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:35.644 16:10:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:35.644 16:10:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:35.644 16:10:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:35.644 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:35.644 16:10:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:35.644 16:10:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:35.645 16:10:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:35.645 16:10:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:35.645 16:10:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:35.645 16:10:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:35.645 16:10:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:35.645 16:10:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:35.645 16:10:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:35.645 16:10:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:35.645 16:10:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:35.645 16:10:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:35.645 16:10:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:35.645 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:35.645 16:10:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:35.645 16:10:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:35.645 16:10:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:35.645 16:10:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:35.645 16:10:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:35.645 16:10:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:35.645 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:35.645 16:10:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:35.645 16:10:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:35.645 16:10:59 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:35.645 16:10:59 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:35.645 16:10:59 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:35.645 16:10:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:35.645 16:10:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:35.645 16:10:59 -- common/autotest_common.sh@10 -- # set +x 00:24:35.645 ************************************ 00:24:35.645 START TEST nvmf_perf_adq 00:24:35.645 ************************************ 00:24:35.645 16:10:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:35.903 * Looking for test storage... 00:24:35.903 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:35.903 16:10:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:35.903 16:10:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:35.903 16:10:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:35.903 16:10:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:35.903 16:10:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:35.903 16:10:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:35.903 16:10:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:35.903 16:10:59 -- scripts/common.sh@335 -- # IFS=.-: 00:24:35.903 16:10:59 -- scripts/common.sh@335 -- # read -ra ver1 00:24:35.903 16:10:59 -- scripts/common.sh@336 -- # IFS=.-: 00:24:35.903 16:10:59 -- scripts/common.sh@336 -- # read -ra ver2 00:24:35.903 16:10:59 -- scripts/common.sh@337 -- # local 'op=<' 00:24:35.903 16:10:59 -- scripts/common.sh@339 -- # ver1_l=2 00:24:35.903 16:10:59 -- scripts/common.sh@340 -- # ver2_l=1 00:24:35.903 16:10:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:35.903 16:10:59 -- scripts/common.sh@343 -- # case "$op" in 00:24:35.903 16:10:59 -- scripts/common.sh@344 -- # : 1 00:24:35.903 16:10:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:35.903 16:10:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:35.903 16:10:59 -- scripts/common.sh@364 -- # decimal 1 00:24:35.903 16:10:59 -- scripts/common.sh@352 -- # local d=1 00:24:35.903 16:10:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:35.903 16:10:59 -- scripts/common.sh@354 -- # echo 1 00:24:35.903 16:10:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:35.903 16:10:59 -- scripts/common.sh@365 -- # decimal 2 00:24:35.903 16:10:59 -- scripts/common.sh@352 -- # local d=2 00:24:35.903 16:10:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:35.903 16:10:59 -- scripts/common.sh@354 -- # echo 2 00:24:35.903 16:10:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:35.903 16:10:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:35.903 16:10:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:35.903 16:10:59 -- scripts/common.sh@367 -- # return 0 00:24:35.903 16:10:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:35.903 16:10:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:35.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:35.903 --rc genhtml_branch_coverage=1 00:24:35.903 --rc genhtml_function_coverage=1 00:24:35.903 --rc genhtml_legend=1 00:24:35.903 --rc geninfo_all_blocks=1 00:24:35.903 --rc geninfo_unexecuted_blocks=1 00:24:35.903 00:24:35.903 ' 00:24:35.903 16:10:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:35.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:35.903 --rc genhtml_branch_coverage=1 00:24:35.903 --rc genhtml_function_coverage=1 00:24:35.903 --rc genhtml_legend=1 00:24:35.903 --rc geninfo_all_blocks=1 00:24:35.903 --rc geninfo_unexecuted_blocks=1 00:24:35.903 00:24:35.903 ' 00:24:35.903 16:10:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:35.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:35.903 --rc genhtml_branch_coverage=1 00:24:35.903 --rc genhtml_function_coverage=1 00:24:35.903 --rc genhtml_legend=1 00:24:35.903 --rc geninfo_all_blocks=1 00:24:35.903 --rc geninfo_unexecuted_blocks=1 00:24:35.903 00:24:35.903 ' 00:24:35.903 16:10:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:35.903 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:35.903 --rc genhtml_branch_coverage=1 00:24:35.903 --rc genhtml_function_coverage=1 00:24:35.903 --rc genhtml_legend=1 00:24:35.903 --rc geninfo_all_blocks=1 00:24:35.903 --rc geninfo_unexecuted_blocks=1 00:24:35.903 00:24:35.903 ' 00:24:35.903 16:10:59 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:35.903 16:10:59 -- nvmf/common.sh@7 -- # uname -s 00:24:35.903 16:10:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:35.903 16:10:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:35.903 16:10:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:35.903 16:10:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:35.903 16:10:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:35.903 16:10:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:35.903 16:10:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:35.903 16:10:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:35.903 16:10:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:35.903 16:10:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:35.903 16:10:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:35.903 16:10:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:35.903 16:10:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:35.903 16:10:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:35.903 16:10:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:35.903 16:10:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:35.903 16:10:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:35.903 16:10:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:35.903 16:10:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:35.903 16:10:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:35.903 16:10:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:35.903 16:10:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:35.903 16:10:59 -- paths/export.sh@5 -- # export PATH 00:24:35.903 16:10:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:35.903 16:10:59 -- nvmf/common.sh@46 -- # : 0 00:24:35.903 16:10:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:35.903 16:10:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:35.903 16:10:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:35.903 16:10:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:35.903 16:10:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:35.903 16:10:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:35.903 16:10:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:35.903 16:10:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:35.903 16:10:59 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:35.903 16:10:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:35.903 16:10:59 -- common/autotest_common.sh@10 -- # set +x 00:24:38.436 16:11:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:38.436 16:11:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:38.436 16:11:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:38.436 16:11:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:38.436 16:11:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:38.436 16:11:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:38.436 16:11:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:38.436 16:11:01 -- nvmf/common.sh@294 -- # net_devs=() 00:24:38.436 16:11:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:38.436 16:11:01 -- nvmf/common.sh@295 -- # e810=() 00:24:38.436 16:11:01 -- nvmf/common.sh@295 -- # local -ga e810 00:24:38.436 16:11:01 -- nvmf/common.sh@296 -- # x722=() 00:24:38.436 16:11:01 -- nvmf/common.sh@296 -- # local -ga x722 00:24:38.436 16:11:01 -- nvmf/common.sh@297 -- # mlx=() 00:24:38.436 16:11:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:38.436 16:11:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:38.436 16:11:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:38.436 16:11:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:38.436 16:11:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:38.436 16:11:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:38.436 16:11:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:38.436 16:11:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:38.436 16:11:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:38.436 16:11:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:38.436 16:11:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:38.436 16:11:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:38.436 16:11:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:38.436 16:11:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:38.436 16:11:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:38.436 16:11:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:38.436 16:11:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:38.436 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:38.436 16:11:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:38.436 16:11:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:38.436 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:38.436 16:11:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:38.436 16:11:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:38.436 16:11:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:38.436 16:11:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:38.436 16:11:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:38.436 16:11:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:38.436 16:11:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:38.436 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:38.436 16:11:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:38.436 16:11:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:38.436 16:11:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:38.436 16:11:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:38.436 16:11:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:38.436 16:11:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:38.436 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:38.436 16:11:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:38.436 16:11:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:38.436 16:11:01 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:38.436 16:11:01 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:38.436 16:11:01 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:38.436 16:11:01 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:38.436 16:11:01 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:38.695 16:11:02 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:41.227 16:11:04 -- target/perf_adq.sh@54 -- # sleep 5 00:24:46.508 16:11:09 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:46.508 16:11:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:46.508 16:11:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:46.508 16:11:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:46.508 16:11:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:46.508 16:11:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:46.508 16:11:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:46.508 16:11:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:46.508 16:11:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:46.508 16:11:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:46.508 16:11:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:46.508 16:11:09 -- common/autotest_common.sh@10 -- # set +x 00:24:46.508 16:11:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:46.508 16:11:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:46.508 16:11:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:46.508 16:11:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:46.508 16:11:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:46.508 16:11:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:46.508 16:11:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:46.508 16:11:09 -- nvmf/common.sh@294 -- # net_devs=() 00:24:46.508 16:11:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:46.508 16:11:09 -- nvmf/common.sh@295 -- # e810=() 00:24:46.508 16:11:09 -- nvmf/common.sh@295 -- # local -ga e810 00:24:46.508 16:11:09 -- nvmf/common.sh@296 -- # x722=() 00:24:46.508 16:11:09 -- nvmf/common.sh@296 -- # local -ga x722 00:24:46.508 16:11:09 -- nvmf/common.sh@297 -- # mlx=() 00:24:46.508 16:11:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:46.508 16:11:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:46.508 16:11:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:46.508 16:11:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:46.508 16:11:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:46.508 16:11:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:46.508 16:11:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:46.508 16:11:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:46.508 16:11:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:46.508 16:11:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:46.508 16:11:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:46.508 16:11:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:46.508 16:11:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:46.508 16:11:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:46.508 16:11:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:46.508 16:11:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:46.508 16:11:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:46.508 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:46.508 16:11:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:46.508 16:11:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:46.508 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:46.508 16:11:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:46.508 16:11:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:46.508 16:11:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:46.508 16:11:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:46.508 16:11:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:46.508 16:11:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:46.508 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:46.508 16:11:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:46.508 16:11:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:46.508 16:11:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:46.508 16:11:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:46.508 16:11:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:46.508 16:11:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:46.508 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:46.508 16:11:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:46.508 16:11:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:46.508 16:11:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:46.508 16:11:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:46.508 16:11:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:46.508 16:11:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:46.508 16:11:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:46.508 16:11:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:46.508 16:11:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:46.508 16:11:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:46.508 16:11:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:46.508 16:11:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:46.508 16:11:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:46.509 16:11:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:46.509 16:11:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:46.509 16:11:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:46.509 16:11:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:46.509 16:11:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:46.509 16:11:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:46.509 16:11:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:46.509 16:11:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:46.509 16:11:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:46.509 16:11:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:46.509 16:11:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:46.509 16:11:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:46.509 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:46.509 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:24:46.509 00:24:46.509 --- 10.0.0.2 ping statistics --- 00:24:46.509 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:46.509 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:24:46.509 16:11:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:46.509 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:46.509 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:24:46.509 00:24:46.509 --- 10.0.0.1 ping statistics --- 00:24:46.509 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:46.509 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:24:46.509 16:11:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:46.509 16:11:09 -- nvmf/common.sh@410 -- # return 0 00:24:46.509 16:11:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:46.509 16:11:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:46.509 16:11:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:46.509 16:11:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:46.509 16:11:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:46.509 16:11:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:46.509 16:11:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:46.509 16:11:09 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:46.509 16:11:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:46.509 16:11:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:46.509 16:11:09 -- common/autotest_common.sh@10 -- # set +x 00:24:46.509 16:11:09 -- nvmf/common.sh@469 -- # nvmfpid=1652656 00:24:46.509 16:11:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:46.509 16:11:09 -- nvmf/common.sh@470 -- # waitforlisten 1652656 00:24:46.509 16:11:09 -- common/autotest_common.sh@829 -- # '[' -z 1652656 ']' 00:24:46.509 16:11:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:46.509 16:11:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:46.509 16:11:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:46.509 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:46.509 16:11:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:46.509 16:11:09 -- common/autotest_common.sh@10 -- # set +x 00:24:46.509 [2024-11-18 16:11:09.709228] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:46.509 [2024-11-18 16:11:09.709304] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:46.509 EAL: No free 2048 kB hugepages reported on node 1 00:24:46.509 [2024-11-18 16:11:09.775033] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:46.509 [2024-11-18 16:11:09.864310] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:46.509 [2024-11-18 16:11:09.864453] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:46.509 [2024-11-18 16:11:09.864469] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:46.509 [2024-11-18 16:11:09.864482] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:46.509 [2024-11-18 16:11:09.864552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:46.509 [2024-11-18 16:11:09.864643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:46.509 [2024-11-18 16:11:09.864578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:46.509 [2024-11-18 16:11:09.864646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:46.509 16:11:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:46.509 16:11:09 -- common/autotest_common.sh@862 -- # return 0 00:24:46.509 16:11:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:46.509 16:11:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:46.509 16:11:09 -- common/autotest_common.sh@10 -- # set +x 00:24:46.509 16:11:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:46.509 16:11:09 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:46.509 16:11:09 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:46.509 16:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:46.509 16:11:09 -- common/autotest_common.sh@10 -- # set +x 00:24:46.509 16:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:46.509 16:11:09 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:46.509 16:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:46.509 16:11:09 -- common/autotest_common.sh@10 -- # set +x 00:24:46.509 16:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:46.509 16:11:10 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:46.509 16:11:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:46.509 16:11:10 -- common/autotest_common.sh@10 -- # set +x 00:24:46.509 [2024-11-18 16:11:10.086156] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:46.509 16:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:46.509 16:11:10 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:46.509 16:11:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:46.509 16:11:10 -- common/autotest_common.sh@10 -- # set +x 00:24:46.767 Malloc1 00:24:46.767 16:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:46.767 16:11:10 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:46.767 16:11:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:46.767 16:11:10 -- common/autotest_common.sh@10 -- # set +x 00:24:46.767 16:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:46.767 16:11:10 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:46.767 16:11:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:46.767 16:11:10 -- common/autotest_common.sh@10 -- # set +x 00:24:46.767 16:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:46.767 16:11:10 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:46.767 16:11:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:46.767 16:11:10 -- common/autotest_common.sh@10 -- # set +x 00:24:46.767 [2024-11-18 16:11:10.137684] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:46.767 16:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:46.767 16:11:10 -- target/perf_adq.sh@73 -- # perfpid=1652691 00:24:46.767 16:11:10 -- target/perf_adq.sh@74 -- # sleep 2 00:24:46.767 16:11:10 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:46.767 EAL: No free 2048 kB hugepages reported on node 1 00:24:48.666 16:11:12 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:48.666 16:11:12 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:48.666 16:11:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:48.666 16:11:12 -- common/autotest_common.sh@10 -- # set +x 00:24:48.666 16:11:12 -- target/perf_adq.sh@76 -- # wc -l 00:24:48.666 16:11:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:48.666 16:11:12 -- target/perf_adq.sh@76 -- # count=4 00:24:48.666 16:11:12 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:48.666 16:11:12 -- target/perf_adq.sh@81 -- # wait 1652691 00:24:56.774 Initializing NVMe Controllers 00:24:56.774 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:56.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:56.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:56.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:56.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:56.774 Initialization complete. Launching workers. 00:24:56.774 ======================================================== 00:24:56.774 Latency(us) 00:24:56.774 Device Information : IOPS MiB/s Average min max 00:24:56.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11129.26 43.47 5751.55 1434.73 9358.86 00:24:56.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11453.66 44.74 5588.08 1853.51 10109.84 00:24:56.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11230.26 43.87 5700.25 1529.28 10000.02 00:24:56.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10950.27 42.77 5845.27 2462.36 9436.37 00:24:56.774 ======================================================== 00:24:56.774 Total : 44763.45 174.86 5719.78 1434.73 10109.84 00:24:56.774 00:24:56.774 16:11:20 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:56.774 16:11:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:56.774 16:11:20 -- nvmf/common.sh@116 -- # sync 00:24:56.774 16:11:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:56.774 16:11:20 -- nvmf/common.sh@119 -- # set +e 00:24:56.774 16:11:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:56.774 16:11:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:56.774 rmmod nvme_tcp 00:24:56.774 rmmod nvme_fabrics 00:24:56.774 rmmod nvme_keyring 00:24:56.774 16:11:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:56.774 16:11:20 -- nvmf/common.sh@123 -- # set -e 00:24:56.774 16:11:20 -- nvmf/common.sh@124 -- # return 0 00:24:56.774 16:11:20 -- nvmf/common.sh@477 -- # '[' -n 1652656 ']' 00:24:56.774 16:11:20 -- nvmf/common.sh@478 -- # killprocess 1652656 00:24:56.774 16:11:20 -- common/autotest_common.sh@936 -- # '[' -z 1652656 ']' 00:24:56.774 16:11:20 -- common/autotest_common.sh@940 -- # kill -0 1652656 00:24:56.774 16:11:20 -- common/autotest_common.sh@941 -- # uname 00:24:56.774 16:11:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:56.774 16:11:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1652656 00:24:57.032 16:11:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:57.032 16:11:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:57.032 16:11:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1652656' 00:24:57.032 killing process with pid 1652656 00:24:57.032 16:11:20 -- common/autotest_common.sh@955 -- # kill 1652656 00:24:57.032 16:11:20 -- common/autotest_common.sh@960 -- # wait 1652656 00:24:57.032 16:11:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:57.032 16:11:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:57.032 16:11:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:57.032 16:11:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:57.032 16:11:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:57.032 16:11:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:57.032 16:11:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:57.032 16:11:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:59.561 16:11:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:59.561 16:11:22 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:59.561 16:11:22 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:59.820 16:11:23 -- target/perf_adq.sh@53 -- # modprobe ice 00:25:02.347 16:11:25 -- target/perf_adq.sh@54 -- # sleep 5 00:25:07.607 16:11:30 -- target/perf_adq.sh@87 -- # nvmftestinit 00:25:07.607 16:11:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:07.607 16:11:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:07.607 16:11:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:07.607 16:11:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:07.607 16:11:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:07.607 16:11:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:07.607 16:11:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:07.607 16:11:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:07.607 16:11:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:07.607 16:11:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:07.607 16:11:30 -- common/autotest_common.sh@10 -- # set +x 00:25:07.607 16:11:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:07.607 16:11:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:07.607 16:11:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:07.607 16:11:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:07.607 16:11:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:07.607 16:11:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:07.607 16:11:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:07.607 16:11:30 -- nvmf/common.sh@294 -- # net_devs=() 00:25:07.607 16:11:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:07.607 16:11:30 -- nvmf/common.sh@295 -- # e810=() 00:25:07.607 16:11:30 -- nvmf/common.sh@295 -- # local -ga e810 00:25:07.607 16:11:30 -- nvmf/common.sh@296 -- # x722=() 00:25:07.607 16:11:30 -- nvmf/common.sh@296 -- # local -ga x722 00:25:07.607 16:11:30 -- nvmf/common.sh@297 -- # mlx=() 00:25:07.607 16:11:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:07.607 16:11:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:07.607 16:11:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:07.607 16:11:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:07.607 16:11:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:07.607 16:11:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:07.607 16:11:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:07.607 16:11:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:07.607 16:11:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:07.607 16:11:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:07.607 16:11:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:07.607 16:11:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:07.607 16:11:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:07.607 16:11:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:07.607 16:11:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:07.607 16:11:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:07.607 16:11:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:07.607 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:07.607 16:11:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:07.607 16:11:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:07.607 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:07.607 16:11:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:07.607 16:11:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:07.607 16:11:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:07.607 16:11:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:07.607 16:11:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:07.607 16:11:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:07.607 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:07.607 16:11:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:07.607 16:11:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:07.607 16:11:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:07.607 16:11:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:07.607 16:11:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:07.607 16:11:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:07.607 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:07.607 16:11:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:07.607 16:11:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:07.607 16:11:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:07.607 16:11:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:07.607 16:11:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:07.607 16:11:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:07.608 16:11:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:07.608 16:11:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:07.608 16:11:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:07.608 16:11:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:07.608 16:11:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:07.608 16:11:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:07.608 16:11:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:07.608 16:11:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:07.608 16:11:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:07.608 16:11:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:07.608 16:11:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:07.608 16:11:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:07.608 16:11:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:07.608 16:11:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:07.608 16:11:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:07.608 16:11:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:07.608 16:11:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:07.608 16:11:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:07.608 16:11:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:07.608 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:07.608 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:25:07.608 00:25:07.608 --- 10.0.0.2 ping statistics --- 00:25:07.608 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:07.608 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:25:07.608 16:11:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:07.608 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:07.608 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:25:07.608 00:25:07.608 --- 10.0.0.1 ping statistics --- 00:25:07.608 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:07.608 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:25:07.608 16:11:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:07.608 16:11:30 -- nvmf/common.sh@410 -- # return 0 00:25:07.608 16:11:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:07.608 16:11:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:07.608 16:11:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:07.608 16:11:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:07.608 16:11:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:07.608 16:11:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:07.608 16:11:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:07.608 16:11:30 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:25:07.608 16:11:30 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:25:07.608 16:11:30 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:25:07.608 16:11:30 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:25:07.608 net.core.busy_poll = 1 00:25:07.608 16:11:30 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:25:07.608 net.core.busy_read = 1 00:25:07.608 16:11:30 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:25:07.608 16:11:30 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:25:07.608 16:11:30 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:25:07.608 16:11:30 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:25:07.608 16:11:30 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:25:07.608 16:11:30 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:25:07.608 16:11:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:07.608 16:11:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:07.608 16:11:30 -- common/autotest_common.sh@10 -- # set +x 00:25:07.608 16:11:30 -- nvmf/common.sh@469 -- # nvmfpid=1655381 00:25:07.608 16:11:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:25:07.608 16:11:30 -- nvmf/common.sh@470 -- # waitforlisten 1655381 00:25:07.608 16:11:30 -- common/autotest_common.sh@829 -- # '[' -z 1655381 ']' 00:25:07.608 16:11:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:07.608 16:11:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:07.608 16:11:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:07.608 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:07.608 16:11:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:07.608 16:11:30 -- common/autotest_common.sh@10 -- # set +x 00:25:07.608 [2024-11-18 16:11:30.947800] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:07.608 [2024-11-18 16:11:30.947882] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:07.608 EAL: No free 2048 kB hugepages reported on node 1 00:25:07.608 [2024-11-18 16:11:31.015569] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:07.608 [2024-11-18 16:11:31.101255] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:07.608 [2024-11-18 16:11:31.101400] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:07.608 [2024-11-18 16:11:31.101417] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:07.608 [2024-11-18 16:11:31.101429] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:07.608 [2024-11-18 16:11:31.101478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:07.608 [2024-11-18 16:11:31.101538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:07.608 [2024-11-18 16:11:31.101603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:07.608 [2024-11-18 16:11:31.101612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:07.608 16:11:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:07.608 16:11:31 -- common/autotest_common.sh@862 -- # return 0 00:25:07.608 16:11:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:07.608 16:11:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:07.608 16:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:07.608 16:11:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:07.608 16:11:31 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:25:07.608 16:11:31 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:25:07.608 16:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.608 16:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:07.866 16:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.866 16:11:31 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:25:07.866 16:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.866 16:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:07.866 16:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.866 16:11:31 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:25:07.866 16:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.866 16:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:07.866 [2024-11-18 16:11:31.306126] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:07.866 16:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.866 16:11:31 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:07.866 16:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.866 16:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:07.866 Malloc1 00:25:07.866 16:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.866 16:11:31 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:07.866 16:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.866 16:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:07.866 16:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.866 16:11:31 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:07.866 16:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.866 16:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:07.866 16:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.866 16:11:31 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:07.866 16:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.866 16:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:07.866 [2024-11-18 16:11:31.357193] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:07.866 16:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.866 16:11:31 -- target/perf_adq.sh@94 -- # perfpid=1655528 00:25:07.866 16:11:31 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:25:07.866 16:11:31 -- target/perf_adq.sh@95 -- # sleep 2 00:25:07.866 EAL: No free 2048 kB hugepages reported on node 1 00:25:10.392 16:11:33 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:25:10.392 16:11:33 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:25:10.392 16:11:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:10.392 16:11:33 -- target/perf_adq.sh@97 -- # wc -l 00:25:10.392 16:11:33 -- common/autotest_common.sh@10 -- # set +x 00:25:10.392 16:11:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.392 16:11:33 -- target/perf_adq.sh@97 -- # count=2 00:25:10.392 16:11:33 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:25:10.392 16:11:33 -- target/perf_adq.sh@103 -- # wait 1655528 00:25:18.507 Initializing NVMe Controllers 00:25:18.507 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:18.507 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:18.507 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:18.507 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:18.507 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:18.507 Initialization complete. Launching workers. 00:25:18.507 ======================================================== 00:25:18.507 Latency(us) 00:25:18.507 Device Information : IOPS MiB/s Average min max 00:25:18.507 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 8014.60 31.31 7986.24 1252.21 53836.31 00:25:18.507 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 6864.90 26.82 9351.81 1735.27 52291.98 00:25:18.507 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7041.00 27.50 9091.34 1461.81 52478.88 00:25:18.507 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 5854.30 22.87 10933.54 1274.13 52829.33 00:25:18.507 ======================================================== 00:25:18.507 Total : 27774.79 108.50 9225.13 1252.21 53836.31 00:25:18.507 00:25:18.507 16:11:41 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:18.507 16:11:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:18.507 16:11:41 -- nvmf/common.sh@116 -- # sync 00:25:18.507 16:11:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:18.507 16:11:41 -- nvmf/common.sh@119 -- # set +e 00:25:18.507 16:11:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:18.507 16:11:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:18.507 rmmod nvme_tcp 00:25:18.507 rmmod nvme_fabrics 00:25:18.507 rmmod nvme_keyring 00:25:18.507 16:11:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:18.507 16:11:41 -- nvmf/common.sh@123 -- # set -e 00:25:18.507 16:11:41 -- nvmf/common.sh@124 -- # return 0 00:25:18.507 16:11:41 -- nvmf/common.sh@477 -- # '[' -n 1655381 ']' 00:25:18.507 16:11:41 -- nvmf/common.sh@478 -- # killprocess 1655381 00:25:18.507 16:11:41 -- common/autotest_common.sh@936 -- # '[' -z 1655381 ']' 00:25:18.507 16:11:41 -- common/autotest_common.sh@940 -- # kill -0 1655381 00:25:18.507 16:11:41 -- common/autotest_common.sh@941 -- # uname 00:25:18.507 16:11:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:18.507 16:11:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1655381 00:25:18.507 16:11:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:18.507 16:11:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:18.507 16:11:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1655381' 00:25:18.507 killing process with pid 1655381 00:25:18.507 16:11:41 -- common/autotest_common.sh@955 -- # kill 1655381 00:25:18.507 16:11:41 -- common/autotest_common.sh@960 -- # wait 1655381 00:25:18.507 16:11:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:18.507 16:11:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:18.507 16:11:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:18.507 16:11:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:18.507 16:11:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:18.507 16:11:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:18.507 16:11:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:18.507 16:11:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:20.408 16:11:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:20.408 16:11:43 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:20.408 00:25:20.408 real 0m44.770s 00:25:20.408 user 2m39.609s 00:25:20.408 sys 0m9.624s 00:25:20.408 16:11:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:20.408 16:11:43 -- common/autotest_common.sh@10 -- # set +x 00:25:20.408 ************************************ 00:25:20.408 END TEST nvmf_perf_adq 00:25:20.408 ************************************ 00:25:20.666 16:11:44 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:20.666 16:11:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:20.666 16:11:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:20.666 16:11:44 -- common/autotest_common.sh@10 -- # set +x 00:25:20.666 ************************************ 00:25:20.666 START TEST nvmf_shutdown 00:25:20.666 ************************************ 00:25:20.666 16:11:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:20.666 * Looking for test storage... 00:25:20.666 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:20.666 16:11:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:20.666 16:11:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:20.666 16:11:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:20.666 16:11:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:20.666 16:11:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:20.666 16:11:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:20.666 16:11:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:20.666 16:11:44 -- scripts/common.sh@335 -- # IFS=.-: 00:25:20.666 16:11:44 -- scripts/common.sh@335 -- # read -ra ver1 00:25:20.666 16:11:44 -- scripts/common.sh@336 -- # IFS=.-: 00:25:20.666 16:11:44 -- scripts/common.sh@336 -- # read -ra ver2 00:25:20.666 16:11:44 -- scripts/common.sh@337 -- # local 'op=<' 00:25:20.666 16:11:44 -- scripts/common.sh@339 -- # ver1_l=2 00:25:20.666 16:11:44 -- scripts/common.sh@340 -- # ver2_l=1 00:25:20.666 16:11:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:20.666 16:11:44 -- scripts/common.sh@343 -- # case "$op" in 00:25:20.666 16:11:44 -- scripts/common.sh@344 -- # : 1 00:25:20.666 16:11:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:20.666 16:11:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:20.666 16:11:44 -- scripts/common.sh@364 -- # decimal 1 00:25:20.666 16:11:44 -- scripts/common.sh@352 -- # local d=1 00:25:20.666 16:11:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:20.666 16:11:44 -- scripts/common.sh@354 -- # echo 1 00:25:20.666 16:11:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:20.666 16:11:44 -- scripts/common.sh@365 -- # decimal 2 00:25:20.666 16:11:44 -- scripts/common.sh@352 -- # local d=2 00:25:20.666 16:11:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:20.666 16:11:44 -- scripts/common.sh@354 -- # echo 2 00:25:20.666 16:11:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:20.666 16:11:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:20.666 16:11:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:20.666 16:11:44 -- scripts/common.sh@367 -- # return 0 00:25:20.666 16:11:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:20.666 16:11:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:20.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:20.666 --rc genhtml_branch_coverage=1 00:25:20.666 --rc genhtml_function_coverage=1 00:25:20.666 --rc genhtml_legend=1 00:25:20.666 --rc geninfo_all_blocks=1 00:25:20.666 --rc geninfo_unexecuted_blocks=1 00:25:20.666 00:25:20.666 ' 00:25:20.666 16:11:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:20.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:20.666 --rc genhtml_branch_coverage=1 00:25:20.666 --rc genhtml_function_coverage=1 00:25:20.666 --rc genhtml_legend=1 00:25:20.666 --rc geninfo_all_blocks=1 00:25:20.666 --rc geninfo_unexecuted_blocks=1 00:25:20.666 00:25:20.666 ' 00:25:20.666 16:11:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:20.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:20.666 --rc genhtml_branch_coverage=1 00:25:20.666 --rc genhtml_function_coverage=1 00:25:20.666 --rc genhtml_legend=1 00:25:20.667 --rc geninfo_all_blocks=1 00:25:20.667 --rc geninfo_unexecuted_blocks=1 00:25:20.667 00:25:20.667 ' 00:25:20.667 16:11:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:20.667 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:20.667 --rc genhtml_branch_coverage=1 00:25:20.667 --rc genhtml_function_coverage=1 00:25:20.667 --rc genhtml_legend=1 00:25:20.667 --rc geninfo_all_blocks=1 00:25:20.667 --rc geninfo_unexecuted_blocks=1 00:25:20.667 00:25:20.667 ' 00:25:20.667 16:11:44 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:20.667 16:11:44 -- nvmf/common.sh@7 -- # uname -s 00:25:20.667 16:11:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:20.667 16:11:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:20.667 16:11:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:20.667 16:11:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:20.667 16:11:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:20.667 16:11:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:20.667 16:11:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:20.667 16:11:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:20.667 16:11:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:20.667 16:11:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:20.667 16:11:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:20.667 16:11:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:20.667 16:11:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:20.667 16:11:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:20.667 16:11:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:20.667 16:11:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:20.667 16:11:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:20.667 16:11:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:20.667 16:11:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:20.667 16:11:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.667 16:11:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.667 16:11:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.667 16:11:44 -- paths/export.sh@5 -- # export PATH 00:25:20.667 16:11:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.667 16:11:44 -- nvmf/common.sh@46 -- # : 0 00:25:20.667 16:11:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:20.667 16:11:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:20.667 16:11:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:20.667 16:11:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:20.667 16:11:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:20.667 16:11:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:20.667 16:11:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:20.667 16:11:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:20.667 16:11:44 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:20.667 16:11:44 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:20.667 16:11:44 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:20.667 16:11:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:20.667 16:11:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:20.667 16:11:44 -- common/autotest_common.sh@10 -- # set +x 00:25:20.667 ************************************ 00:25:20.667 START TEST nvmf_shutdown_tc1 00:25:20.667 ************************************ 00:25:20.667 16:11:44 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:25:20.667 16:11:44 -- target/shutdown.sh@74 -- # starttarget 00:25:20.667 16:11:44 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:20.667 16:11:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:20.667 16:11:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:20.667 16:11:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:20.667 16:11:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:20.667 16:11:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:20.667 16:11:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:20.667 16:11:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:20.667 16:11:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:20.667 16:11:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:20.667 16:11:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:20.667 16:11:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:20.667 16:11:44 -- common/autotest_common.sh@10 -- # set +x 00:25:23.219 16:11:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:23.219 16:11:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:23.219 16:11:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:23.219 16:11:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:23.219 16:11:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:23.219 16:11:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:23.219 16:11:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:23.219 16:11:46 -- nvmf/common.sh@294 -- # net_devs=() 00:25:23.219 16:11:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:23.219 16:11:46 -- nvmf/common.sh@295 -- # e810=() 00:25:23.219 16:11:46 -- nvmf/common.sh@295 -- # local -ga e810 00:25:23.219 16:11:46 -- nvmf/common.sh@296 -- # x722=() 00:25:23.219 16:11:46 -- nvmf/common.sh@296 -- # local -ga x722 00:25:23.219 16:11:46 -- nvmf/common.sh@297 -- # mlx=() 00:25:23.219 16:11:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:23.219 16:11:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:23.219 16:11:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:23.219 16:11:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:23.219 16:11:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:23.219 16:11:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:23.219 16:11:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:23.219 16:11:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:23.219 16:11:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:23.219 16:11:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:23.219 16:11:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:23.219 16:11:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:23.219 16:11:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:23.219 16:11:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:23.219 16:11:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:23.219 16:11:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:23.219 16:11:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:23.219 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:23.219 16:11:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:23.219 16:11:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:23.219 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:23.219 16:11:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:23.219 16:11:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:23.219 16:11:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:23.219 16:11:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:23.219 16:11:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:23.219 16:11:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:23.219 16:11:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:23.219 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:23.219 16:11:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:23.219 16:11:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:23.219 16:11:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:23.219 16:11:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:23.219 16:11:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:23.219 16:11:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:23.219 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:23.219 16:11:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:23.219 16:11:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:23.220 16:11:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:23.220 16:11:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:23.220 16:11:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:23.220 16:11:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:23.220 16:11:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:23.220 16:11:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:23.220 16:11:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:23.220 16:11:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:23.220 16:11:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:23.220 16:11:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:23.220 16:11:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:23.220 16:11:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:23.220 16:11:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:23.220 16:11:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:23.220 16:11:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:23.220 16:11:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:23.220 16:11:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:23.220 16:11:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:23.220 16:11:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:23.220 16:11:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:23.220 16:11:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:23.220 16:11:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:23.220 16:11:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:23.220 16:11:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:23.220 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:23.220 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.386 ms 00:25:23.220 00:25:23.220 --- 10.0.0.2 ping statistics --- 00:25:23.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:23.220 rtt min/avg/max/mdev = 0.386/0.386/0.386/0.000 ms 00:25:23.220 16:11:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:23.220 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:23.220 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:25:23.220 00:25:23.220 --- 10.0.0.1 ping statistics --- 00:25:23.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:23.220 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:25:23.220 16:11:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:23.220 16:11:46 -- nvmf/common.sh@410 -- # return 0 00:25:23.220 16:11:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:23.220 16:11:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:23.220 16:11:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:23.220 16:11:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:23.220 16:11:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:23.220 16:11:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:23.220 16:11:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:23.220 16:11:46 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:23.220 16:11:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:23.220 16:11:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:23.220 16:11:46 -- common/autotest_common.sh@10 -- # set +x 00:25:23.220 16:11:46 -- nvmf/common.sh@469 -- # nvmfpid=1658740 00:25:23.220 16:11:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:23.220 16:11:46 -- nvmf/common.sh@470 -- # waitforlisten 1658740 00:25:23.220 16:11:46 -- common/autotest_common.sh@829 -- # '[' -z 1658740 ']' 00:25:23.220 16:11:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:23.220 16:11:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:23.220 16:11:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:23.220 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:23.220 16:11:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:23.220 16:11:46 -- common/autotest_common.sh@10 -- # set +x 00:25:23.220 [2024-11-18 16:11:46.502573] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:23.220 [2024-11-18 16:11:46.502688] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:23.220 EAL: No free 2048 kB hugepages reported on node 1 00:25:23.220 [2024-11-18 16:11:46.569244] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:23.220 [2024-11-18 16:11:46.653106] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:23.220 [2024-11-18 16:11:46.653265] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:23.220 [2024-11-18 16:11:46.653291] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:23.220 [2024-11-18 16:11:46.653311] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:23.220 [2024-11-18 16:11:46.653389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:23.220 [2024-11-18 16:11:46.653435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:23.220 [2024-11-18 16:11:46.653467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:23.220 [2024-11-18 16:11:46.653472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:24.207 16:11:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:24.207 16:11:47 -- common/autotest_common.sh@862 -- # return 0 00:25:24.207 16:11:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:24.207 16:11:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:24.207 16:11:47 -- common/autotest_common.sh@10 -- # set +x 00:25:24.207 16:11:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:24.207 16:11:47 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:24.207 16:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:24.207 16:11:47 -- common/autotest_common.sh@10 -- # set +x 00:25:24.207 [2024-11-18 16:11:47.532391] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:24.207 16:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:24.207 16:11:47 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:24.207 16:11:47 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:24.207 16:11:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:24.207 16:11:47 -- common/autotest_common.sh@10 -- # set +x 00:25:24.207 16:11:47 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:24.207 16:11:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:24.207 16:11:47 -- target/shutdown.sh@28 -- # cat 00:25:24.207 16:11:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:24.207 16:11:47 -- target/shutdown.sh@28 -- # cat 00:25:24.207 16:11:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:24.207 16:11:47 -- target/shutdown.sh@28 -- # cat 00:25:24.207 16:11:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:24.207 16:11:47 -- target/shutdown.sh@28 -- # cat 00:25:24.207 16:11:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:24.207 16:11:47 -- target/shutdown.sh@28 -- # cat 00:25:24.207 16:11:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:24.207 16:11:47 -- target/shutdown.sh@28 -- # cat 00:25:24.207 16:11:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:24.207 16:11:47 -- target/shutdown.sh@28 -- # cat 00:25:24.207 16:11:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:24.207 16:11:47 -- target/shutdown.sh@28 -- # cat 00:25:24.207 16:11:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:24.207 16:11:47 -- target/shutdown.sh@28 -- # cat 00:25:24.207 16:11:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:24.207 16:11:47 -- target/shutdown.sh@28 -- # cat 00:25:24.207 16:11:47 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:24.207 16:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:24.207 16:11:47 -- common/autotest_common.sh@10 -- # set +x 00:25:24.207 Malloc1 00:25:24.207 [2024-11-18 16:11:47.608526] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:24.207 Malloc2 00:25:24.207 Malloc3 00:25:24.207 Malloc4 00:25:24.207 Malloc5 00:25:24.465 Malloc6 00:25:24.465 Malloc7 00:25:24.465 Malloc8 00:25:24.465 Malloc9 00:25:24.465 Malloc10 00:25:24.724 16:11:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:24.724 16:11:48 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:24.724 16:11:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:24.724 16:11:48 -- common/autotest_common.sh@10 -- # set +x 00:25:24.724 16:11:48 -- target/shutdown.sh@78 -- # perfpid=1658991 00:25:24.724 16:11:48 -- target/shutdown.sh@79 -- # waitforlisten 1658991 /var/tmp/bdevperf.sock 00:25:24.724 16:11:48 -- common/autotest_common.sh@829 -- # '[' -z 1658991 ']' 00:25:24.724 16:11:48 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:24.724 16:11:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:24.724 16:11:48 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:24.724 16:11:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:24.724 16:11:48 -- nvmf/common.sh@520 -- # config=() 00:25:24.724 16:11:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:24.724 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:24.724 16:11:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:24.724 16:11:48 -- nvmf/common.sh@520 -- # local subsystem config 00:25:24.724 16:11:48 -- common/autotest_common.sh@10 -- # set +x 00:25:24.724 16:11:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:24.724 16:11:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:24.724 { 00:25:24.724 "params": { 00:25:24.724 "name": "Nvme$subsystem", 00:25:24.724 "trtype": "$TEST_TRANSPORT", 00:25:24.724 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:24.724 "adrfam": "ipv4", 00:25:24.724 "trsvcid": "$NVMF_PORT", 00:25:24.724 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:24.724 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:24.724 "hdgst": ${hdgst:-false}, 00:25:24.724 "ddgst": ${ddgst:-false} 00:25:24.724 }, 00:25:24.724 "method": "bdev_nvme_attach_controller" 00:25:24.724 } 00:25:24.724 EOF 00:25:24.724 )") 00:25:24.724 16:11:48 -- nvmf/common.sh@542 -- # cat 00:25:24.724 16:11:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:24.724 16:11:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:24.724 { 00:25:24.724 "params": { 00:25:24.724 "name": "Nvme$subsystem", 00:25:24.724 "trtype": "$TEST_TRANSPORT", 00:25:24.724 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:24.724 "adrfam": "ipv4", 00:25:24.724 "trsvcid": "$NVMF_PORT", 00:25:24.724 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:24.724 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:24.724 "hdgst": ${hdgst:-false}, 00:25:24.724 "ddgst": ${ddgst:-false} 00:25:24.724 }, 00:25:24.724 "method": "bdev_nvme_attach_controller" 00:25:24.724 } 00:25:24.724 EOF 00:25:24.724 )") 00:25:24.724 16:11:48 -- nvmf/common.sh@542 -- # cat 00:25:24.724 16:11:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:24.724 16:11:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:24.724 { 00:25:24.724 "params": { 00:25:24.724 "name": "Nvme$subsystem", 00:25:24.724 "trtype": "$TEST_TRANSPORT", 00:25:24.724 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:24.724 "adrfam": "ipv4", 00:25:24.724 "trsvcid": "$NVMF_PORT", 00:25:24.724 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:24.724 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:24.724 "hdgst": ${hdgst:-false}, 00:25:24.724 "ddgst": ${ddgst:-false} 00:25:24.724 }, 00:25:24.724 "method": "bdev_nvme_attach_controller" 00:25:24.724 } 00:25:24.724 EOF 00:25:24.724 )") 00:25:24.724 16:11:48 -- nvmf/common.sh@542 -- # cat 00:25:24.724 16:11:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:24.725 { 00:25:24.725 "params": { 00:25:24.725 "name": "Nvme$subsystem", 00:25:24.725 "trtype": "$TEST_TRANSPORT", 00:25:24.725 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:24.725 "adrfam": "ipv4", 00:25:24.725 "trsvcid": "$NVMF_PORT", 00:25:24.725 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:24.725 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:24.725 "hdgst": ${hdgst:-false}, 00:25:24.725 "ddgst": ${ddgst:-false} 00:25:24.725 }, 00:25:24.725 "method": "bdev_nvme_attach_controller" 00:25:24.725 } 00:25:24.725 EOF 00:25:24.725 )") 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # cat 00:25:24.725 16:11:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:24.725 { 00:25:24.725 "params": { 00:25:24.725 "name": "Nvme$subsystem", 00:25:24.725 "trtype": "$TEST_TRANSPORT", 00:25:24.725 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:24.725 "adrfam": "ipv4", 00:25:24.725 "trsvcid": "$NVMF_PORT", 00:25:24.725 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:24.725 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:24.725 "hdgst": ${hdgst:-false}, 00:25:24.725 "ddgst": ${ddgst:-false} 00:25:24.725 }, 00:25:24.725 "method": "bdev_nvme_attach_controller" 00:25:24.725 } 00:25:24.725 EOF 00:25:24.725 )") 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # cat 00:25:24.725 16:11:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:24.725 { 00:25:24.725 "params": { 00:25:24.725 "name": "Nvme$subsystem", 00:25:24.725 "trtype": "$TEST_TRANSPORT", 00:25:24.725 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:24.725 "adrfam": "ipv4", 00:25:24.725 "trsvcid": "$NVMF_PORT", 00:25:24.725 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:24.725 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:24.725 "hdgst": ${hdgst:-false}, 00:25:24.725 "ddgst": ${ddgst:-false} 00:25:24.725 }, 00:25:24.725 "method": "bdev_nvme_attach_controller" 00:25:24.725 } 00:25:24.725 EOF 00:25:24.725 )") 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # cat 00:25:24.725 16:11:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:24.725 { 00:25:24.725 "params": { 00:25:24.725 "name": "Nvme$subsystem", 00:25:24.725 "trtype": "$TEST_TRANSPORT", 00:25:24.725 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:24.725 "adrfam": "ipv4", 00:25:24.725 "trsvcid": "$NVMF_PORT", 00:25:24.725 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:24.725 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:24.725 "hdgst": ${hdgst:-false}, 00:25:24.725 "ddgst": ${ddgst:-false} 00:25:24.725 }, 00:25:24.725 "method": "bdev_nvme_attach_controller" 00:25:24.725 } 00:25:24.725 EOF 00:25:24.725 )") 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # cat 00:25:24.725 16:11:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:24.725 { 00:25:24.725 "params": { 00:25:24.725 "name": "Nvme$subsystem", 00:25:24.725 "trtype": "$TEST_TRANSPORT", 00:25:24.725 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:24.725 "adrfam": "ipv4", 00:25:24.725 "trsvcid": "$NVMF_PORT", 00:25:24.725 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:24.725 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:24.725 "hdgst": ${hdgst:-false}, 00:25:24.725 "ddgst": ${ddgst:-false} 00:25:24.725 }, 00:25:24.725 "method": "bdev_nvme_attach_controller" 00:25:24.725 } 00:25:24.725 EOF 00:25:24.725 )") 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # cat 00:25:24.725 16:11:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:24.725 { 00:25:24.725 "params": { 00:25:24.725 "name": "Nvme$subsystem", 00:25:24.725 "trtype": "$TEST_TRANSPORT", 00:25:24.725 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:24.725 "adrfam": "ipv4", 00:25:24.725 "trsvcid": "$NVMF_PORT", 00:25:24.725 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:24.725 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:24.725 "hdgst": ${hdgst:-false}, 00:25:24.725 "ddgst": ${ddgst:-false} 00:25:24.725 }, 00:25:24.725 "method": "bdev_nvme_attach_controller" 00:25:24.725 } 00:25:24.725 EOF 00:25:24.725 )") 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # cat 00:25:24.725 16:11:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:24.725 { 00:25:24.725 "params": { 00:25:24.725 "name": "Nvme$subsystem", 00:25:24.725 "trtype": "$TEST_TRANSPORT", 00:25:24.725 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:24.725 "adrfam": "ipv4", 00:25:24.725 "trsvcid": "$NVMF_PORT", 00:25:24.725 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:24.725 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:24.725 "hdgst": ${hdgst:-false}, 00:25:24.725 "ddgst": ${ddgst:-false} 00:25:24.725 }, 00:25:24.725 "method": "bdev_nvme_attach_controller" 00:25:24.725 } 00:25:24.725 EOF 00:25:24.725 )") 00:25:24.725 16:11:48 -- nvmf/common.sh@542 -- # cat 00:25:24.725 16:11:48 -- nvmf/common.sh@544 -- # jq . 00:25:24.725 16:11:48 -- nvmf/common.sh@545 -- # IFS=, 00:25:24.725 16:11:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:24.725 "params": { 00:25:24.725 "name": "Nvme1", 00:25:24.725 "trtype": "tcp", 00:25:24.725 "traddr": "10.0.0.2", 00:25:24.725 "adrfam": "ipv4", 00:25:24.725 "trsvcid": "4420", 00:25:24.725 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:24.725 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:24.725 "hdgst": false, 00:25:24.725 "ddgst": false 00:25:24.725 }, 00:25:24.725 "method": "bdev_nvme_attach_controller" 00:25:24.725 },{ 00:25:24.725 "params": { 00:25:24.725 "name": "Nvme2", 00:25:24.725 "trtype": "tcp", 00:25:24.725 "traddr": "10.0.0.2", 00:25:24.725 "adrfam": "ipv4", 00:25:24.725 "trsvcid": "4420", 00:25:24.725 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:24.725 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:24.725 "hdgst": false, 00:25:24.725 "ddgst": false 00:25:24.726 }, 00:25:24.726 "method": "bdev_nvme_attach_controller" 00:25:24.726 },{ 00:25:24.726 "params": { 00:25:24.726 "name": "Nvme3", 00:25:24.726 "trtype": "tcp", 00:25:24.726 "traddr": "10.0.0.2", 00:25:24.726 "adrfam": "ipv4", 00:25:24.726 "trsvcid": "4420", 00:25:24.726 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:24.726 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:24.726 "hdgst": false, 00:25:24.726 "ddgst": false 00:25:24.726 }, 00:25:24.726 "method": "bdev_nvme_attach_controller" 00:25:24.726 },{ 00:25:24.726 "params": { 00:25:24.726 "name": "Nvme4", 00:25:24.726 "trtype": "tcp", 00:25:24.726 "traddr": "10.0.0.2", 00:25:24.726 "adrfam": "ipv4", 00:25:24.726 "trsvcid": "4420", 00:25:24.726 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:24.726 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:24.726 "hdgst": false, 00:25:24.726 "ddgst": false 00:25:24.726 }, 00:25:24.726 "method": "bdev_nvme_attach_controller" 00:25:24.726 },{ 00:25:24.726 "params": { 00:25:24.726 "name": "Nvme5", 00:25:24.726 "trtype": "tcp", 00:25:24.726 "traddr": "10.0.0.2", 00:25:24.726 "adrfam": "ipv4", 00:25:24.726 "trsvcid": "4420", 00:25:24.726 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:24.726 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:24.726 "hdgst": false, 00:25:24.726 "ddgst": false 00:25:24.726 }, 00:25:24.726 "method": "bdev_nvme_attach_controller" 00:25:24.726 },{ 00:25:24.726 "params": { 00:25:24.726 "name": "Nvme6", 00:25:24.726 "trtype": "tcp", 00:25:24.726 "traddr": "10.0.0.2", 00:25:24.726 "adrfam": "ipv4", 00:25:24.726 "trsvcid": "4420", 00:25:24.726 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:24.726 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:24.726 "hdgst": false, 00:25:24.726 "ddgst": false 00:25:24.726 }, 00:25:24.726 "method": "bdev_nvme_attach_controller" 00:25:24.726 },{ 00:25:24.726 "params": { 00:25:24.726 "name": "Nvme7", 00:25:24.726 "trtype": "tcp", 00:25:24.726 "traddr": "10.0.0.2", 00:25:24.726 "adrfam": "ipv4", 00:25:24.726 "trsvcid": "4420", 00:25:24.726 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:24.726 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:24.726 "hdgst": false, 00:25:24.726 "ddgst": false 00:25:24.726 }, 00:25:24.726 "method": "bdev_nvme_attach_controller" 00:25:24.726 },{ 00:25:24.726 "params": { 00:25:24.726 "name": "Nvme8", 00:25:24.726 "trtype": "tcp", 00:25:24.726 "traddr": "10.0.0.2", 00:25:24.726 "adrfam": "ipv4", 00:25:24.726 "trsvcid": "4420", 00:25:24.726 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:24.726 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:24.726 "hdgst": false, 00:25:24.726 "ddgst": false 00:25:24.726 }, 00:25:24.726 "method": "bdev_nvme_attach_controller" 00:25:24.726 },{ 00:25:24.726 "params": { 00:25:24.726 "name": "Nvme9", 00:25:24.726 "trtype": "tcp", 00:25:24.726 "traddr": "10.0.0.2", 00:25:24.726 "adrfam": "ipv4", 00:25:24.726 "trsvcid": "4420", 00:25:24.726 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:24.726 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:24.726 "hdgst": false, 00:25:24.726 "ddgst": false 00:25:24.726 }, 00:25:24.726 "method": "bdev_nvme_attach_controller" 00:25:24.726 },{ 00:25:24.726 "params": { 00:25:24.726 "name": "Nvme10", 00:25:24.726 "trtype": "tcp", 00:25:24.726 "traddr": "10.0.0.2", 00:25:24.726 "adrfam": "ipv4", 00:25:24.726 "trsvcid": "4420", 00:25:24.726 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:24.726 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:24.726 "hdgst": false, 00:25:24.726 "ddgst": false 00:25:24.726 }, 00:25:24.726 "method": "bdev_nvme_attach_controller" 00:25:24.726 }' 00:25:24.726 [2024-11-18 16:11:48.127746] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:24.726 [2024-11-18 16:11:48.127822] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:24.726 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.726 [2024-11-18 16:11:48.193171] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:24.726 [2024-11-18 16:11:48.278117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:26.626 16:11:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:26.626 16:11:49 -- common/autotest_common.sh@862 -- # return 0 00:25:26.626 16:11:49 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:26.626 16:11:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.626 16:11:49 -- common/autotest_common.sh@10 -- # set +x 00:25:26.626 16:11:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.626 16:11:49 -- target/shutdown.sh@83 -- # kill -9 1658991 00:25:26.626 16:11:49 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:26.626 16:11:49 -- target/shutdown.sh@87 -- # sleep 1 00:25:27.560 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1658991 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:27.560 16:11:50 -- target/shutdown.sh@88 -- # kill -0 1658740 00:25:27.560 16:11:50 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:27.560 16:11:50 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:27.560 16:11:50 -- nvmf/common.sh@520 -- # config=() 00:25:27.560 16:11:50 -- nvmf/common.sh@520 -- # local subsystem config 00:25:27.560 16:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.560 { 00:25:27.560 "params": { 00:25:27.560 "name": "Nvme$subsystem", 00:25:27.560 "trtype": "$TEST_TRANSPORT", 00:25:27.560 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.560 "adrfam": "ipv4", 00:25:27.560 "trsvcid": "$NVMF_PORT", 00:25:27.560 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.560 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.560 "hdgst": ${hdgst:-false}, 00:25:27.560 "ddgst": ${ddgst:-false} 00:25:27.560 }, 00:25:27.560 "method": "bdev_nvme_attach_controller" 00:25:27.560 } 00:25:27.560 EOF 00:25:27.560 )") 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # cat 00:25:27.560 16:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.560 { 00:25:27.560 "params": { 00:25:27.560 "name": "Nvme$subsystem", 00:25:27.560 "trtype": "$TEST_TRANSPORT", 00:25:27.560 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.560 "adrfam": "ipv4", 00:25:27.560 "trsvcid": "$NVMF_PORT", 00:25:27.560 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.560 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.560 "hdgst": ${hdgst:-false}, 00:25:27.560 "ddgst": ${ddgst:-false} 00:25:27.560 }, 00:25:27.560 "method": "bdev_nvme_attach_controller" 00:25:27.560 } 00:25:27.560 EOF 00:25:27.560 )") 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # cat 00:25:27.560 16:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.560 { 00:25:27.560 "params": { 00:25:27.560 "name": "Nvme$subsystem", 00:25:27.560 "trtype": "$TEST_TRANSPORT", 00:25:27.560 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.560 "adrfam": "ipv4", 00:25:27.560 "trsvcid": "$NVMF_PORT", 00:25:27.560 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.560 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.560 "hdgst": ${hdgst:-false}, 00:25:27.560 "ddgst": ${ddgst:-false} 00:25:27.560 }, 00:25:27.560 "method": "bdev_nvme_attach_controller" 00:25:27.560 } 00:25:27.560 EOF 00:25:27.560 )") 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # cat 00:25:27.560 16:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.560 { 00:25:27.560 "params": { 00:25:27.560 "name": "Nvme$subsystem", 00:25:27.560 "trtype": "$TEST_TRANSPORT", 00:25:27.560 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.560 "adrfam": "ipv4", 00:25:27.560 "trsvcid": "$NVMF_PORT", 00:25:27.560 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.560 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.560 "hdgst": ${hdgst:-false}, 00:25:27.560 "ddgst": ${ddgst:-false} 00:25:27.560 }, 00:25:27.560 "method": "bdev_nvme_attach_controller" 00:25:27.560 } 00:25:27.560 EOF 00:25:27.560 )") 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # cat 00:25:27.560 16:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.560 { 00:25:27.560 "params": { 00:25:27.560 "name": "Nvme$subsystem", 00:25:27.560 "trtype": "$TEST_TRANSPORT", 00:25:27.560 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.560 "adrfam": "ipv4", 00:25:27.560 "trsvcid": "$NVMF_PORT", 00:25:27.560 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.560 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.560 "hdgst": ${hdgst:-false}, 00:25:27.560 "ddgst": ${ddgst:-false} 00:25:27.560 }, 00:25:27.560 "method": "bdev_nvme_attach_controller" 00:25:27.560 } 00:25:27.560 EOF 00:25:27.560 )") 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # cat 00:25:27.560 16:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.560 { 00:25:27.560 "params": { 00:25:27.560 "name": "Nvme$subsystem", 00:25:27.560 "trtype": "$TEST_TRANSPORT", 00:25:27.560 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.560 "adrfam": "ipv4", 00:25:27.560 "trsvcid": "$NVMF_PORT", 00:25:27.560 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.560 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.560 "hdgst": ${hdgst:-false}, 00:25:27.560 "ddgst": ${ddgst:-false} 00:25:27.560 }, 00:25:27.560 "method": "bdev_nvme_attach_controller" 00:25:27.560 } 00:25:27.560 EOF 00:25:27.560 )") 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # cat 00:25:27.560 16:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.560 { 00:25:27.560 "params": { 00:25:27.560 "name": "Nvme$subsystem", 00:25:27.560 "trtype": "$TEST_TRANSPORT", 00:25:27.560 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.560 "adrfam": "ipv4", 00:25:27.560 "trsvcid": "$NVMF_PORT", 00:25:27.560 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.560 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.560 "hdgst": ${hdgst:-false}, 00:25:27.560 "ddgst": ${ddgst:-false} 00:25:27.560 }, 00:25:27.560 "method": "bdev_nvme_attach_controller" 00:25:27.560 } 00:25:27.560 EOF 00:25:27.560 )") 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # cat 00:25:27.560 16:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.560 { 00:25:27.560 "params": { 00:25:27.560 "name": "Nvme$subsystem", 00:25:27.560 "trtype": "$TEST_TRANSPORT", 00:25:27.560 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.560 "adrfam": "ipv4", 00:25:27.560 "trsvcid": "$NVMF_PORT", 00:25:27.560 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.560 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.560 "hdgst": ${hdgst:-false}, 00:25:27.560 "ddgst": ${ddgst:-false} 00:25:27.560 }, 00:25:27.560 "method": "bdev_nvme_attach_controller" 00:25:27.560 } 00:25:27.560 EOF 00:25:27.560 )") 00:25:27.560 16:11:50 -- nvmf/common.sh@542 -- # cat 00:25:27.560 16:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.561 16:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.561 { 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme$subsystem", 00:25:27.561 "trtype": "$TEST_TRANSPORT", 00:25:27.561 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "$NVMF_PORT", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.561 "hdgst": ${hdgst:-false}, 00:25:27.561 "ddgst": ${ddgst:-false} 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 } 00:25:27.561 EOF 00:25:27.561 )") 00:25:27.561 16:11:50 -- nvmf/common.sh@542 -- # cat 00:25:27.561 16:11:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.561 16:11:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.561 { 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme$subsystem", 00:25:27.561 "trtype": "$TEST_TRANSPORT", 00:25:27.561 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "$NVMF_PORT", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.561 "hdgst": ${hdgst:-false}, 00:25:27.561 "ddgst": ${ddgst:-false} 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 } 00:25:27.561 EOF 00:25:27.561 )") 00:25:27.561 16:11:50 -- nvmf/common.sh@542 -- # cat 00:25:27.561 16:11:50 -- nvmf/common.sh@544 -- # jq . 00:25:27.561 16:11:50 -- nvmf/common.sh@545 -- # IFS=, 00:25:27.561 16:11:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme1", 00:25:27.561 "trtype": "tcp", 00:25:27.561 "traddr": "10.0.0.2", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "4420", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:27.561 "hdgst": false, 00:25:27.561 "ddgst": false 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 },{ 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme2", 00:25:27.561 "trtype": "tcp", 00:25:27.561 "traddr": "10.0.0.2", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "4420", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:27.561 "hdgst": false, 00:25:27.561 "ddgst": false 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 },{ 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme3", 00:25:27.561 "trtype": "tcp", 00:25:27.561 "traddr": "10.0.0.2", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "4420", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:27.561 "hdgst": false, 00:25:27.561 "ddgst": false 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 },{ 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme4", 00:25:27.561 "trtype": "tcp", 00:25:27.561 "traddr": "10.0.0.2", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "4420", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:27.561 "hdgst": false, 00:25:27.561 "ddgst": false 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 },{ 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme5", 00:25:27.561 "trtype": "tcp", 00:25:27.561 "traddr": "10.0.0.2", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "4420", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:27.561 "hdgst": false, 00:25:27.561 "ddgst": false 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 },{ 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme6", 00:25:27.561 "trtype": "tcp", 00:25:27.561 "traddr": "10.0.0.2", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "4420", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:27.561 "hdgst": false, 00:25:27.561 "ddgst": false 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 },{ 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme7", 00:25:27.561 "trtype": "tcp", 00:25:27.561 "traddr": "10.0.0.2", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "4420", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:27.561 "hdgst": false, 00:25:27.561 "ddgst": false 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 },{ 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme8", 00:25:27.561 "trtype": "tcp", 00:25:27.561 "traddr": "10.0.0.2", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "4420", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:27.561 "hdgst": false, 00:25:27.561 "ddgst": false 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 },{ 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme9", 00:25:27.561 "trtype": "tcp", 00:25:27.561 "traddr": "10.0.0.2", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "4420", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:27.561 "hdgst": false, 00:25:27.561 "ddgst": false 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 },{ 00:25:27.561 "params": { 00:25:27.561 "name": "Nvme10", 00:25:27.561 "trtype": "tcp", 00:25:27.561 "traddr": "10.0.0.2", 00:25:27.561 "adrfam": "ipv4", 00:25:27.561 "trsvcid": "4420", 00:25:27.561 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:27.561 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:27.561 "hdgst": false, 00:25:27.561 "ddgst": false 00:25:27.561 }, 00:25:27.561 "method": "bdev_nvme_attach_controller" 00:25:27.561 }' 00:25:27.561 [2024-11-18 16:11:50.929087] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:27.561 [2024-11-18 16:11:50.929171] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1659365 ] 00:25:27.561 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.561 [2024-11-18 16:11:50.995440] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:27.561 [2024-11-18 16:11:51.082728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:29.460 Running I/O for 1 seconds... 00:25:30.393 00:25:30.393 Latency(us) 00:25:30.393 [2024-11-18T15:11:53.984Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:30.393 [2024-11-18T15:11:53.984Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.393 Verification LBA range: start 0x0 length 0x400 00:25:30.393 Nvme1n1 : 1.11 364.81 22.80 0.00 0.00 163136.88 11893.57 133596.35 00:25:30.393 [2024-11-18T15:11:53.984Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.393 Verification LBA range: start 0x0 length 0x400 00:25:30.393 Nvme2n1 : 1.07 371.41 23.21 0.00 0.00 165875.24 46603.38 139033.41 00:25:30.393 [2024-11-18T15:11:53.984Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.393 Verification LBA range: start 0x0 length 0x400 00:25:30.393 Nvme3n1 : 1.10 395.85 24.74 0.00 0.00 157017.84 14563.56 153791.15 00:25:30.393 [2024-11-18T15:11:53.984Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.393 Verification LBA range: start 0x0 length 0x400 00:25:30.393 Nvme4n1 : 1.09 398.27 24.89 0.00 0.00 155095.04 13301.38 123498.95 00:25:30.393 [2024-11-18T15:11:53.984Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.393 Verification LBA range: start 0x0 length 0x400 00:25:30.393 Nvme5n1 : 1.10 394.44 24.65 0.00 0.00 155213.39 16214.09 129712.73 00:25:30.393 [2024-11-18T15:11:53.984Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.393 Verification LBA range: start 0x0 length 0x400 00:25:30.393 Nvme6n1 : 1.11 392.27 24.52 0.00 0.00 155270.88 14660.65 129712.73 00:25:30.393 [2024-11-18T15:11:53.984Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.393 Verification LBA range: start 0x0 length 0x400 00:25:30.393 Nvme7n1 : 1.09 396.67 24.79 0.00 0.00 152267.34 15146.10 118061.89 00:25:30.393 [2024-11-18T15:11:53.984Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.393 Verification LBA range: start 0x0 length 0x400 00:25:30.393 Nvme8n1 : 1.11 390.59 24.41 0.00 0.00 154003.50 12281.93 125052.40 00:25:30.393 [2024-11-18T15:11:53.984Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.393 Verification LBA range: start 0x0 length 0x400 00:25:30.393 Nvme9n1 : 1.11 389.90 24.37 0.00 0.00 153479.80 10000.31 128159.29 00:25:30.393 [2024-11-18T15:11:53.984Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:30.393 Verification LBA range: start 0x0 length 0x400 00:25:30.393 Nvme10n1 : 1.12 390.93 24.43 0.00 0.00 152039.68 9369.22 125829.12 00:25:30.393 [2024-11-18T15:11:53.984Z] =================================================================================================================== 00:25:30.393 [2024-11-18T15:11:53.984Z] Total : 3885.14 242.82 0.00 0.00 156209.98 9369.22 153791.15 00:25:30.651 16:11:54 -- target/shutdown.sh@93 -- # stoptarget 00:25:30.651 16:11:54 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:30.651 16:11:54 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:30.652 16:11:54 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:30.652 16:11:54 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:30.652 16:11:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:30.652 16:11:54 -- nvmf/common.sh@116 -- # sync 00:25:30.652 16:11:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:30.652 16:11:54 -- nvmf/common.sh@119 -- # set +e 00:25:30.652 16:11:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:30.652 16:11:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:30.652 rmmod nvme_tcp 00:25:30.652 rmmod nvme_fabrics 00:25:30.652 rmmod nvme_keyring 00:25:30.652 16:11:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:30.652 16:11:54 -- nvmf/common.sh@123 -- # set -e 00:25:30.652 16:11:54 -- nvmf/common.sh@124 -- # return 0 00:25:30.652 16:11:54 -- nvmf/common.sh@477 -- # '[' -n 1658740 ']' 00:25:30.652 16:11:54 -- nvmf/common.sh@478 -- # killprocess 1658740 00:25:30.652 16:11:54 -- common/autotest_common.sh@936 -- # '[' -z 1658740 ']' 00:25:30.652 16:11:54 -- common/autotest_common.sh@940 -- # kill -0 1658740 00:25:30.652 16:11:54 -- common/autotest_common.sh@941 -- # uname 00:25:30.652 16:11:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:30.652 16:11:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1658740 00:25:30.652 16:11:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:30.652 16:11:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:30.652 16:11:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1658740' 00:25:30.652 killing process with pid 1658740 00:25:30.652 16:11:54 -- common/autotest_common.sh@955 -- # kill 1658740 00:25:30.652 16:11:54 -- common/autotest_common.sh@960 -- # wait 1658740 00:25:31.217 16:11:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:31.217 16:11:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:31.217 16:11:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:31.217 16:11:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:31.217 16:11:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:31.217 16:11:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:31.217 16:11:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:31.218 16:11:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:33.747 16:11:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:33.747 00:25:33.747 real 0m12.532s 00:25:33.747 user 0m36.959s 00:25:33.747 sys 0m3.433s 00:25:33.747 16:11:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:33.747 16:11:56 -- common/autotest_common.sh@10 -- # set +x 00:25:33.747 ************************************ 00:25:33.747 END TEST nvmf_shutdown_tc1 00:25:33.747 ************************************ 00:25:33.747 16:11:56 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:33.747 16:11:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:33.747 16:11:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:33.747 16:11:56 -- common/autotest_common.sh@10 -- # set +x 00:25:33.747 ************************************ 00:25:33.747 START TEST nvmf_shutdown_tc2 00:25:33.747 ************************************ 00:25:33.747 16:11:56 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:33.747 16:11:56 -- target/shutdown.sh@98 -- # starttarget 00:25:33.747 16:11:56 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:33.747 16:11:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:33.747 16:11:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:33.747 16:11:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:33.747 16:11:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:33.747 16:11:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:33.747 16:11:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:33.747 16:11:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:33.747 16:11:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:33.747 16:11:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:33.747 16:11:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:33.747 16:11:56 -- common/autotest_common.sh@10 -- # set +x 00:25:33.747 16:11:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:33.747 16:11:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:33.747 16:11:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:33.747 16:11:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:33.747 16:11:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:33.747 16:11:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:33.747 16:11:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:33.747 16:11:56 -- nvmf/common.sh@294 -- # net_devs=() 00:25:33.747 16:11:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:33.747 16:11:56 -- nvmf/common.sh@295 -- # e810=() 00:25:33.747 16:11:56 -- nvmf/common.sh@295 -- # local -ga e810 00:25:33.747 16:11:56 -- nvmf/common.sh@296 -- # x722=() 00:25:33.747 16:11:56 -- nvmf/common.sh@296 -- # local -ga x722 00:25:33.747 16:11:56 -- nvmf/common.sh@297 -- # mlx=() 00:25:33.747 16:11:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:33.747 16:11:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:33.747 16:11:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:33.747 16:11:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:33.747 16:11:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:33.747 16:11:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:33.747 16:11:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:33.747 16:11:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:33.747 16:11:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:33.747 16:11:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:33.747 16:11:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:33.747 16:11:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:33.747 16:11:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:33.747 16:11:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:33.747 16:11:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:33.747 16:11:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:33.747 16:11:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:33.747 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:33.747 16:11:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:33.747 16:11:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:33.747 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:33.747 16:11:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:33.747 16:11:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:33.747 16:11:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:33.747 16:11:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:33.747 16:11:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:33.747 16:11:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:33.747 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:33.747 16:11:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:33.747 16:11:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:33.747 16:11:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:33.747 16:11:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:33.747 16:11:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:33.747 16:11:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:33.747 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:33.747 16:11:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:33.747 16:11:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:33.747 16:11:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:33.747 16:11:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:33.747 16:11:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:33.747 16:11:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:33.747 16:11:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:33.747 16:11:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:33.748 16:11:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:33.748 16:11:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:33.748 16:11:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:33.748 16:11:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:33.748 16:11:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:33.748 16:11:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:33.748 16:11:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:33.748 16:11:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:33.748 16:11:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:33.748 16:11:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:33.748 16:11:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:33.748 16:11:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:33.748 16:11:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:33.748 16:11:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:33.748 16:11:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:33.748 16:11:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:33.748 16:11:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:33.748 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:33.748 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:25:33.748 00:25:33.748 --- 10.0.0.2 ping statistics --- 00:25:33.748 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:33.748 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:25:33.748 16:11:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:33.748 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:33.748 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:25:33.748 00:25:33.748 --- 10.0.0.1 ping statistics --- 00:25:33.748 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:33.748 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:25:33.748 16:11:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:33.748 16:11:56 -- nvmf/common.sh@410 -- # return 0 00:25:33.748 16:11:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:33.748 16:11:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:33.748 16:11:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:33.748 16:11:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:33.748 16:11:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:33.748 16:11:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:33.748 16:11:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:33.748 16:11:56 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:33.748 16:11:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:33.748 16:11:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:33.748 16:11:56 -- common/autotest_common.sh@10 -- # set +x 00:25:33.748 16:11:56 -- nvmf/common.sh@469 -- # nvmfpid=1660155 00:25:33.748 16:11:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:33.748 16:11:56 -- nvmf/common.sh@470 -- # waitforlisten 1660155 00:25:33.748 16:11:56 -- common/autotest_common.sh@829 -- # '[' -z 1660155 ']' 00:25:33.748 16:11:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:33.748 16:11:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:33.748 16:11:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:33.748 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:33.748 16:11:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:33.748 16:11:56 -- common/autotest_common.sh@10 -- # set +x 00:25:33.748 [2024-11-18 16:11:56.950119] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:33.748 [2024-11-18 16:11:56.950201] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:33.748 EAL: No free 2048 kB hugepages reported on node 1 00:25:33.748 [2024-11-18 16:11:57.017136] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:33.748 [2024-11-18 16:11:57.108712] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:33.748 [2024-11-18 16:11:57.108861] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:33.748 [2024-11-18 16:11:57.108911] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:33.748 [2024-11-18 16:11:57.108933] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:33.748 [2024-11-18 16:11:57.109045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:33.748 [2024-11-18 16:11:57.109070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:33.748 [2024-11-18 16:11:57.109814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:33.748 [2024-11-18 16:11:57.109821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:34.681 16:11:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:34.681 16:11:57 -- common/autotest_common.sh@862 -- # return 0 00:25:34.681 16:11:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:34.681 16:11:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:34.681 16:11:57 -- common/autotest_common.sh@10 -- # set +x 00:25:34.681 16:11:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:34.681 16:11:57 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:34.681 16:11:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.681 16:11:57 -- common/autotest_common.sh@10 -- # set +x 00:25:34.681 [2024-11-18 16:11:57.972344] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:34.681 16:11:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.681 16:11:57 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:34.681 16:11:57 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:34.681 16:11:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:34.681 16:11:57 -- common/autotest_common.sh@10 -- # set +x 00:25:34.681 16:11:57 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:34.681 16:11:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.681 16:11:57 -- target/shutdown.sh@28 -- # cat 00:25:34.681 16:11:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.681 16:11:57 -- target/shutdown.sh@28 -- # cat 00:25:34.681 16:11:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.681 16:11:57 -- target/shutdown.sh@28 -- # cat 00:25:34.681 16:11:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.681 16:11:57 -- target/shutdown.sh@28 -- # cat 00:25:34.681 16:11:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.681 16:11:57 -- target/shutdown.sh@28 -- # cat 00:25:34.681 16:11:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.681 16:11:58 -- target/shutdown.sh@28 -- # cat 00:25:34.681 16:11:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.681 16:11:58 -- target/shutdown.sh@28 -- # cat 00:25:34.681 16:11:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.681 16:11:58 -- target/shutdown.sh@28 -- # cat 00:25:34.681 16:11:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.681 16:11:58 -- target/shutdown.sh@28 -- # cat 00:25:34.681 16:11:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.681 16:11:58 -- target/shutdown.sh@28 -- # cat 00:25:34.681 16:11:58 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:34.681 16:11:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.681 16:11:58 -- common/autotest_common.sh@10 -- # set +x 00:25:34.681 Malloc1 00:25:34.681 [2024-11-18 16:11:58.061826] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:34.681 Malloc2 00:25:34.681 Malloc3 00:25:34.681 Malloc4 00:25:34.681 Malloc5 00:25:34.939 Malloc6 00:25:34.939 Malloc7 00:25:34.939 Malloc8 00:25:34.939 Malloc9 00:25:34.939 Malloc10 00:25:34.939 16:11:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.939 16:11:58 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:34.939 16:11:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:34.939 16:11:58 -- common/autotest_common.sh@10 -- # set +x 00:25:34.939 16:11:58 -- target/shutdown.sh@102 -- # perfpid=1660464 00:25:34.939 16:11:58 -- target/shutdown.sh@103 -- # waitforlisten 1660464 /var/tmp/bdevperf.sock 00:25:34.939 16:11:58 -- common/autotest_common.sh@829 -- # '[' -z 1660464 ']' 00:25:34.939 16:11:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:34.939 16:11:58 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:34.939 16:11:58 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:34.939 16:11:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:34.939 16:11:58 -- nvmf/common.sh@520 -- # config=() 00:25:34.939 16:11:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:34.939 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:34.939 16:11:58 -- nvmf/common.sh@520 -- # local subsystem config 00:25:34.939 16:11:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:34.939 16:11:58 -- common/autotest_common.sh@10 -- # set +x 00:25:34.939 16:11:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.939 16:11:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.939 { 00:25:34.939 "params": { 00:25:34.939 "name": "Nvme$subsystem", 00:25:34.939 "trtype": "$TEST_TRANSPORT", 00:25:34.939 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.939 "adrfam": "ipv4", 00:25:34.939 "trsvcid": "$NVMF_PORT", 00:25:34.939 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.939 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.939 "hdgst": ${hdgst:-false}, 00:25:34.939 "ddgst": ${ddgst:-false} 00:25:34.939 }, 00:25:34.939 "method": "bdev_nvme_attach_controller" 00:25:34.939 } 00:25:34.939 EOF 00:25:34.939 )") 00:25:34.939 16:11:58 -- nvmf/common.sh@542 -- # cat 00:25:34.939 16:11:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.939 16:11:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.939 { 00:25:34.939 "params": { 00:25:34.939 "name": "Nvme$subsystem", 00:25:34.939 "trtype": "$TEST_TRANSPORT", 00:25:34.939 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.939 "adrfam": "ipv4", 00:25:34.939 "trsvcid": "$NVMF_PORT", 00:25:34.939 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.939 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.939 "hdgst": ${hdgst:-false}, 00:25:34.939 "ddgst": ${ddgst:-false} 00:25:34.939 }, 00:25:34.939 "method": "bdev_nvme_attach_controller" 00:25:34.939 } 00:25:34.939 EOF 00:25:34.940 )") 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # cat 00:25:35.199 16:11:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.199 { 00:25:35.199 "params": { 00:25:35.199 "name": "Nvme$subsystem", 00:25:35.199 "trtype": "$TEST_TRANSPORT", 00:25:35.199 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.199 "adrfam": "ipv4", 00:25:35.199 "trsvcid": "$NVMF_PORT", 00:25:35.199 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.199 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.199 "hdgst": ${hdgst:-false}, 00:25:35.199 "ddgst": ${ddgst:-false} 00:25:35.199 }, 00:25:35.199 "method": "bdev_nvme_attach_controller" 00:25:35.199 } 00:25:35.199 EOF 00:25:35.199 )") 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # cat 00:25:35.199 16:11:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.199 { 00:25:35.199 "params": { 00:25:35.199 "name": "Nvme$subsystem", 00:25:35.199 "trtype": "$TEST_TRANSPORT", 00:25:35.199 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.199 "adrfam": "ipv4", 00:25:35.199 "trsvcid": "$NVMF_PORT", 00:25:35.199 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.199 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.199 "hdgst": ${hdgst:-false}, 00:25:35.199 "ddgst": ${ddgst:-false} 00:25:35.199 }, 00:25:35.199 "method": "bdev_nvme_attach_controller" 00:25:35.199 } 00:25:35.199 EOF 00:25:35.199 )") 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # cat 00:25:35.199 16:11:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.199 { 00:25:35.199 "params": { 00:25:35.199 "name": "Nvme$subsystem", 00:25:35.199 "trtype": "$TEST_TRANSPORT", 00:25:35.199 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.199 "adrfam": "ipv4", 00:25:35.199 "trsvcid": "$NVMF_PORT", 00:25:35.199 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.199 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.199 "hdgst": ${hdgst:-false}, 00:25:35.199 "ddgst": ${ddgst:-false} 00:25:35.199 }, 00:25:35.199 "method": "bdev_nvme_attach_controller" 00:25:35.199 } 00:25:35.199 EOF 00:25:35.199 )") 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # cat 00:25:35.199 16:11:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.199 { 00:25:35.199 "params": { 00:25:35.199 "name": "Nvme$subsystem", 00:25:35.199 "trtype": "$TEST_TRANSPORT", 00:25:35.199 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.199 "adrfam": "ipv4", 00:25:35.199 "trsvcid": "$NVMF_PORT", 00:25:35.199 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.199 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.199 "hdgst": ${hdgst:-false}, 00:25:35.199 "ddgst": ${ddgst:-false} 00:25:35.199 }, 00:25:35.199 "method": "bdev_nvme_attach_controller" 00:25:35.199 } 00:25:35.199 EOF 00:25:35.199 )") 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # cat 00:25:35.199 16:11:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.199 { 00:25:35.199 "params": { 00:25:35.199 "name": "Nvme$subsystem", 00:25:35.199 "trtype": "$TEST_TRANSPORT", 00:25:35.199 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.199 "adrfam": "ipv4", 00:25:35.199 "trsvcid": "$NVMF_PORT", 00:25:35.199 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.199 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.199 "hdgst": ${hdgst:-false}, 00:25:35.199 "ddgst": ${ddgst:-false} 00:25:35.199 }, 00:25:35.199 "method": "bdev_nvme_attach_controller" 00:25:35.199 } 00:25:35.199 EOF 00:25:35.199 )") 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # cat 00:25:35.199 16:11:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.199 { 00:25:35.199 "params": { 00:25:35.199 "name": "Nvme$subsystem", 00:25:35.199 "trtype": "$TEST_TRANSPORT", 00:25:35.199 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.199 "adrfam": "ipv4", 00:25:35.199 "trsvcid": "$NVMF_PORT", 00:25:35.199 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.199 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.199 "hdgst": ${hdgst:-false}, 00:25:35.199 "ddgst": ${ddgst:-false} 00:25:35.199 }, 00:25:35.199 "method": "bdev_nvme_attach_controller" 00:25:35.199 } 00:25:35.199 EOF 00:25:35.199 )") 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # cat 00:25:35.199 16:11:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.199 { 00:25:35.199 "params": { 00:25:35.199 "name": "Nvme$subsystem", 00:25:35.199 "trtype": "$TEST_TRANSPORT", 00:25:35.199 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.199 "adrfam": "ipv4", 00:25:35.199 "trsvcid": "$NVMF_PORT", 00:25:35.199 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.199 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.199 "hdgst": ${hdgst:-false}, 00:25:35.199 "ddgst": ${ddgst:-false} 00:25:35.199 }, 00:25:35.199 "method": "bdev_nvme_attach_controller" 00:25:35.199 } 00:25:35.199 EOF 00:25:35.199 )") 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # cat 00:25:35.199 16:11:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.199 { 00:25:35.199 "params": { 00:25:35.199 "name": "Nvme$subsystem", 00:25:35.199 "trtype": "$TEST_TRANSPORT", 00:25:35.199 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.199 "adrfam": "ipv4", 00:25:35.199 "trsvcid": "$NVMF_PORT", 00:25:35.199 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.199 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.199 "hdgst": ${hdgst:-false}, 00:25:35.199 "ddgst": ${ddgst:-false} 00:25:35.199 }, 00:25:35.199 "method": "bdev_nvme_attach_controller" 00:25:35.199 } 00:25:35.199 EOF 00:25:35.199 )") 00:25:35.199 16:11:58 -- nvmf/common.sh@542 -- # cat 00:25:35.199 16:11:58 -- nvmf/common.sh@544 -- # jq . 00:25:35.199 16:11:58 -- nvmf/common.sh@545 -- # IFS=, 00:25:35.199 16:11:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:35.199 "params": { 00:25:35.200 "name": "Nvme1", 00:25:35.200 "trtype": "tcp", 00:25:35.200 "traddr": "10.0.0.2", 00:25:35.200 "adrfam": "ipv4", 00:25:35.200 "trsvcid": "4420", 00:25:35.200 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:35.200 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:35.200 "hdgst": false, 00:25:35.200 "ddgst": false 00:25:35.200 }, 00:25:35.200 "method": "bdev_nvme_attach_controller" 00:25:35.200 },{ 00:25:35.200 "params": { 00:25:35.200 "name": "Nvme2", 00:25:35.200 "trtype": "tcp", 00:25:35.200 "traddr": "10.0.0.2", 00:25:35.200 "adrfam": "ipv4", 00:25:35.200 "trsvcid": "4420", 00:25:35.200 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:35.200 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:35.200 "hdgst": false, 00:25:35.200 "ddgst": false 00:25:35.200 }, 00:25:35.200 "method": "bdev_nvme_attach_controller" 00:25:35.200 },{ 00:25:35.200 "params": { 00:25:35.200 "name": "Nvme3", 00:25:35.200 "trtype": "tcp", 00:25:35.200 "traddr": "10.0.0.2", 00:25:35.200 "adrfam": "ipv4", 00:25:35.200 "trsvcid": "4420", 00:25:35.200 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:35.200 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:35.200 "hdgst": false, 00:25:35.200 "ddgst": false 00:25:35.200 }, 00:25:35.200 "method": "bdev_nvme_attach_controller" 00:25:35.200 },{ 00:25:35.200 "params": { 00:25:35.200 "name": "Nvme4", 00:25:35.200 "trtype": "tcp", 00:25:35.200 "traddr": "10.0.0.2", 00:25:35.200 "adrfam": "ipv4", 00:25:35.200 "trsvcid": "4420", 00:25:35.200 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:35.200 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:35.200 "hdgst": false, 00:25:35.200 "ddgst": false 00:25:35.200 }, 00:25:35.200 "method": "bdev_nvme_attach_controller" 00:25:35.200 },{ 00:25:35.200 "params": { 00:25:35.200 "name": "Nvme5", 00:25:35.200 "trtype": "tcp", 00:25:35.200 "traddr": "10.0.0.2", 00:25:35.200 "adrfam": "ipv4", 00:25:35.200 "trsvcid": "4420", 00:25:35.200 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:35.200 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:35.200 "hdgst": false, 00:25:35.200 "ddgst": false 00:25:35.200 }, 00:25:35.200 "method": "bdev_nvme_attach_controller" 00:25:35.200 },{ 00:25:35.200 "params": { 00:25:35.200 "name": "Nvme6", 00:25:35.200 "trtype": "tcp", 00:25:35.200 "traddr": "10.0.0.2", 00:25:35.200 "adrfam": "ipv4", 00:25:35.200 "trsvcid": "4420", 00:25:35.200 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:35.200 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:35.200 "hdgst": false, 00:25:35.200 "ddgst": false 00:25:35.200 }, 00:25:35.200 "method": "bdev_nvme_attach_controller" 00:25:35.200 },{ 00:25:35.200 "params": { 00:25:35.200 "name": "Nvme7", 00:25:35.200 "trtype": "tcp", 00:25:35.200 "traddr": "10.0.0.2", 00:25:35.200 "adrfam": "ipv4", 00:25:35.200 "trsvcid": "4420", 00:25:35.200 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:35.200 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:35.200 "hdgst": false, 00:25:35.200 "ddgst": false 00:25:35.200 }, 00:25:35.200 "method": "bdev_nvme_attach_controller" 00:25:35.200 },{ 00:25:35.200 "params": { 00:25:35.200 "name": "Nvme8", 00:25:35.200 "trtype": "tcp", 00:25:35.200 "traddr": "10.0.0.2", 00:25:35.200 "adrfam": "ipv4", 00:25:35.200 "trsvcid": "4420", 00:25:35.200 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:35.200 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:35.200 "hdgst": false, 00:25:35.200 "ddgst": false 00:25:35.200 }, 00:25:35.200 "method": "bdev_nvme_attach_controller" 00:25:35.200 },{ 00:25:35.200 "params": { 00:25:35.200 "name": "Nvme9", 00:25:35.200 "trtype": "tcp", 00:25:35.200 "traddr": "10.0.0.2", 00:25:35.200 "adrfam": "ipv4", 00:25:35.200 "trsvcid": "4420", 00:25:35.200 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:35.200 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:35.200 "hdgst": false, 00:25:35.200 "ddgst": false 00:25:35.200 }, 00:25:35.200 "method": "bdev_nvme_attach_controller" 00:25:35.200 },{ 00:25:35.200 "params": { 00:25:35.200 "name": "Nvme10", 00:25:35.200 "trtype": "tcp", 00:25:35.200 "traddr": "10.0.0.2", 00:25:35.200 "adrfam": "ipv4", 00:25:35.200 "trsvcid": "4420", 00:25:35.200 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:35.200 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:35.200 "hdgst": false, 00:25:35.200 "ddgst": false 00:25:35.200 }, 00:25:35.200 "method": "bdev_nvme_attach_controller" 00:25:35.200 }' 00:25:35.200 [2024-11-18 16:11:58.565417] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:35.200 [2024-11-18 16:11:58.565492] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1660464 ] 00:25:35.200 EAL: No free 2048 kB hugepages reported on node 1 00:25:35.200 [2024-11-18 16:11:58.629727] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:35.200 [2024-11-18 16:11:58.714939] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:37.096 Running I/O for 10 seconds... 00:25:37.096 16:12:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:37.096 16:12:00 -- common/autotest_common.sh@862 -- # return 0 00:25:37.096 16:12:00 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:37.096 16:12:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.096 16:12:00 -- common/autotest_common.sh@10 -- # set +x 00:25:37.096 16:12:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.096 16:12:00 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:37.096 16:12:00 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:37.096 16:12:00 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:37.096 16:12:00 -- target/shutdown.sh@57 -- # local ret=1 00:25:37.096 16:12:00 -- target/shutdown.sh@58 -- # local i 00:25:37.096 16:12:00 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:37.096 16:12:00 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:37.096 16:12:00 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:37.096 16:12:00 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:37.096 16:12:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.096 16:12:00 -- common/autotest_common.sh@10 -- # set +x 00:25:37.096 16:12:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.096 16:12:00 -- target/shutdown.sh@60 -- # read_io_count=42 00:25:37.096 16:12:00 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:25:37.096 16:12:00 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:37.096 16:12:00 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:37.096 16:12:00 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:37.096 16:12:00 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:37.096 16:12:00 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:37.096 16:12:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.096 16:12:00 -- common/autotest_common.sh@10 -- # set +x 00:25:37.354 16:12:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.354 16:12:00 -- target/shutdown.sh@60 -- # read_io_count=167 00:25:37.354 16:12:00 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:25:37.354 16:12:00 -- target/shutdown.sh@64 -- # ret=0 00:25:37.354 16:12:00 -- target/shutdown.sh@65 -- # break 00:25:37.354 16:12:00 -- target/shutdown.sh@69 -- # return 0 00:25:37.354 16:12:00 -- target/shutdown.sh@109 -- # killprocess 1660464 00:25:37.354 16:12:00 -- common/autotest_common.sh@936 -- # '[' -z 1660464 ']' 00:25:37.354 16:12:00 -- common/autotest_common.sh@940 -- # kill -0 1660464 00:25:37.355 16:12:00 -- common/autotest_common.sh@941 -- # uname 00:25:37.355 16:12:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:37.355 16:12:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1660464 00:25:37.355 16:12:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:37.355 16:12:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:37.355 16:12:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1660464' 00:25:37.355 killing process with pid 1660464 00:25:37.355 16:12:00 -- common/autotest_common.sh@955 -- # kill 1660464 00:25:37.355 16:12:00 -- common/autotest_common.sh@960 -- # wait 1660464 00:25:37.355 Received shutdown signal, test time was about 0.598213 seconds 00:25:37.355 00:25:37.355 Latency(us) 00:25:37.355 [2024-11-18T15:12:00.946Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:37.355 [2024-11-18T15:12:00.946Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.355 Verification LBA range: start 0x0 length 0x400 00:25:37.355 Nvme1n1 : 0.58 394.39 24.65 0.00 0.00 155848.78 26602.76 121945.51 00:25:37.355 [2024-11-18T15:12:00.946Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.355 Verification LBA range: start 0x0 length 0x400 00:25:37.355 Nvme2n1 : 0.58 392.15 24.51 0.00 0.00 154182.91 27767.85 120392.06 00:25:37.355 [2024-11-18T15:12:00.946Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.355 Verification LBA range: start 0x0 length 0x400 00:25:37.355 Nvme3n1 : 0.58 393.43 24.59 0.00 0.00 152184.26 22330.79 118838.61 00:25:37.355 [2024-11-18T15:12:00.946Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.355 Verification LBA range: start 0x0 length 0x400 00:25:37.355 Nvme4n1 : 0.58 391.20 24.45 0.00 0.00 150559.91 26991.12 119615.34 00:25:37.355 [2024-11-18T15:12:00.946Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.355 Verification LBA range: start 0x0 length 0x400 00:25:37.355 Nvme5n1 : 0.59 389.72 24.36 0.00 0.00 149023.50 27185.30 121168.78 00:25:37.355 [2024-11-18T15:12:00.946Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.355 Verification LBA range: start 0x0 length 0x400 00:25:37.355 Nvme6n1 : 0.59 387.65 24.23 0.00 0.00 147614.84 27767.85 121945.51 00:25:37.355 [2024-11-18T15:12:00.946Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.355 Verification LBA range: start 0x0 length 0x400 00:25:37.355 Nvme7n1 : 0.59 385.83 24.11 0.00 0.00 146181.48 27379.48 124275.67 00:25:37.355 [2024-11-18T15:12:00.946Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.355 Verification LBA range: start 0x0 length 0x400 00:25:37.355 Nvme8n1 : 0.59 384.42 24.03 0.00 0.00 145011.28 26214.40 127382.57 00:25:37.355 [2024-11-18T15:12:00.946Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.355 Verification LBA range: start 0x0 length 0x400 00:25:37.355 Nvme9n1 : 0.60 382.76 23.92 0.00 0.00 144381.05 22330.79 128159.29 00:25:37.355 [2024-11-18T15:12:00.946Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.355 Verification LBA range: start 0x0 length 0x400 00:25:37.355 Nvme10n1 : 0.60 381.66 23.85 0.00 0.00 143278.56 20388.98 128159.29 00:25:37.355 [2024-11-18T15:12:00.946Z] =================================================================================================================== 00:25:37.355 [2024-11-18T15:12:00.946Z] Total : 3883.21 242.70 0.00 0.00 148826.66 20388.98 128159.29 00:25:37.612 16:12:01 -- target/shutdown.sh@112 -- # sleep 1 00:25:38.544 16:12:02 -- target/shutdown.sh@113 -- # kill -0 1660155 00:25:38.544 16:12:02 -- target/shutdown.sh@115 -- # stoptarget 00:25:38.544 16:12:02 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:38.544 16:12:02 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:38.544 16:12:02 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:38.544 16:12:02 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:38.544 16:12:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:38.544 16:12:02 -- nvmf/common.sh@116 -- # sync 00:25:38.544 16:12:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:38.544 16:12:02 -- nvmf/common.sh@119 -- # set +e 00:25:38.544 16:12:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:38.544 16:12:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:38.544 rmmod nvme_tcp 00:25:38.544 rmmod nvme_fabrics 00:25:38.544 rmmod nvme_keyring 00:25:38.544 16:12:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:38.544 16:12:02 -- nvmf/common.sh@123 -- # set -e 00:25:38.544 16:12:02 -- nvmf/common.sh@124 -- # return 0 00:25:38.544 16:12:02 -- nvmf/common.sh@477 -- # '[' -n 1660155 ']' 00:25:38.544 16:12:02 -- nvmf/common.sh@478 -- # killprocess 1660155 00:25:38.544 16:12:02 -- common/autotest_common.sh@936 -- # '[' -z 1660155 ']' 00:25:38.544 16:12:02 -- common/autotest_common.sh@940 -- # kill -0 1660155 00:25:38.544 16:12:02 -- common/autotest_common.sh@941 -- # uname 00:25:38.544 16:12:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:38.544 16:12:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1660155 00:25:38.802 16:12:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:38.802 16:12:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:38.802 16:12:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1660155' 00:25:38.802 killing process with pid 1660155 00:25:38.802 16:12:02 -- common/autotest_common.sh@955 -- # kill 1660155 00:25:38.802 16:12:02 -- common/autotest_common.sh@960 -- # wait 1660155 00:25:39.061 16:12:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:39.061 16:12:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:39.061 16:12:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:39.061 16:12:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:39.061 16:12:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:39.061 16:12:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:39.061 16:12:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:39.061 16:12:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:41.592 16:12:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:41.592 00:25:41.592 real 0m7.906s 00:25:41.592 user 0m24.473s 00:25:41.592 sys 0m1.415s 00:25:41.592 16:12:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:41.592 16:12:04 -- common/autotest_common.sh@10 -- # set +x 00:25:41.592 ************************************ 00:25:41.592 END TEST nvmf_shutdown_tc2 00:25:41.592 ************************************ 00:25:41.592 16:12:04 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:41.592 16:12:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:41.592 16:12:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:41.592 16:12:04 -- common/autotest_common.sh@10 -- # set +x 00:25:41.592 ************************************ 00:25:41.592 START TEST nvmf_shutdown_tc3 00:25:41.592 ************************************ 00:25:41.592 16:12:04 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:41.592 16:12:04 -- target/shutdown.sh@120 -- # starttarget 00:25:41.592 16:12:04 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:41.592 16:12:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:41.592 16:12:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:41.592 16:12:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:41.592 16:12:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:41.592 16:12:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:41.592 16:12:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:41.592 16:12:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:41.592 16:12:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:41.592 16:12:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:41.592 16:12:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:41.592 16:12:04 -- common/autotest_common.sh@10 -- # set +x 00:25:41.592 16:12:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:41.592 16:12:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:41.592 16:12:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:41.592 16:12:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:41.592 16:12:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:41.592 16:12:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:41.592 16:12:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:41.592 16:12:04 -- nvmf/common.sh@294 -- # net_devs=() 00:25:41.592 16:12:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:41.592 16:12:04 -- nvmf/common.sh@295 -- # e810=() 00:25:41.592 16:12:04 -- nvmf/common.sh@295 -- # local -ga e810 00:25:41.592 16:12:04 -- nvmf/common.sh@296 -- # x722=() 00:25:41.592 16:12:04 -- nvmf/common.sh@296 -- # local -ga x722 00:25:41.592 16:12:04 -- nvmf/common.sh@297 -- # mlx=() 00:25:41.592 16:12:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:41.592 16:12:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:41.592 16:12:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:41.592 16:12:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:41.592 16:12:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:41.592 16:12:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:41.592 16:12:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:41.592 16:12:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:41.592 16:12:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:41.592 16:12:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:41.592 16:12:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:41.592 16:12:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:41.592 16:12:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:41.592 16:12:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:41.592 16:12:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:41.592 16:12:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:41.592 16:12:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:41.592 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:41.592 16:12:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:41.592 16:12:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:41.592 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:41.592 16:12:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:41.592 16:12:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:41.592 16:12:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:41.592 16:12:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:41.592 16:12:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:41.592 16:12:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:41.592 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:41.592 16:12:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:41.592 16:12:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:41.592 16:12:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:41.592 16:12:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:41.592 16:12:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:41.592 16:12:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:41.592 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:41.592 16:12:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:41.592 16:12:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:41.592 16:12:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:41.592 16:12:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:41.592 16:12:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:41.592 16:12:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:41.593 16:12:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:41.593 16:12:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:41.593 16:12:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:41.593 16:12:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:41.593 16:12:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:41.593 16:12:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:41.593 16:12:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:41.593 16:12:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:41.593 16:12:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:41.593 16:12:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:41.593 16:12:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:41.593 16:12:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:41.593 16:12:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:41.593 16:12:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:41.593 16:12:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:41.593 16:12:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:41.593 16:12:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:41.593 16:12:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:41.593 16:12:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:41.593 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:41.593 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.377 ms 00:25:41.593 00:25:41.593 --- 10.0.0.2 ping statistics --- 00:25:41.593 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:41.593 rtt min/avg/max/mdev = 0.377/0.377/0.377/0.000 ms 00:25:41.593 16:12:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:41.593 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:41.593 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:25:41.593 00:25:41.593 --- 10.0.0.1 ping statistics --- 00:25:41.593 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:41.593 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:25:41.593 16:12:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:41.593 16:12:04 -- nvmf/common.sh@410 -- # return 0 00:25:41.593 16:12:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:41.593 16:12:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:41.593 16:12:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:41.593 16:12:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:41.593 16:12:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:41.593 16:12:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:41.593 16:12:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:41.593 16:12:04 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:41.593 16:12:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:41.593 16:12:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:41.593 16:12:04 -- common/autotest_common.sh@10 -- # set +x 00:25:41.593 16:12:04 -- nvmf/common.sh@469 -- # nvmfpid=1661385 00:25:41.593 16:12:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:41.593 16:12:04 -- nvmf/common.sh@470 -- # waitforlisten 1661385 00:25:41.593 16:12:04 -- common/autotest_common.sh@829 -- # '[' -z 1661385 ']' 00:25:41.593 16:12:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:41.593 16:12:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:41.593 16:12:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:41.593 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:41.593 16:12:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:41.593 16:12:04 -- common/autotest_common.sh@10 -- # set +x 00:25:41.593 [2024-11-18 16:12:04.918683] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:41.593 [2024-11-18 16:12:04.918765] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:41.593 EAL: No free 2048 kB hugepages reported on node 1 00:25:41.593 [2024-11-18 16:12:04.987683] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:41.593 [2024-11-18 16:12:05.076515] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:41.593 [2024-11-18 16:12:05.076707] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:41.593 [2024-11-18 16:12:05.076734] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:41.593 [2024-11-18 16:12:05.076754] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:41.593 [2024-11-18 16:12:05.076835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:41.593 [2024-11-18 16:12:05.076897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:41.593 [2024-11-18 16:12:05.076946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:41.593 [2024-11-18 16:12:05.076951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:42.526 16:12:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:42.526 16:12:05 -- common/autotest_common.sh@862 -- # return 0 00:25:42.526 16:12:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:42.526 16:12:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:42.526 16:12:05 -- common/autotest_common.sh@10 -- # set +x 00:25:42.526 16:12:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:42.526 16:12:05 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:42.526 16:12:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.526 16:12:05 -- common/autotest_common.sh@10 -- # set +x 00:25:42.526 [2024-11-18 16:12:05.958364] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:42.526 16:12:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.526 16:12:05 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:42.526 16:12:05 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:42.526 16:12:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:42.526 16:12:05 -- common/autotest_common.sh@10 -- # set +x 00:25:42.526 16:12:05 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:42.526 16:12:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.526 16:12:05 -- target/shutdown.sh@28 -- # cat 00:25:42.526 16:12:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.526 16:12:05 -- target/shutdown.sh@28 -- # cat 00:25:42.526 16:12:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.526 16:12:05 -- target/shutdown.sh@28 -- # cat 00:25:42.526 16:12:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.526 16:12:05 -- target/shutdown.sh@28 -- # cat 00:25:42.526 16:12:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.526 16:12:05 -- target/shutdown.sh@28 -- # cat 00:25:42.526 16:12:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.526 16:12:05 -- target/shutdown.sh@28 -- # cat 00:25:42.526 16:12:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.526 16:12:05 -- target/shutdown.sh@28 -- # cat 00:25:42.526 16:12:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.526 16:12:05 -- target/shutdown.sh@28 -- # cat 00:25:42.526 16:12:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.526 16:12:05 -- target/shutdown.sh@28 -- # cat 00:25:42.526 16:12:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:42.526 16:12:05 -- target/shutdown.sh@28 -- # cat 00:25:42.526 16:12:05 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:42.526 16:12:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.526 16:12:05 -- common/autotest_common.sh@10 -- # set +x 00:25:42.526 Malloc1 00:25:42.526 [2024-11-18 16:12:06.033819] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:42.526 Malloc2 00:25:42.526 Malloc3 00:25:42.784 Malloc4 00:25:42.784 Malloc5 00:25:42.784 Malloc6 00:25:42.784 Malloc7 00:25:42.784 Malloc8 00:25:43.042 Malloc9 00:25:43.042 Malloc10 00:25:43.043 16:12:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.043 16:12:06 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:43.043 16:12:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:43.043 16:12:06 -- common/autotest_common.sh@10 -- # set +x 00:25:43.043 16:12:06 -- target/shutdown.sh@124 -- # perfpid=1661707 00:25:43.043 16:12:06 -- target/shutdown.sh@125 -- # waitforlisten 1661707 /var/tmp/bdevperf.sock 00:25:43.043 16:12:06 -- common/autotest_common.sh@829 -- # '[' -z 1661707 ']' 00:25:43.043 16:12:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:43.043 16:12:06 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:43.043 16:12:06 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:43.043 16:12:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:43.043 16:12:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:43.043 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:43.043 16:12:06 -- nvmf/common.sh@520 -- # config=() 00:25:43.043 16:12:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:43.043 16:12:06 -- nvmf/common.sh@520 -- # local subsystem config 00:25:43.043 16:12:06 -- common/autotest_common.sh@10 -- # set +x 00:25:43.043 16:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:43.043 { 00:25:43.043 "params": { 00:25:43.043 "name": "Nvme$subsystem", 00:25:43.043 "trtype": "$TEST_TRANSPORT", 00:25:43.043 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:43.043 "adrfam": "ipv4", 00:25:43.043 "trsvcid": "$NVMF_PORT", 00:25:43.043 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:43.043 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:43.043 "hdgst": ${hdgst:-false}, 00:25:43.043 "ddgst": ${ddgst:-false} 00:25:43.043 }, 00:25:43.043 "method": "bdev_nvme_attach_controller" 00:25:43.043 } 00:25:43.043 EOF 00:25:43.043 )") 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # cat 00:25:43.043 16:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:43.043 { 00:25:43.043 "params": { 00:25:43.043 "name": "Nvme$subsystem", 00:25:43.043 "trtype": "$TEST_TRANSPORT", 00:25:43.043 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:43.043 "adrfam": "ipv4", 00:25:43.043 "trsvcid": "$NVMF_PORT", 00:25:43.043 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:43.043 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:43.043 "hdgst": ${hdgst:-false}, 00:25:43.043 "ddgst": ${ddgst:-false} 00:25:43.043 }, 00:25:43.043 "method": "bdev_nvme_attach_controller" 00:25:43.043 } 00:25:43.043 EOF 00:25:43.043 )") 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # cat 00:25:43.043 16:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:43.043 { 00:25:43.043 "params": { 00:25:43.043 "name": "Nvme$subsystem", 00:25:43.043 "trtype": "$TEST_TRANSPORT", 00:25:43.043 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:43.043 "adrfam": "ipv4", 00:25:43.043 "trsvcid": "$NVMF_PORT", 00:25:43.043 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:43.043 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:43.043 "hdgst": ${hdgst:-false}, 00:25:43.043 "ddgst": ${ddgst:-false} 00:25:43.043 }, 00:25:43.043 "method": "bdev_nvme_attach_controller" 00:25:43.043 } 00:25:43.043 EOF 00:25:43.043 )") 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # cat 00:25:43.043 16:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:43.043 { 00:25:43.043 "params": { 00:25:43.043 "name": "Nvme$subsystem", 00:25:43.043 "trtype": "$TEST_TRANSPORT", 00:25:43.043 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:43.043 "adrfam": "ipv4", 00:25:43.043 "trsvcid": "$NVMF_PORT", 00:25:43.043 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:43.043 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:43.043 "hdgst": ${hdgst:-false}, 00:25:43.043 "ddgst": ${ddgst:-false} 00:25:43.043 }, 00:25:43.043 "method": "bdev_nvme_attach_controller" 00:25:43.043 } 00:25:43.043 EOF 00:25:43.043 )") 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # cat 00:25:43.043 16:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:43.043 { 00:25:43.043 "params": { 00:25:43.043 "name": "Nvme$subsystem", 00:25:43.043 "trtype": "$TEST_TRANSPORT", 00:25:43.043 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:43.043 "adrfam": "ipv4", 00:25:43.043 "trsvcid": "$NVMF_PORT", 00:25:43.043 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:43.043 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:43.043 "hdgst": ${hdgst:-false}, 00:25:43.043 "ddgst": ${ddgst:-false} 00:25:43.043 }, 00:25:43.043 "method": "bdev_nvme_attach_controller" 00:25:43.043 } 00:25:43.043 EOF 00:25:43.043 )") 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # cat 00:25:43.043 16:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:43.043 { 00:25:43.043 "params": { 00:25:43.043 "name": "Nvme$subsystem", 00:25:43.043 "trtype": "$TEST_TRANSPORT", 00:25:43.043 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:43.043 "adrfam": "ipv4", 00:25:43.043 "trsvcid": "$NVMF_PORT", 00:25:43.043 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:43.043 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:43.043 "hdgst": ${hdgst:-false}, 00:25:43.043 "ddgst": ${ddgst:-false} 00:25:43.043 }, 00:25:43.043 "method": "bdev_nvme_attach_controller" 00:25:43.043 } 00:25:43.043 EOF 00:25:43.043 )") 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # cat 00:25:43.043 16:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:43.043 { 00:25:43.043 "params": { 00:25:43.043 "name": "Nvme$subsystem", 00:25:43.043 "trtype": "$TEST_TRANSPORT", 00:25:43.043 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:43.043 "adrfam": "ipv4", 00:25:43.043 "trsvcid": "$NVMF_PORT", 00:25:43.043 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:43.043 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:43.043 "hdgst": ${hdgst:-false}, 00:25:43.043 "ddgst": ${ddgst:-false} 00:25:43.043 }, 00:25:43.043 "method": "bdev_nvme_attach_controller" 00:25:43.043 } 00:25:43.043 EOF 00:25:43.043 )") 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # cat 00:25:43.043 16:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:43.043 { 00:25:43.043 "params": { 00:25:43.043 "name": "Nvme$subsystem", 00:25:43.043 "trtype": "$TEST_TRANSPORT", 00:25:43.043 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:43.043 "adrfam": "ipv4", 00:25:43.043 "trsvcid": "$NVMF_PORT", 00:25:43.043 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:43.043 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:43.043 "hdgst": ${hdgst:-false}, 00:25:43.043 "ddgst": ${ddgst:-false} 00:25:43.043 }, 00:25:43.043 "method": "bdev_nvme_attach_controller" 00:25:43.043 } 00:25:43.043 EOF 00:25:43.043 )") 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # cat 00:25:43.043 16:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:43.043 { 00:25:43.043 "params": { 00:25:43.043 "name": "Nvme$subsystem", 00:25:43.043 "trtype": "$TEST_TRANSPORT", 00:25:43.043 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:43.043 "adrfam": "ipv4", 00:25:43.043 "trsvcid": "$NVMF_PORT", 00:25:43.043 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:43.043 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:43.043 "hdgst": ${hdgst:-false}, 00:25:43.043 "ddgst": ${ddgst:-false} 00:25:43.043 }, 00:25:43.043 "method": "bdev_nvme_attach_controller" 00:25:43.043 } 00:25:43.043 EOF 00:25:43.043 )") 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # cat 00:25:43.043 16:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:43.043 { 00:25:43.043 "params": { 00:25:43.043 "name": "Nvme$subsystem", 00:25:43.043 "trtype": "$TEST_TRANSPORT", 00:25:43.043 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:43.043 "adrfam": "ipv4", 00:25:43.043 "trsvcid": "$NVMF_PORT", 00:25:43.043 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:43.043 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:43.043 "hdgst": ${hdgst:-false}, 00:25:43.043 "ddgst": ${ddgst:-false} 00:25:43.043 }, 00:25:43.043 "method": "bdev_nvme_attach_controller" 00:25:43.043 } 00:25:43.043 EOF 00:25:43.043 )") 00:25:43.043 16:12:06 -- nvmf/common.sh@542 -- # cat 00:25:43.043 16:12:06 -- nvmf/common.sh@544 -- # jq . 00:25:43.043 16:12:06 -- nvmf/common.sh@545 -- # IFS=, 00:25:43.043 16:12:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:43.043 "params": { 00:25:43.043 "name": "Nvme1", 00:25:43.043 "trtype": "tcp", 00:25:43.043 "traddr": "10.0.0.2", 00:25:43.043 "adrfam": "ipv4", 00:25:43.043 "trsvcid": "4420", 00:25:43.043 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:43.044 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:43.044 "hdgst": false, 00:25:43.044 "ddgst": false 00:25:43.044 }, 00:25:43.044 "method": "bdev_nvme_attach_controller" 00:25:43.044 },{ 00:25:43.044 "params": { 00:25:43.044 "name": "Nvme2", 00:25:43.044 "trtype": "tcp", 00:25:43.044 "traddr": "10.0.0.2", 00:25:43.044 "adrfam": "ipv4", 00:25:43.044 "trsvcid": "4420", 00:25:43.044 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:43.044 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:43.044 "hdgst": false, 00:25:43.044 "ddgst": false 00:25:43.044 }, 00:25:43.044 "method": "bdev_nvme_attach_controller" 00:25:43.044 },{ 00:25:43.044 "params": { 00:25:43.044 "name": "Nvme3", 00:25:43.044 "trtype": "tcp", 00:25:43.044 "traddr": "10.0.0.2", 00:25:43.044 "adrfam": "ipv4", 00:25:43.044 "trsvcid": "4420", 00:25:43.044 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:43.044 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:43.044 "hdgst": false, 00:25:43.044 "ddgst": false 00:25:43.044 }, 00:25:43.044 "method": "bdev_nvme_attach_controller" 00:25:43.044 },{ 00:25:43.044 "params": { 00:25:43.044 "name": "Nvme4", 00:25:43.044 "trtype": "tcp", 00:25:43.044 "traddr": "10.0.0.2", 00:25:43.044 "adrfam": "ipv4", 00:25:43.044 "trsvcid": "4420", 00:25:43.044 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:43.044 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:43.044 "hdgst": false, 00:25:43.044 "ddgst": false 00:25:43.044 }, 00:25:43.044 "method": "bdev_nvme_attach_controller" 00:25:43.044 },{ 00:25:43.044 "params": { 00:25:43.044 "name": "Nvme5", 00:25:43.044 "trtype": "tcp", 00:25:43.044 "traddr": "10.0.0.2", 00:25:43.044 "adrfam": "ipv4", 00:25:43.044 "trsvcid": "4420", 00:25:43.044 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:43.044 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:43.044 "hdgst": false, 00:25:43.044 "ddgst": false 00:25:43.044 }, 00:25:43.044 "method": "bdev_nvme_attach_controller" 00:25:43.044 },{ 00:25:43.044 "params": { 00:25:43.044 "name": "Nvme6", 00:25:43.044 "trtype": "tcp", 00:25:43.044 "traddr": "10.0.0.2", 00:25:43.044 "adrfam": "ipv4", 00:25:43.044 "trsvcid": "4420", 00:25:43.044 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:43.044 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:43.044 "hdgst": false, 00:25:43.044 "ddgst": false 00:25:43.044 }, 00:25:43.044 "method": "bdev_nvme_attach_controller" 00:25:43.044 },{ 00:25:43.044 "params": { 00:25:43.044 "name": "Nvme7", 00:25:43.044 "trtype": "tcp", 00:25:43.044 "traddr": "10.0.0.2", 00:25:43.044 "adrfam": "ipv4", 00:25:43.044 "trsvcid": "4420", 00:25:43.044 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:43.044 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:43.044 "hdgst": false, 00:25:43.044 "ddgst": false 00:25:43.044 }, 00:25:43.044 "method": "bdev_nvme_attach_controller" 00:25:43.044 },{ 00:25:43.044 "params": { 00:25:43.044 "name": "Nvme8", 00:25:43.044 "trtype": "tcp", 00:25:43.044 "traddr": "10.0.0.2", 00:25:43.044 "adrfam": "ipv4", 00:25:43.044 "trsvcid": "4420", 00:25:43.044 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:43.044 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:43.044 "hdgst": false, 00:25:43.044 "ddgst": false 00:25:43.044 }, 00:25:43.044 "method": "bdev_nvme_attach_controller" 00:25:43.044 },{ 00:25:43.044 "params": { 00:25:43.044 "name": "Nvme9", 00:25:43.044 "trtype": "tcp", 00:25:43.044 "traddr": "10.0.0.2", 00:25:43.044 "adrfam": "ipv4", 00:25:43.044 "trsvcid": "4420", 00:25:43.044 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:43.044 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:43.044 "hdgst": false, 00:25:43.044 "ddgst": false 00:25:43.044 }, 00:25:43.044 "method": "bdev_nvme_attach_controller" 00:25:43.044 },{ 00:25:43.044 "params": { 00:25:43.044 "name": "Nvme10", 00:25:43.044 "trtype": "tcp", 00:25:43.044 "traddr": "10.0.0.2", 00:25:43.044 "adrfam": "ipv4", 00:25:43.044 "trsvcid": "4420", 00:25:43.044 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:43.044 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:43.044 "hdgst": false, 00:25:43.044 "ddgst": false 00:25:43.044 }, 00:25:43.044 "method": "bdev_nvme_attach_controller" 00:25:43.044 }' 00:25:43.044 [2024-11-18 16:12:06.546236] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:43.044 [2024-11-18 16:12:06.546312] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1661707 ] 00:25:43.044 EAL: No free 2048 kB hugepages reported on node 1 00:25:43.044 [2024-11-18 16:12:06.610075] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:43.302 [2024-11-18 16:12:06.695485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:45.201 Running I/O for 10 seconds... 00:25:45.458 16:12:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:45.458 16:12:09 -- common/autotest_common.sh@862 -- # return 0 00:25:45.458 16:12:09 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:45.458 16:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.458 16:12:09 -- common/autotest_common.sh@10 -- # set +x 00:25:45.730 16:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.730 16:12:09 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:45.730 16:12:09 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:45.730 16:12:09 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:45.730 16:12:09 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:45.730 16:12:09 -- target/shutdown.sh@57 -- # local ret=1 00:25:45.730 16:12:09 -- target/shutdown.sh@58 -- # local i 00:25:45.730 16:12:09 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:45.730 16:12:09 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:45.730 16:12:09 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:45.730 16:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.730 16:12:09 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:45.730 16:12:09 -- common/autotest_common.sh@10 -- # set +x 00:25:45.730 16:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.730 16:12:09 -- target/shutdown.sh@60 -- # read_io_count=211 00:25:45.730 16:12:09 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:25:45.730 16:12:09 -- target/shutdown.sh@64 -- # ret=0 00:25:45.730 16:12:09 -- target/shutdown.sh@65 -- # break 00:25:45.730 16:12:09 -- target/shutdown.sh@69 -- # return 0 00:25:45.730 16:12:09 -- target/shutdown.sh@134 -- # killprocess 1661385 00:25:45.730 16:12:09 -- common/autotest_common.sh@936 -- # '[' -z 1661385 ']' 00:25:45.730 16:12:09 -- common/autotest_common.sh@940 -- # kill -0 1661385 00:25:45.730 16:12:09 -- common/autotest_common.sh@941 -- # uname 00:25:45.730 16:12:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:45.730 16:12:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1661385 00:25:45.730 16:12:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:45.730 16:12:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:45.730 16:12:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1661385' 00:25:45.730 killing process with pid 1661385 00:25:45.730 16:12:09 -- common/autotest_common.sh@955 -- # kill 1661385 00:25:45.730 16:12:09 -- common/autotest_common.sh@960 -- # wait 1661385 00:25:45.730 [2024-11-18 16:12:09.130666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.730 [2024-11-18 16:12:09.130785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.730 [2024-11-18 16:12:09.130802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.730 [2024-11-18 16:12:09.130815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.730 [2024-11-18 16:12:09.130827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.730 [2024-11-18 16:12:09.130840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.730 [2024-11-18 16:12:09.130852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.130864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.130876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.130889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.130900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.130927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.130949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.130961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.130972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.130984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.130996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.131536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b30e90 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.731 [2024-11-18 16:12:09.132832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.132993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.133418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b33750 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.138994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.732 [2024-11-18 16:12:09.139195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.139633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b31340 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.140872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b317f0 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.141876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32130 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.141914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32130 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.142449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b325e0 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.142475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b325e0 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.733 [2024-11-18 16:12:09.143671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.143996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.144009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.144020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.144032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.144044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.144056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.144067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.144079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.144094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32a90 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.145999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.146021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.146042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.734 [2024-11-18 16:12:09.146063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.146510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b32df0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.735 [2024-11-18 16:12:09.147819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.147999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.148150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b332a0 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.158256] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158417] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d5f700 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.158526] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158563] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158590] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158626] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c00650 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.158704] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158740] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158768] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158795] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d6ec50 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.158876] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158937] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158969] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.158983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.158998] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.159016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.159030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bfe070 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.159082] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.159103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.159118] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.159132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.159146] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.159159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.159174] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.159187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.159200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d5a660 is same with the state(5) to be set 00:25:45.736 [2024-11-18 16:12:09.159247] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.159267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.159282] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.736 [2024-11-18 16:12:09.159296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.736 [2024-11-18 16:12:09.159310] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159338] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d70100 is same with the state(5) to be set 00:25:45.737 [2024-11-18 16:12:09.159410] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159451] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159478] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159512] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d4ac80 is same with the state(5) to be set 00:25:45.737 [2024-11-18 16:12:09.159588] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159640] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159669] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159696] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bb6d30 is same with the state(5) to be set 00:25:45.737 [2024-11-18 16:12:09.159768] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159809] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159837] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159865] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bcba30 is same with the state(5) to be set 00:25:45.737 [2024-11-18 16:12:09.159948] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.159968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.159984] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.160008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160028] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.160047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160064] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.737 [2024-11-18 16:12:09.160078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ba96b0 is same with the state(5) to be set 00:25:45.737 [2024-11-18 16:12:09.160665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.160689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.160731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.160763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.160794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.160825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.160856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.160886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.160925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.160956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.160972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.160986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.161007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.161023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.161039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.161053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.161069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.161083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.161099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.161113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.737 [2024-11-18 16:12:09.161129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.737 [2024-11-18 16:12:09.161144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.161980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.161994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.162011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.162025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.162041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.162055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.162071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.162086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.162102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.162116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.162131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.162145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.162161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.162179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.162195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.162209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.162225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.162240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.738 [2024-11-18 16:12:09.162256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.738 [2024-11-18 16:12:09.162270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d27ef0 is same with the state(5) to be set 00:25:45.739 [2024-11-18 16:12:09.162790] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d27ef0 was disconnected and freed. reset controller. 00:25:45.739 [2024-11-18 16:12:09.162856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.162970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.162986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.739 [2024-11-18 16:12:09.163363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.739 [2024-11-18 16:12:09.163380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.163969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.163983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.740 [2024-11-18 16:12:09.164378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.740 [2024-11-18 16:12:09.164393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.164874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.164888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d28d30 is same with the state(5) to be set 00:25:45.741 [2024-11-18 16:12:09.164958] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d28d30 was disconnected and freed. reset controller. 00:25:45.741 [2024-11-18 16:12:09.165013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.741 [2024-11-18 16:12:09.165531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.741 [2024-11-18 16:12:09.165553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.165568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.165588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.165604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.165628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.165643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.165660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.165674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.165690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.165703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.165719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.165733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.165749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.165763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.165779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.165793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.165808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.165823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.165838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.165852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.165868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.165882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.165908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.177635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.177706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.177722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.177739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.177765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.177781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.177795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.177812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.177827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.177844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.177858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.177874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.177894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.177911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.177925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.177941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.177955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.177971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.177985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.742 [2024-11-18 16:12:09.178350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.742 [2024-11-18 16:12:09.178366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.178787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.178803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d2a0e0 is same with the state(5) to be set 00:25:45.743 [2024-11-18 16:12:09.178914] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d2a0e0 was disconnected and freed. reset controller. 00:25:45.743 [2024-11-18 16:12:09.179426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d5f700 (9): Bad file descriptor 00:25:45.743 [2024-11-18 16:12:09.179464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c00650 (9): Bad file descriptor 00:25:45.743 [2024-11-18 16:12:09.179489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d6ec50 (9): Bad file descriptor 00:25:45.743 [2024-11-18 16:12:09.179513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bfe070 (9): Bad file descriptor 00:25:45.743 [2024-11-18 16:12:09.179541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d5a660 (9): Bad file descriptor 00:25:45.743 [2024-11-18 16:12:09.179568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d70100 (9): Bad file descriptor 00:25:45.743 [2024-11-18 16:12:09.179598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d4ac80 (9): Bad file descriptor 00:25:45.743 [2024-11-18 16:12:09.179638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bb6d30 (9): Bad file descriptor 00:25:45.743 [2024-11-18 16:12:09.179668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bcba30 (9): Bad file descriptor 00:25:45.743 [2024-11-18 16:12:09.179694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ba96b0 (9): Bad file descriptor 00:25:45.743 [2024-11-18 16:12:09.184690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:45.743 [2024-11-18 16:12:09.184831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.184858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.184881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.184904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.184921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.184936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.184952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.184967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.184982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.184996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.185013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.185026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.185043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.185057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.185073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.185087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.185103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.185118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.185134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.185148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.185165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.185186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.185203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.185217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.185233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.743 [2024-11-18 16:12:09.185247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.743 [2024-11-18 16:12:09.185263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.185982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.185997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.744 [2024-11-18 16:12:09.186344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.744 [2024-11-18 16:12:09.186359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.186822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.186947] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c1b010 was disconnected and freed. reset controller. 00:25:45.745 [2024-11-18 16:12:09.187007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.745 [2024-11-18 16:12:09.187573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.745 [2024-11-18 16:12:09.187589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.187979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.187995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.746 [2024-11-18 16:12:09.188472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.746 [2024-11-18 16:12:09.188485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.188968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.188982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189079] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d26950 was disconnected and freed. reset controller. 00:25:45.747 [2024-11-18 16:12:09.189239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.747 [2024-11-18 16:12:09.189838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.747 [2024-11-18 16:12:09.189853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.189872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.189899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.189913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.189928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1b8a0 is same with the state(5) to be set 00:25:45.748 [2024-11-18 16:12:09.190000] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c1b8a0 was disconnected and freed. reset controller. 00:25:45.748 [2024-11-18 16:12:09.190293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:45.748 [2024-11-18 16:12:09.190323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:45.748 [2024-11-18 16:12:09.190509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.748 [2024-11-18 16:12:09.190632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.748 [2024-11-18 16:12:09.190660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d70100 with addr=10.0.0.2, port=4420 00:25:45.748 [2024-11-18 16:12:09.190678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d70100 is same with the state(5) to be set 00:25:45.748 [2024-11-18 16:12:09.190752] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.748 [2024-11-18 16:12:09.190780] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.748 [2024-11-18 16:12:09.190802] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.748 [2024-11-18 16:12:09.194803] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:45.748 [2024-11-18 16:12:09.194905] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:45.748 [2024-11-18 16:12:09.194976] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:45.748 [2024-11-18 16:12:09.195070] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:45.748 [2024-11-18 16:12:09.195128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:45.748 [2024-11-18 16:12:09.195154] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:45.748 [2024-11-18 16:12:09.195282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.748 [2024-11-18 16:12:09.195398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.748 [2024-11-18 16:12:09.195426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bcba30 with addr=10.0.0.2, port=4420 00:25:45.748 [2024-11-18 16:12:09.195444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bcba30 is same with the state(5) to be set 00:25:45.748 [2024-11-18 16:12:09.195519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.748 [2024-11-18 16:12:09.195604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.748 [2024-11-18 16:12:09.195635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d4ac80 with addr=10.0.0.2, port=4420 00:25:45.748 [2024-11-18 16:12:09.195651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d4ac80 is same with the state(5) to be set 00:25:45.748 [2024-11-18 16:12:09.195674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d70100 (9): Bad file descriptor 00:25:45.748 [2024-11-18 16:12:09.195718] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.748 [2024-11-18 16:12:09.195848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.195881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.195913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.195929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.195947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.195961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.195978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.195992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.748 [2024-11-18 16:12:09.196412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.748 [2024-11-18 16:12:09.196427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.196974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.196990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.749 [2024-11-18 16:12:09.197349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.749 [2024-11-18 16:12:09.197363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.197835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.197849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1cdd0 is same with the state(5) to be set 00:25:45.750 [2024-11-18 16:12:09.199095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.750 [2024-11-18 16:12:09.199625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.750 [2024-11-18 16:12:09.199642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.199671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.199701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.199731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.199760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.199791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.199821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.199856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.199886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.199924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.199955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.199984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.199998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.751 [2024-11-18 16:12:09.200464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.751 [2024-11-18 16:12:09.200478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.200971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.200985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.201006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.201021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.201037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.201051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.201066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.201082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.201097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1e3b0 is same with the state(5) to be set 00:25:45.752 [2024-11-18 16:12:09.202295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.752 [2024-11-18 16:12:09.202797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.752 [2024-11-18 16:12:09.202811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.202827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.202842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.202857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.202871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.202899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.202913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.202929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.202944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.202959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.202973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.202990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.753 [2024-11-18 16:12:09.203964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.753 [2024-11-18 16:12:09.203980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.203993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.204009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.204022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.204039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.204053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.204069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.204082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.204098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.204112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.204127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.204141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.204160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.204174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.204190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.204204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.204219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.204233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.204248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.204262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.204277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.204292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.204306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1f990 is same with the state(5) to be set 00:25:45.754 [2024-11-18 16:12:09.205914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.205938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.205960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.205976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.205992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.754 [2024-11-18 16:12:09.206568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.754 [2024-11-18 16:12:09.206581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.206980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.206993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.755 [2024-11-18 16:12:09.207654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.755 [2024-11-18 16:12:09.207668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.756 [2024-11-18 16:12:09.207684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.756 [2024-11-18 16:12:09.207702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.756 [2024-11-18 16:12:09.207719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.756 [2024-11-18 16:12:09.207733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.756 [2024-11-18 16:12:09.207748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.756 [2024-11-18 16:12:09.207762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.756 [2024-11-18 16:12:09.207778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.756 [2024-11-18 16:12:09.207792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.756 [2024-11-18 16:12:09.207807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.756 [2024-11-18 16:12:09.207822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.756 [2024-11-18 16:12:09.207837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.756 [2024-11-18 16:12:09.207851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.756 [2024-11-18 16:12:09.207875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.756 [2024-11-18 16:12:09.207899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.756 [2024-11-18 16:12:09.207913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c20f70 is same with the state(5) to be set 00:25:45.756 [2024-11-18 16:12:09.209466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:45.756 [2024-11-18 16:12:09.209499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:45.756 [2024-11-18 16:12:09.209518] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:45.756 [2024-11-18 16:12:09.209537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:45.756 [2024-11-18 16:12:09.209784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.756 [2024-11-18 16:12:09.209882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.756 [2024-11-18 16:12:09.209913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ba96b0 with addr=10.0.0.2, port=4420 00:25:45.756 [2024-11-18 16:12:09.209931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ba96b0 is same with the state(5) to be set 00:25:45.756 [2024-11-18 16:12:09.210021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.756 [2024-11-18 16:12:09.210114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.756 [2024-11-18 16:12:09.210139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bb6d30 with addr=10.0.0.2, port=4420 00:25:45.756 [2024-11-18 16:12:09.210156] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bb6d30 is same with the state(5) to be set 00:25:45.756 [2024-11-18 16:12:09.210182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bcba30 (9): Bad file descriptor 00:25:45.756 [2024-11-18 16:12:09.210209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d4ac80 (9): Bad file descriptor 00:25:45.756 [2024-11-18 16:12:09.210227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:45.756 [2024-11-18 16:12:09.210241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:45.756 [2024-11-18 16:12:09.210258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:45.756 [2024-11-18 16:12:09.210318] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.756 [2024-11-18 16:12:09.210349] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.756 [2024-11-18 16:12:09.210371] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.756 [2024-11-18 16:12:09.210390] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.756 [2024-11-18 16:12:09.210411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bb6d30 (9): Bad file descriptor 00:25:45.756 [2024-11-18 16:12:09.210436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ba96b0 (9): Bad file descriptor 00:25:45.756 task offset: 34816 on job bdev=Nvme3n1 fails 00:25:45.756 00:25:45.756 Latency(us) 00:25:45.756 [2024-11-18T15:12:09.347Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme1n1 ended in about 0.72 seconds with error 00:25:45.756 Verification LBA range: start 0x0 length 0x400 00:25:45.756 Nvme1n1 : 0.72 349.06 21.82 89.00 0.00 145075.21 66409.81 119615.34 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme2n1 ended in about 0.72 seconds with error 00:25:45.756 Verification LBA range: start 0x0 length 0x400 00:25:45.756 Nvme2n1 : 0.72 348.53 21.78 88.87 0.00 143725.80 59030.95 118061.89 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme3n1 ended in about 0.71 seconds with error 00:25:45.756 Verification LBA range: start 0x0 length 0x400 00:25:45.756 Nvme3n1 : 0.71 354.27 22.14 90.33 0.00 139810.75 39224.51 118061.89 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme4n1 ended in about 0.71 seconds with error 00:25:45.756 Verification LBA range: start 0x0 length 0x400 00:25:45.756 Nvme4n1 : 0.71 353.71 22.11 90.19 0.00 138512.51 32039.82 115731.72 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme5n1 ended in about 0.71 seconds with error 00:25:45.756 Verification LBA range: start 0x0 length 0x400 00:25:45.756 Nvme5n1 : 0.71 353.18 22.07 90.05 0.00 137163.73 24855.13 142140.30 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme6n1 ended in about 0.72 seconds with error 00:25:45.756 Verification LBA range: start 0x0 length 0x400 00:25:45.756 Nvme6n1 : 0.72 347.71 21.73 29.09 0.00 158202.96 9514.86 134373.07 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme7n1 ended in about 0.73 seconds with error 00:25:45.756 Verification LBA range: start 0x0 length 0x400 00:25:45.756 Nvme7n1 : 0.73 286.47 17.90 88.14 0.00 158936.94 98255.45 139810.13 00:25:45.756 [2024-11-18T15:12:09.347Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.756 [2024-11-18T15:12:09.348Z] Job: Nvme8n1 ended in about 0.73 seconds with error 00:25:45.757 Verification LBA range: start 0x0 length 0x400 00:25:45.757 Nvme8n1 : 0.73 285.20 17.83 87.75 0.00 157956.04 98255.45 132042.90 00:25:45.757 [2024-11-18T15:12:09.348Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.757 [2024-11-18T15:12:09.348Z] Job: Nvme9n1 ended in about 0.73 seconds with error 00:25:45.757 Verification LBA range: start 0x0 length 0x400 00:25:45.757 Nvme9n1 : 0.73 283.95 17.75 87.37 0.00 156922.31 97478.73 125829.12 00:25:45.757 [2024-11-18T15:12:09.348Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:45.757 [2024-11-18T15:12:09.348Z] Job: Nvme10n1 ended in about 0.74 seconds with error 00:25:45.757 Verification LBA range: start 0x0 length 0x400 00:25:45.757 Nvme10n1 : 0.74 282.56 17.66 86.94 0.00 156052.78 98255.45 123498.95 00:25:45.757 [2024-11-18T15:12:09.348Z] =================================================================================================================== 00:25:45.757 [2024-11-18T15:12:09.348Z] Total : 3244.64 202.79 827.75 0.00 148622.16 9514.86 142140.30 00:25:45.757 [2024-11-18 16:12:09.236677] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:45.757 [2024-11-18 16:12:09.236764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:45.757 [2024-11-18 16:12:09.236799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.757 [2024-11-18 16:12:09.237075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.237202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.237229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d5a660 with addr=10.0.0.2, port=4420 00:25:45.757 [2024-11-18 16:12:09.237250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d5a660 is same with the state(5) to be set 00:25:45.757 [2024-11-18 16:12:09.237334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.237416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.237442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d5f700 with addr=10.0.0.2, port=4420 00:25:45.757 [2024-11-18 16:12:09.237459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d5f700 is same with the state(5) to be set 00:25:45.757 [2024-11-18 16:12:09.237559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.237662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.237688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bfe070 with addr=10.0.0.2, port=4420 00:25:45.757 [2024-11-18 16:12:09.237705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bfe070 is same with the state(5) to be set 00:25:45.757 [2024-11-18 16:12:09.237807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.237900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.237925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c00650 with addr=10.0.0.2, port=4420 00:25:45.757 [2024-11-18 16:12:09.237942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c00650 is same with the state(5) to be set 00:25:45.757 [2024-11-18 16:12:09.237964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:45.757 [2024-11-18 16:12:09.237978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:45.757 [2024-11-18 16:12:09.237995] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:45.757 [2024-11-18 16:12:09.238023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:45.757 [2024-11-18 16:12:09.238038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:45.757 [2024-11-18 16:12:09.238051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:45.757 [2024-11-18 16:12:09.239205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.757 [2024-11-18 16:12:09.239229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.757 [2024-11-18 16:12:09.239354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.239444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.239469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d6ec50 with addr=10.0.0.2, port=4420 00:25:45.757 [2024-11-18 16:12:09.239487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d6ec50 is same with the state(5) to be set 00:25:45.757 [2024-11-18 16:12:09.239512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d5a660 (9): Bad file descriptor 00:25:45.757 [2024-11-18 16:12:09.239535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d5f700 (9): Bad file descriptor 00:25:45.757 [2024-11-18 16:12:09.239553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bfe070 (9): Bad file descriptor 00:25:45.757 [2024-11-18 16:12:09.239570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c00650 (9): Bad file descriptor 00:25:45.757 [2024-11-18 16:12:09.239586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:45.757 [2024-11-18 16:12:09.239616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:45.757 [2024-11-18 16:12:09.239632] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:45.757 [2024-11-18 16:12:09.239651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:45.757 [2024-11-18 16:12:09.239665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:45.757 [2024-11-18 16:12:09.239679] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:45.757 [2024-11-18 16:12:09.239747] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.757 [2024-11-18 16:12:09.239772] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.757 [2024-11-18 16:12:09.239792] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.757 [2024-11-18 16:12:09.239811] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.757 [2024-11-18 16:12:09.239830] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.757 [2024-11-18 16:12:09.239849] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:45.757 [2024-11-18 16:12:09.239960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.757 [2024-11-18 16:12:09.239981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.757 [2024-11-18 16:12:09.240010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d6ec50 (9): Bad file descriptor 00:25:45.757 [2024-11-18 16:12:09.240028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:45.757 [2024-11-18 16:12:09.240041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:45.757 [2024-11-18 16:12:09.240054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:45.757 [2024-11-18 16:12:09.240074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:45.757 [2024-11-18 16:12:09.240088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:45.757 [2024-11-18 16:12:09.240101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:45.757 [2024-11-18 16:12:09.240117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:45.757 [2024-11-18 16:12:09.240136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:45.757 [2024-11-18 16:12:09.240150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:45.757 [2024-11-18 16:12:09.240167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:45.757 [2024-11-18 16:12:09.240181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:45.757 [2024-11-18 16:12:09.240194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:45.757 [2024-11-18 16:12:09.240265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:45.757 [2024-11-18 16:12:09.240289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:45.757 [2024-11-18 16:12:09.240306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:45.757 [2024-11-18 16:12:09.240322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.757 [2024-11-18 16:12:09.240335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.757 [2024-11-18 16:12:09.240346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.757 [2024-11-18 16:12:09.240358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.757 [2024-11-18 16:12:09.240390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:45.757 [2024-11-18 16:12:09.240406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:45.757 [2024-11-18 16:12:09.240419] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:45.757 [2024-11-18 16:12:09.240457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.757 [2024-11-18 16:12:09.240557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.240686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.757 [2024-11-18 16:12:09.240712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d4ac80 with addr=10.0.0.2, port=4420 00:25:45.758 [2024-11-18 16:12:09.240728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d4ac80 is same with the state(5) to be set 00:25:45.758 [2024-11-18 16:12:09.240811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.758 [2024-11-18 16:12:09.240907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.758 [2024-11-18 16:12:09.240932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bcba30 with addr=10.0.0.2, port=4420 00:25:45.758 [2024-11-18 16:12:09.240948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bcba30 is same with the state(5) to be set 00:25:45.758 [2024-11-18 16:12:09.241019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.758 [2024-11-18 16:12:09.241102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:45.758 [2024-11-18 16:12:09.241127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d70100 with addr=10.0.0.2, port=4420 00:25:45.758 [2024-11-18 16:12:09.241143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d70100 is same with the state(5) to be set 00:25:45.758 [2024-11-18 16:12:09.241187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d4ac80 (9): Bad file descriptor 00:25:45.758 [2024-11-18 16:12:09.241211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bcba30 (9): Bad file descriptor 00:25:45.758 [2024-11-18 16:12:09.241229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d70100 (9): Bad file descriptor 00:25:45.758 [2024-11-18 16:12:09.241271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:45.758 [2024-11-18 16:12:09.241289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:45.758 [2024-11-18 16:12:09.241303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:45.758 [2024-11-18 16:12:09.241320] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:45.758 [2024-11-18 16:12:09.241334] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:45.758 [2024-11-18 16:12:09.241346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:45.758 [2024-11-18 16:12:09.241361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:45.758 [2024-11-18 16:12:09.241375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:45.758 [2024-11-18 16:12:09.241388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:45.758 [2024-11-18 16:12:09.241424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.758 [2024-11-18 16:12:09.241440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:45.758 [2024-11-18 16:12:09.241453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:46.324 16:12:09 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:46.324 16:12:09 -- target/shutdown.sh@138 -- # sleep 1 00:25:47.258 16:12:10 -- target/shutdown.sh@141 -- # kill -9 1661707 00:25:47.258 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1661707) - No such process 00:25:47.258 16:12:10 -- target/shutdown.sh@141 -- # true 00:25:47.258 16:12:10 -- target/shutdown.sh@143 -- # stoptarget 00:25:47.258 16:12:10 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:47.258 16:12:10 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:47.258 16:12:10 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:47.258 16:12:10 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:47.258 16:12:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:47.259 16:12:10 -- nvmf/common.sh@116 -- # sync 00:25:47.259 16:12:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:47.259 16:12:10 -- nvmf/common.sh@119 -- # set +e 00:25:47.259 16:12:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:47.259 16:12:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:47.259 rmmod nvme_tcp 00:25:47.259 rmmod nvme_fabrics 00:25:47.259 rmmod nvme_keyring 00:25:47.259 16:12:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:47.259 16:12:10 -- nvmf/common.sh@123 -- # set -e 00:25:47.259 16:12:10 -- nvmf/common.sh@124 -- # return 0 00:25:47.259 16:12:10 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:47.259 16:12:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:47.259 16:12:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:47.259 16:12:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:47.259 16:12:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:47.259 16:12:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:47.259 16:12:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:47.259 16:12:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:47.259 16:12:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:49.790 16:12:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:49.790 00:25:49.790 real 0m8.078s 00:25:49.790 user 0m21.200s 00:25:49.790 sys 0m1.529s 00:25:49.790 16:12:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:49.790 16:12:12 -- common/autotest_common.sh@10 -- # set +x 00:25:49.790 ************************************ 00:25:49.790 END TEST nvmf_shutdown_tc3 00:25:49.790 ************************************ 00:25:49.790 16:12:12 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:49.790 00:25:49.790 real 0m28.769s 00:25:49.790 user 1m22.774s 00:25:49.790 sys 0m6.513s 00:25:49.790 16:12:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:49.790 16:12:12 -- common/autotest_common.sh@10 -- # set +x 00:25:49.790 ************************************ 00:25:49.790 END TEST nvmf_shutdown 00:25:49.790 ************************************ 00:25:49.790 16:12:12 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:49.790 16:12:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:49.790 16:12:12 -- common/autotest_common.sh@10 -- # set +x 00:25:49.790 16:12:12 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:49.790 16:12:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:49.790 16:12:12 -- common/autotest_common.sh@10 -- # set +x 00:25:49.790 16:12:12 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:49.790 16:12:12 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:49.790 16:12:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:49.790 16:12:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:49.790 16:12:12 -- common/autotest_common.sh@10 -- # set +x 00:25:49.790 ************************************ 00:25:49.790 START TEST nvmf_multicontroller 00:25:49.790 ************************************ 00:25:49.790 16:12:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:49.790 * Looking for test storage... 00:25:49.790 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:49.790 16:12:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:49.790 16:12:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:49.790 16:12:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:49.790 16:12:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:49.790 16:12:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:49.790 16:12:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:49.790 16:12:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:49.790 16:12:12 -- scripts/common.sh@335 -- # IFS=.-: 00:25:49.790 16:12:12 -- scripts/common.sh@335 -- # read -ra ver1 00:25:49.790 16:12:12 -- scripts/common.sh@336 -- # IFS=.-: 00:25:49.790 16:12:12 -- scripts/common.sh@336 -- # read -ra ver2 00:25:49.790 16:12:12 -- scripts/common.sh@337 -- # local 'op=<' 00:25:49.790 16:12:12 -- scripts/common.sh@339 -- # ver1_l=2 00:25:49.790 16:12:12 -- scripts/common.sh@340 -- # ver2_l=1 00:25:49.790 16:12:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:49.790 16:12:12 -- scripts/common.sh@343 -- # case "$op" in 00:25:49.790 16:12:12 -- scripts/common.sh@344 -- # : 1 00:25:49.790 16:12:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:49.790 16:12:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:49.790 16:12:12 -- scripts/common.sh@364 -- # decimal 1 00:25:49.790 16:12:12 -- scripts/common.sh@352 -- # local d=1 00:25:49.790 16:12:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:49.790 16:12:12 -- scripts/common.sh@354 -- # echo 1 00:25:49.790 16:12:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:49.790 16:12:12 -- scripts/common.sh@365 -- # decimal 2 00:25:49.790 16:12:12 -- scripts/common.sh@352 -- # local d=2 00:25:49.790 16:12:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:49.790 16:12:12 -- scripts/common.sh@354 -- # echo 2 00:25:49.790 16:12:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:49.790 16:12:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:49.790 16:12:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:49.790 16:12:12 -- scripts/common.sh@367 -- # return 0 00:25:49.790 16:12:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:49.790 16:12:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:49.790 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:49.790 --rc genhtml_branch_coverage=1 00:25:49.790 --rc genhtml_function_coverage=1 00:25:49.790 --rc genhtml_legend=1 00:25:49.790 --rc geninfo_all_blocks=1 00:25:49.790 --rc geninfo_unexecuted_blocks=1 00:25:49.790 00:25:49.790 ' 00:25:49.790 16:12:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:49.790 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:49.790 --rc genhtml_branch_coverage=1 00:25:49.790 --rc genhtml_function_coverage=1 00:25:49.790 --rc genhtml_legend=1 00:25:49.790 --rc geninfo_all_blocks=1 00:25:49.790 --rc geninfo_unexecuted_blocks=1 00:25:49.790 00:25:49.790 ' 00:25:49.790 16:12:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:49.790 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:49.790 --rc genhtml_branch_coverage=1 00:25:49.790 --rc genhtml_function_coverage=1 00:25:49.790 --rc genhtml_legend=1 00:25:49.790 --rc geninfo_all_blocks=1 00:25:49.790 --rc geninfo_unexecuted_blocks=1 00:25:49.790 00:25:49.790 ' 00:25:49.790 16:12:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:49.790 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:49.790 --rc genhtml_branch_coverage=1 00:25:49.790 --rc genhtml_function_coverage=1 00:25:49.790 --rc genhtml_legend=1 00:25:49.790 --rc geninfo_all_blocks=1 00:25:49.790 --rc geninfo_unexecuted_blocks=1 00:25:49.790 00:25:49.790 ' 00:25:49.790 16:12:12 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:49.790 16:12:12 -- nvmf/common.sh@7 -- # uname -s 00:25:49.790 16:12:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:49.790 16:12:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:49.790 16:12:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:49.790 16:12:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:49.790 16:12:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:49.790 16:12:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:49.790 16:12:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:49.790 16:12:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:49.790 16:12:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:49.790 16:12:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:49.790 16:12:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:49.790 16:12:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:49.790 16:12:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:49.790 16:12:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:49.790 16:12:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:49.790 16:12:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:49.790 16:12:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:49.790 16:12:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:49.790 16:12:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:49.790 16:12:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:49.790 16:12:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:49.791 16:12:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:49.791 16:12:12 -- paths/export.sh@5 -- # export PATH 00:25:49.791 16:12:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:49.791 16:12:12 -- nvmf/common.sh@46 -- # : 0 00:25:49.791 16:12:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:49.791 16:12:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:49.791 16:12:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:49.791 16:12:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:49.791 16:12:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:49.791 16:12:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:49.791 16:12:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:49.791 16:12:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:49.791 16:12:12 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:49.791 16:12:12 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:49.791 16:12:12 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:49.791 16:12:12 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:49.791 16:12:12 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:49.791 16:12:12 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:49.791 16:12:12 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:49.791 16:12:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:49.791 16:12:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:49.791 16:12:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:49.791 16:12:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:49.791 16:12:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:49.791 16:12:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:49.791 16:12:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:49.791 16:12:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:49.791 16:12:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:49.791 16:12:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:49.791 16:12:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:49.791 16:12:13 -- common/autotest_common.sh@10 -- # set +x 00:25:51.692 16:12:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:51.692 16:12:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:51.692 16:12:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:51.692 16:12:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:51.692 16:12:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:51.692 16:12:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:51.692 16:12:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:51.692 16:12:15 -- nvmf/common.sh@294 -- # net_devs=() 00:25:51.692 16:12:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:51.692 16:12:15 -- nvmf/common.sh@295 -- # e810=() 00:25:51.692 16:12:15 -- nvmf/common.sh@295 -- # local -ga e810 00:25:51.692 16:12:15 -- nvmf/common.sh@296 -- # x722=() 00:25:51.692 16:12:15 -- nvmf/common.sh@296 -- # local -ga x722 00:25:51.692 16:12:15 -- nvmf/common.sh@297 -- # mlx=() 00:25:51.692 16:12:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:51.692 16:12:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:51.692 16:12:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:51.692 16:12:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:51.692 16:12:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:51.692 16:12:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:51.692 16:12:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:51.692 16:12:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:51.692 16:12:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:51.692 16:12:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:51.692 16:12:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:51.692 16:12:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:51.692 16:12:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:51.692 16:12:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:51.692 16:12:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:51.692 16:12:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:51.692 16:12:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:51.692 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:51.692 16:12:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:51.692 16:12:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:51.692 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:51.692 16:12:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:51.692 16:12:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:51.692 16:12:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:51.692 16:12:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:51.692 16:12:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:51.692 16:12:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:51.692 16:12:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:51.692 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:51.692 16:12:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:51.692 16:12:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:51.693 16:12:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:51.693 16:12:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:51.693 16:12:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:51.693 16:12:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:51.693 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:51.693 16:12:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:51.693 16:12:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:51.693 16:12:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:51.693 16:12:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:51.693 16:12:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:51.693 16:12:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:51.693 16:12:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:51.693 16:12:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:51.693 16:12:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:51.693 16:12:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:51.693 16:12:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:51.693 16:12:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:51.693 16:12:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:51.693 16:12:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:51.693 16:12:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:51.693 16:12:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:51.693 16:12:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:51.693 16:12:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:51.693 16:12:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:51.693 16:12:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:51.693 16:12:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:51.693 16:12:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:51.693 16:12:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:51.693 16:12:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:51.693 16:12:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:51.693 16:12:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:51.693 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:51.693 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:25:51.693 00:25:51.693 --- 10.0.0.2 ping statistics --- 00:25:51.693 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:51.693 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:25:51.693 16:12:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:51.693 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:51.693 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:25:51.693 00:25:51.693 --- 10.0.0.1 ping statistics --- 00:25:51.693 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:51.693 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:25:51.693 16:12:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:51.693 16:12:15 -- nvmf/common.sh@410 -- # return 0 00:25:51.693 16:12:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:51.693 16:12:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:51.693 16:12:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:51.693 16:12:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:51.693 16:12:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:51.693 16:12:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:51.693 16:12:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:51.693 16:12:15 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:51.693 16:12:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:51.693 16:12:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:51.693 16:12:15 -- common/autotest_common.sh@10 -- # set +x 00:25:51.693 16:12:15 -- nvmf/common.sh@469 -- # nvmfpid=1664647 00:25:51.693 16:12:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:51.693 16:12:15 -- nvmf/common.sh@470 -- # waitforlisten 1664647 00:25:51.693 16:12:15 -- common/autotest_common.sh@829 -- # '[' -z 1664647 ']' 00:25:51.693 16:12:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:51.693 16:12:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:51.693 16:12:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:51.693 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:51.693 16:12:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:51.693 16:12:15 -- common/autotest_common.sh@10 -- # set +x 00:25:51.693 [2024-11-18 16:12:15.260518] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:51.693 [2024-11-18 16:12:15.260619] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:51.951 EAL: No free 2048 kB hugepages reported on node 1 00:25:51.951 [2024-11-18 16:12:15.335353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:51.951 [2024-11-18 16:12:15.424565] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:51.951 [2024-11-18 16:12:15.424741] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:51.951 [2024-11-18 16:12:15.424760] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:51.951 [2024-11-18 16:12:15.424772] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:51.951 [2024-11-18 16:12:15.424878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:51.951 [2024-11-18 16:12:15.425034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:51.951 [2024-11-18 16:12:15.425038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:52.884 16:12:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:52.884 16:12:16 -- common/autotest_common.sh@862 -- # return 0 00:25:52.884 16:12:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:52.884 16:12:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:52.884 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.884 16:12:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:52.884 16:12:16 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:52.884 16:12:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.884 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.884 [2024-11-18 16:12:16.302042] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:52.884 16:12:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.884 16:12:16 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:52.884 16:12:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.884 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.884 Malloc0 00:25:52.884 16:12:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.884 16:12:16 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:52.884 16:12:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.884 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.884 16:12:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.884 16:12:16 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:52.884 16:12:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.884 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.884 16:12:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.884 16:12:16 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:52.884 16:12:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.884 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.884 [2024-11-18 16:12:16.369229] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:52.884 16:12:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.884 16:12:16 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:52.884 16:12:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.884 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.884 [2024-11-18 16:12:16.377127] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:52.885 16:12:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.885 16:12:16 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:52.885 16:12:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.885 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.885 Malloc1 00:25:52.885 16:12:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.885 16:12:16 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:52.885 16:12:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.885 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.885 16:12:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.885 16:12:16 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:52.885 16:12:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.885 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.885 16:12:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.885 16:12:16 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:52.885 16:12:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.885 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.885 16:12:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.885 16:12:16 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:52.885 16:12:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.885 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:52.885 16:12:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.885 16:12:16 -- host/multicontroller.sh@44 -- # bdevperf_pid=1664894 00:25:52.885 16:12:16 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:52.885 16:12:16 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:52.885 16:12:16 -- host/multicontroller.sh@47 -- # waitforlisten 1664894 /var/tmp/bdevperf.sock 00:25:52.885 16:12:16 -- common/autotest_common.sh@829 -- # '[' -z 1664894 ']' 00:25:52.885 16:12:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:52.885 16:12:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:52.885 16:12:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:52.885 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:52.885 16:12:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:52.885 16:12:16 -- common/autotest_common.sh@10 -- # set +x 00:25:54.257 16:12:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:54.257 16:12:17 -- common/autotest_common.sh@862 -- # return 0 00:25:54.257 16:12:17 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:54.257 16:12:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.257 16:12:17 -- common/autotest_common.sh@10 -- # set +x 00:25:54.257 NVMe0n1 00:25:54.257 16:12:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.257 16:12:17 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:54.257 16:12:17 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:54.257 16:12:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.257 16:12:17 -- common/autotest_common.sh@10 -- # set +x 00:25:54.257 16:12:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.257 1 00:25:54.257 16:12:17 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:54.257 16:12:17 -- common/autotest_common.sh@650 -- # local es=0 00:25:54.257 16:12:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:54.257 16:12:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:54.257 16:12:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.257 16:12:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:54.257 16:12:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.257 16:12:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:54.257 16:12:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.257 16:12:17 -- common/autotest_common.sh@10 -- # set +x 00:25:54.257 request: 00:25:54.257 { 00:25:54.257 "name": "NVMe0", 00:25:54.257 "trtype": "tcp", 00:25:54.257 "traddr": "10.0.0.2", 00:25:54.258 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:54.258 "hostaddr": "10.0.0.2", 00:25:54.258 "hostsvcid": "60000", 00:25:54.258 "adrfam": "ipv4", 00:25:54.258 "trsvcid": "4420", 00:25:54.258 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:54.258 "method": "bdev_nvme_attach_controller", 00:25:54.258 "req_id": 1 00:25:54.258 } 00:25:54.258 Got JSON-RPC error response 00:25:54.258 response: 00:25:54.258 { 00:25:54.258 "code": -114, 00:25:54.258 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:54.258 } 00:25:54.258 16:12:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:54.258 16:12:17 -- common/autotest_common.sh@653 -- # es=1 00:25:54.258 16:12:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:54.258 16:12:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:54.258 16:12:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:54.258 16:12:17 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:54.258 16:12:17 -- common/autotest_common.sh@650 -- # local es=0 00:25:54.258 16:12:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:54.258 16:12:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:54.258 16:12:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.258 16:12:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:54.258 16:12:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.258 16:12:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:54.258 16:12:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.258 16:12:17 -- common/autotest_common.sh@10 -- # set +x 00:25:54.258 request: 00:25:54.258 { 00:25:54.258 "name": "NVMe0", 00:25:54.258 "trtype": "tcp", 00:25:54.258 "traddr": "10.0.0.2", 00:25:54.258 "hostaddr": "10.0.0.2", 00:25:54.258 "hostsvcid": "60000", 00:25:54.258 "adrfam": "ipv4", 00:25:54.258 "trsvcid": "4420", 00:25:54.258 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:54.258 "method": "bdev_nvme_attach_controller", 00:25:54.258 "req_id": 1 00:25:54.258 } 00:25:54.258 Got JSON-RPC error response 00:25:54.258 response: 00:25:54.258 { 00:25:54.258 "code": -114, 00:25:54.258 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:54.258 } 00:25:54.258 16:12:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:54.258 16:12:17 -- common/autotest_common.sh@653 -- # es=1 00:25:54.258 16:12:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:54.258 16:12:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:54.258 16:12:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:54.258 16:12:17 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:54.258 16:12:17 -- common/autotest_common.sh@650 -- # local es=0 00:25:54.258 16:12:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:54.258 16:12:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:54.258 16:12:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.258 16:12:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:54.258 16:12:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.258 16:12:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:54.258 16:12:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.258 16:12:17 -- common/autotest_common.sh@10 -- # set +x 00:25:54.258 request: 00:25:54.258 { 00:25:54.258 "name": "NVMe0", 00:25:54.258 "trtype": "tcp", 00:25:54.258 "traddr": "10.0.0.2", 00:25:54.258 "hostaddr": "10.0.0.2", 00:25:54.258 "hostsvcid": "60000", 00:25:54.258 "adrfam": "ipv4", 00:25:54.258 "trsvcid": "4420", 00:25:54.258 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:54.258 "multipath": "disable", 00:25:54.258 "method": "bdev_nvme_attach_controller", 00:25:54.258 "req_id": 1 00:25:54.258 } 00:25:54.258 Got JSON-RPC error response 00:25:54.258 response: 00:25:54.258 { 00:25:54.258 "code": -114, 00:25:54.258 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:54.258 } 00:25:54.258 16:12:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:54.258 16:12:17 -- common/autotest_common.sh@653 -- # es=1 00:25:54.258 16:12:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:54.258 16:12:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:54.258 16:12:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:54.258 16:12:17 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:54.258 16:12:17 -- common/autotest_common.sh@650 -- # local es=0 00:25:54.258 16:12:17 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:54.258 16:12:17 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:54.258 16:12:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.258 16:12:17 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:54.258 16:12:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.258 16:12:17 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:54.258 16:12:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.258 16:12:17 -- common/autotest_common.sh@10 -- # set +x 00:25:54.258 request: 00:25:54.258 { 00:25:54.258 "name": "NVMe0", 00:25:54.258 "trtype": "tcp", 00:25:54.258 "traddr": "10.0.0.2", 00:25:54.258 "hostaddr": "10.0.0.2", 00:25:54.258 "hostsvcid": "60000", 00:25:54.258 "adrfam": "ipv4", 00:25:54.258 "trsvcid": "4420", 00:25:54.258 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:54.258 "multipath": "failover", 00:25:54.258 "method": "bdev_nvme_attach_controller", 00:25:54.258 "req_id": 1 00:25:54.258 } 00:25:54.258 Got JSON-RPC error response 00:25:54.258 response: 00:25:54.258 { 00:25:54.258 "code": -114, 00:25:54.258 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:54.258 } 00:25:54.258 16:12:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:54.258 16:12:17 -- common/autotest_common.sh@653 -- # es=1 00:25:54.258 16:12:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:54.258 16:12:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:54.258 16:12:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:54.258 16:12:17 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:54.258 16:12:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.258 16:12:17 -- common/autotest_common.sh@10 -- # set +x 00:25:54.258 00:25:54.258 16:12:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.258 16:12:17 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:54.258 16:12:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.258 16:12:17 -- common/autotest_common.sh@10 -- # set +x 00:25:54.258 16:12:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.258 16:12:17 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:54.258 16:12:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.258 16:12:17 -- common/autotest_common.sh@10 -- # set +x 00:25:54.258 00:25:54.258 16:12:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.258 16:12:17 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:54.258 16:12:17 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:54.258 16:12:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.258 16:12:17 -- common/autotest_common.sh@10 -- # set +x 00:25:54.258 16:12:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.258 16:12:17 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:54.258 16:12:17 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:55.632 0 00:25:55.632 16:12:18 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:55.632 16:12:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.632 16:12:18 -- common/autotest_common.sh@10 -- # set +x 00:25:55.632 16:12:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.632 16:12:18 -- host/multicontroller.sh@100 -- # killprocess 1664894 00:25:55.632 16:12:18 -- common/autotest_common.sh@936 -- # '[' -z 1664894 ']' 00:25:55.632 16:12:18 -- common/autotest_common.sh@940 -- # kill -0 1664894 00:25:55.632 16:12:18 -- common/autotest_common.sh@941 -- # uname 00:25:55.632 16:12:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:55.632 16:12:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1664894 00:25:55.632 16:12:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:55.632 16:12:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:55.632 16:12:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1664894' 00:25:55.632 killing process with pid 1664894 00:25:55.632 16:12:18 -- common/autotest_common.sh@955 -- # kill 1664894 00:25:55.632 16:12:18 -- common/autotest_common.sh@960 -- # wait 1664894 00:25:55.632 16:12:19 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:55.632 16:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.632 16:12:19 -- common/autotest_common.sh@10 -- # set +x 00:25:55.632 16:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.632 16:12:19 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:55.632 16:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:55.632 16:12:19 -- common/autotest_common.sh@10 -- # set +x 00:25:55.632 16:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:55.632 16:12:19 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:55.632 16:12:19 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:55.632 16:12:19 -- common/autotest_common.sh@1607 -- # read -r file 00:25:55.632 16:12:19 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:55.632 16:12:19 -- common/autotest_common.sh@1606 -- # sort -u 00:25:55.632 16:12:19 -- common/autotest_common.sh@1608 -- # cat 00:25:55.632 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:55.632 [2024-11-18 16:12:16.476407] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:55.632 [2024-11-18 16:12:16.476494] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1664894 ] 00:25:55.632 EAL: No free 2048 kB hugepages reported on node 1 00:25:55.632 [2024-11-18 16:12:16.538968] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:55.632 [2024-11-18 16:12:16.623529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:55.632 [2024-11-18 16:12:17.697678] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name e35e9dd4-ccc8-4937-81a1-3ba15aee0224 already exists 00:25:55.632 [2024-11-18 16:12:17.697718] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:e35e9dd4-ccc8-4937-81a1-3ba15aee0224 alias for bdev NVMe1n1 00:25:55.632 [2024-11-18 16:12:17.697736] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:55.632 Running I/O for 1 seconds... 00:25:55.632 00:25:55.632 Latency(us) 00:25:55.632 [2024-11-18T15:12:19.223Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:55.632 [2024-11-18T15:12:19.223Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:55.632 NVMe0n1 : 1.01 19187.02 74.95 0.00 0.00 6662.04 5461.33 12913.02 00:25:55.632 [2024-11-18T15:12:19.223Z] =================================================================================================================== 00:25:55.632 [2024-11-18T15:12:19.223Z] Total : 19187.02 74.95 0.00 0.00 6662.04 5461.33 12913.02 00:25:55.632 Received shutdown signal, test time was about 1.000000 seconds 00:25:55.632 00:25:55.632 Latency(us) 00:25:55.632 [2024-11-18T15:12:19.223Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:55.632 [2024-11-18T15:12:19.223Z] =================================================================================================================== 00:25:55.632 [2024-11-18T15:12:19.223Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:55.632 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:55.632 16:12:19 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:55.632 16:12:19 -- common/autotest_common.sh@1607 -- # read -r file 00:25:55.632 16:12:19 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:55.632 16:12:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:55.632 16:12:19 -- nvmf/common.sh@116 -- # sync 00:25:55.632 16:12:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:55.632 16:12:19 -- nvmf/common.sh@119 -- # set +e 00:25:55.632 16:12:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:55.632 16:12:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:55.632 rmmod nvme_tcp 00:25:55.632 rmmod nvme_fabrics 00:25:55.632 rmmod nvme_keyring 00:25:55.890 16:12:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:55.890 16:12:19 -- nvmf/common.sh@123 -- # set -e 00:25:55.890 16:12:19 -- nvmf/common.sh@124 -- # return 0 00:25:55.890 16:12:19 -- nvmf/common.sh@477 -- # '[' -n 1664647 ']' 00:25:55.890 16:12:19 -- nvmf/common.sh@478 -- # killprocess 1664647 00:25:55.890 16:12:19 -- common/autotest_common.sh@936 -- # '[' -z 1664647 ']' 00:25:55.890 16:12:19 -- common/autotest_common.sh@940 -- # kill -0 1664647 00:25:55.890 16:12:19 -- common/autotest_common.sh@941 -- # uname 00:25:55.890 16:12:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:55.890 16:12:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1664647 00:25:55.890 16:12:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:55.890 16:12:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:55.890 16:12:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1664647' 00:25:55.890 killing process with pid 1664647 00:25:55.890 16:12:19 -- common/autotest_common.sh@955 -- # kill 1664647 00:25:55.890 16:12:19 -- common/autotest_common.sh@960 -- # wait 1664647 00:25:56.148 16:12:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:56.148 16:12:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:56.148 16:12:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:56.148 16:12:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:56.148 16:12:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:56.148 16:12:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:56.148 16:12:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:56.148 16:12:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:58.166 16:12:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:58.166 00:25:58.166 real 0m8.762s 00:25:58.166 user 0m16.326s 00:25:58.166 sys 0m2.360s 00:25:58.166 16:12:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:58.166 16:12:21 -- common/autotest_common.sh@10 -- # set +x 00:25:58.166 ************************************ 00:25:58.166 END TEST nvmf_multicontroller 00:25:58.166 ************************************ 00:25:58.166 16:12:21 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:58.166 16:12:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:58.166 16:12:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:58.166 16:12:21 -- common/autotest_common.sh@10 -- # set +x 00:25:58.166 ************************************ 00:25:58.166 START TEST nvmf_aer 00:25:58.166 ************************************ 00:25:58.166 16:12:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:58.166 * Looking for test storage... 00:25:58.166 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:58.166 16:12:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:58.166 16:12:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:58.166 16:12:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:58.424 16:12:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:58.424 16:12:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:58.424 16:12:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:58.424 16:12:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:58.424 16:12:21 -- scripts/common.sh@335 -- # IFS=.-: 00:25:58.424 16:12:21 -- scripts/common.sh@335 -- # read -ra ver1 00:25:58.424 16:12:21 -- scripts/common.sh@336 -- # IFS=.-: 00:25:58.424 16:12:21 -- scripts/common.sh@336 -- # read -ra ver2 00:25:58.424 16:12:21 -- scripts/common.sh@337 -- # local 'op=<' 00:25:58.424 16:12:21 -- scripts/common.sh@339 -- # ver1_l=2 00:25:58.424 16:12:21 -- scripts/common.sh@340 -- # ver2_l=1 00:25:58.424 16:12:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:58.424 16:12:21 -- scripts/common.sh@343 -- # case "$op" in 00:25:58.424 16:12:21 -- scripts/common.sh@344 -- # : 1 00:25:58.424 16:12:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:58.424 16:12:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:58.424 16:12:21 -- scripts/common.sh@364 -- # decimal 1 00:25:58.424 16:12:21 -- scripts/common.sh@352 -- # local d=1 00:25:58.424 16:12:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:58.424 16:12:21 -- scripts/common.sh@354 -- # echo 1 00:25:58.424 16:12:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:58.424 16:12:21 -- scripts/common.sh@365 -- # decimal 2 00:25:58.424 16:12:21 -- scripts/common.sh@352 -- # local d=2 00:25:58.424 16:12:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:58.424 16:12:21 -- scripts/common.sh@354 -- # echo 2 00:25:58.424 16:12:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:58.424 16:12:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:58.424 16:12:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:58.424 16:12:21 -- scripts/common.sh@367 -- # return 0 00:25:58.424 16:12:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:58.424 16:12:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:58.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:58.424 --rc genhtml_branch_coverage=1 00:25:58.424 --rc genhtml_function_coverage=1 00:25:58.424 --rc genhtml_legend=1 00:25:58.424 --rc geninfo_all_blocks=1 00:25:58.424 --rc geninfo_unexecuted_blocks=1 00:25:58.424 00:25:58.424 ' 00:25:58.424 16:12:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:58.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:58.424 --rc genhtml_branch_coverage=1 00:25:58.424 --rc genhtml_function_coverage=1 00:25:58.424 --rc genhtml_legend=1 00:25:58.424 --rc geninfo_all_blocks=1 00:25:58.424 --rc geninfo_unexecuted_blocks=1 00:25:58.424 00:25:58.424 ' 00:25:58.424 16:12:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:58.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:58.424 --rc genhtml_branch_coverage=1 00:25:58.424 --rc genhtml_function_coverage=1 00:25:58.424 --rc genhtml_legend=1 00:25:58.424 --rc geninfo_all_blocks=1 00:25:58.424 --rc geninfo_unexecuted_blocks=1 00:25:58.424 00:25:58.424 ' 00:25:58.424 16:12:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:58.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:58.424 --rc genhtml_branch_coverage=1 00:25:58.424 --rc genhtml_function_coverage=1 00:25:58.424 --rc genhtml_legend=1 00:25:58.424 --rc geninfo_all_blocks=1 00:25:58.424 --rc geninfo_unexecuted_blocks=1 00:25:58.424 00:25:58.424 ' 00:25:58.424 16:12:21 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:58.424 16:12:21 -- nvmf/common.sh@7 -- # uname -s 00:25:58.425 16:12:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:58.425 16:12:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:58.425 16:12:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:58.425 16:12:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:58.425 16:12:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:58.425 16:12:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:58.425 16:12:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:58.425 16:12:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:58.425 16:12:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:58.425 16:12:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:58.425 16:12:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:58.425 16:12:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:58.425 16:12:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:58.425 16:12:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:58.425 16:12:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:58.425 16:12:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:58.425 16:12:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:58.425 16:12:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:58.425 16:12:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:58.425 16:12:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.425 16:12:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.425 16:12:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.425 16:12:21 -- paths/export.sh@5 -- # export PATH 00:25:58.425 16:12:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:58.425 16:12:21 -- nvmf/common.sh@46 -- # : 0 00:25:58.425 16:12:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:58.425 16:12:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:58.425 16:12:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:58.425 16:12:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:58.425 16:12:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:58.425 16:12:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:58.425 16:12:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:58.425 16:12:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:58.425 16:12:21 -- host/aer.sh@11 -- # nvmftestinit 00:25:58.425 16:12:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:58.425 16:12:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:58.425 16:12:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:58.425 16:12:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:58.425 16:12:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:58.425 16:12:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:58.425 16:12:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:58.425 16:12:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:58.425 16:12:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:58.425 16:12:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:58.425 16:12:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:58.425 16:12:21 -- common/autotest_common.sh@10 -- # set +x 00:26:00.325 16:12:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:00.325 16:12:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:00.325 16:12:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:00.325 16:12:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:00.325 16:12:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:00.325 16:12:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:00.325 16:12:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:00.326 16:12:23 -- nvmf/common.sh@294 -- # net_devs=() 00:26:00.326 16:12:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:00.326 16:12:23 -- nvmf/common.sh@295 -- # e810=() 00:26:00.326 16:12:23 -- nvmf/common.sh@295 -- # local -ga e810 00:26:00.326 16:12:23 -- nvmf/common.sh@296 -- # x722=() 00:26:00.326 16:12:23 -- nvmf/common.sh@296 -- # local -ga x722 00:26:00.326 16:12:23 -- nvmf/common.sh@297 -- # mlx=() 00:26:00.326 16:12:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:00.326 16:12:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:00.326 16:12:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:00.326 16:12:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:00.326 16:12:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:00.326 16:12:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:00.326 16:12:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:00.326 16:12:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:00.326 16:12:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:00.326 16:12:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:00.326 16:12:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:00.326 16:12:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:00.326 16:12:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:00.326 16:12:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:00.326 16:12:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:00.326 16:12:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:00.326 16:12:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:00.326 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:00.326 16:12:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:00.326 16:12:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:00.326 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:00.326 16:12:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:00.326 16:12:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:00.326 16:12:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:00.326 16:12:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:00.326 16:12:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:00.326 16:12:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:00.326 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:00.326 16:12:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:00.326 16:12:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:00.326 16:12:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:00.326 16:12:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:00.326 16:12:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:00.326 16:12:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:00.326 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:00.326 16:12:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:00.326 16:12:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:00.326 16:12:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:00.326 16:12:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:00.326 16:12:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:00.326 16:12:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:00.326 16:12:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:00.326 16:12:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:00.326 16:12:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:00.326 16:12:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:00.326 16:12:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:00.326 16:12:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:00.326 16:12:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:00.326 16:12:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:00.326 16:12:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:00.326 16:12:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:00.326 16:12:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:00.326 16:12:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:00.584 16:12:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:00.584 16:12:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:00.584 16:12:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:00.584 16:12:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:00.584 16:12:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:00.584 16:12:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:00.584 16:12:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:00.584 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:00.584 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:26:00.584 00:26:00.584 --- 10.0.0.2 ping statistics --- 00:26:00.584 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:00.584 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:26:00.584 16:12:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:00.584 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:00.584 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:26:00.584 00:26:00.584 --- 10.0.0.1 ping statistics --- 00:26:00.584 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:00.584 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:26:00.584 16:12:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:00.584 16:12:23 -- nvmf/common.sh@410 -- # return 0 00:26:00.584 16:12:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:00.584 16:12:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:00.584 16:12:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:00.584 16:12:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:00.584 16:12:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:00.584 16:12:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:00.584 16:12:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:00.584 16:12:24 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:26:00.584 16:12:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:00.584 16:12:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:00.584 16:12:24 -- common/autotest_common.sh@10 -- # set +x 00:26:00.584 16:12:24 -- nvmf/common.sh@469 -- # nvmfpid=1667173 00:26:00.584 16:12:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:00.584 16:12:24 -- nvmf/common.sh@470 -- # waitforlisten 1667173 00:26:00.584 16:12:24 -- common/autotest_common.sh@829 -- # '[' -z 1667173 ']' 00:26:00.584 16:12:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:00.584 16:12:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:00.584 16:12:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:00.584 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:00.584 16:12:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:00.584 16:12:24 -- common/autotest_common.sh@10 -- # set +x 00:26:00.584 [2024-11-18 16:12:24.072904] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:00.584 [2024-11-18 16:12:24.073005] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:00.584 EAL: No free 2048 kB hugepages reported on node 1 00:26:00.585 [2024-11-18 16:12:24.136757] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:00.843 [2024-11-18 16:12:24.223334] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:00.843 [2024-11-18 16:12:24.223467] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:00.843 [2024-11-18 16:12:24.223485] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:00.843 [2024-11-18 16:12:24.223498] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:00.843 [2024-11-18 16:12:24.223549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:00.843 [2024-11-18 16:12:24.223578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:00.843 [2024-11-18 16:12:24.223657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:00.843 [2024-11-18 16:12:24.223660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:01.778 16:12:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:01.778 16:12:25 -- common/autotest_common.sh@862 -- # return 0 00:26:01.778 16:12:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:01.778 16:12:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:01.778 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:01.778 16:12:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:01.778 16:12:25 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:01.778 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.778 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:01.778 [2024-11-18 16:12:25.099384] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:01.778 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.778 16:12:25 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:26:01.778 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.778 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:01.778 Malloc0 00:26:01.778 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.778 16:12:25 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:26:01.778 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.778 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:01.778 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.778 16:12:25 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:01.778 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.778 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:01.778 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.778 16:12:25 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:01.778 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.778 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:01.778 [2024-11-18 16:12:25.153087] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:01.778 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.778 16:12:25 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:26:01.778 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.778 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:01.778 [2024-11-18 16:12:25.160794] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:01.778 [ 00:26:01.778 { 00:26:01.778 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:01.778 "subtype": "Discovery", 00:26:01.778 "listen_addresses": [], 00:26:01.778 "allow_any_host": true, 00:26:01.778 "hosts": [] 00:26:01.778 }, 00:26:01.778 { 00:26:01.778 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:01.778 "subtype": "NVMe", 00:26:01.778 "listen_addresses": [ 00:26:01.778 { 00:26:01.778 "transport": "TCP", 00:26:01.778 "trtype": "TCP", 00:26:01.778 "adrfam": "IPv4", 00:26:01.778 "traddr": "10.0.0.2", 00:26:01.778 "trsvcid": "4420" 00:26:01.778 } 00:26:01.778 ], 00:26:01.778 "allow_any_host": true, 00:26:01.778 "hosts": [], 00:26:01.778 "serial_number": "SPDK00000000000001", 00:26:01.778 "model_number": "SPDK bdev Controller", 00:26:01.778 "max_namespaces": 2, 00:26:01.778 "min_cntlid": 1, 00:26:01.778 "max_cntlid": 65519, 00:26:01.778 "namespaces": [ 00:26:01.778 { 00:26:01.778 "nsid": 1, 00:26:01.778 "bdev_name": "Malloc0", 00:26:01.778 "name": "Malloc0", 00:26:01.778 "nguid": "ABF2F200D0F24738B584304CDC29E815", 00:26:01.778 "uuid": "abf2f200-d0f2-4738-b584-304cdc29e815" 00:26:01.778 } 00:26:01.778 ] 00:26:01.778 } 00:26:01.778 ] 00:26:01.778 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.778 16:12:25 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:26:01.778 16:12:25 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:26:01.778 16:12:25 -- host/aer.sh@33 -- # aerpid=1667333 00:26:01.778 16:12:25 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:26:01.778 16:12:25 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:26:01.778 16:12:25 -- common/autotest_common.sh@1254 -- # local i=0 00:26:01.779 16:12:25 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:01.779 16:12:25 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:26:01.779 16:12:25 -- common/autotest_common.sh@1257 -- # i=1 00:26:01.779 16:12:25 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:26:01.779 EAL: No free 2048 kB hugepages reported on node 1 00:26:01.779 16:12:25 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:01.779 16:12:25 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:26:01.779 16:12:25 -- common/autotest_common.sh@1257 -- # i=2 00:26:01.779 16:12:25 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:26:02.037 16:12:25 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:02.037 16:12:25 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:02.037 16:12:25 -- common/autotest_common.sh@1265 -- # return 0 00:26:02.037 16:12:25 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:26:02.037 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.037 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:02.037 Malloc1 00:26:02.037 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.037 16:12:25 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:26:02.037 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.037 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:02.037 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.037 16:12:25 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:26:02.037 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.037 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:02.037 Asynchronous Event Request test 00:26:02.037 Attaching to 10.0.0.2 00:26:02.037 Attached to 10.0.0.2 00:26:02.037 Registering asynchronous event callbacks... 00:26:02.037 Starting namespace attribute notice tests for all controllers... 00:26:02.037 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:26:02.037 aer_cb - Changed Namespace 00:26:02.037 Cleaning up... 00:26:02.037 [ 00:26:02.037 { 00:26:02.037 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:02.037 "subtype": "Discovery", 00:26:02.037 "listen_addresses": [], 00:26:02.037 "allow_any_host": true, 00:26:02.037 "hosts": [] 00:26:02.037 }, 00:26:02.037 { 00:26:02.037 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:02.037 "subtype": "NVMe", 00:26:02.037 "listen_addresses": [ 00:26:02.037 { 00:26:02.037 "transport": "TCP", 00:26:02.037 "trtype": "TCP", 00:26:02.037 "adrfam": "IPv4", 00:26:02.037 "traddr": "10.0.0.2", 00:26:02.037 "trsvcid": "4420" 00:26:02.037 } 00:26:02.037 ], 00:26:02.037 "allow_any_host": true, 00:26:02.037 "hosts": [], 00:26:02.037 "serial_number": "SPDK00000000000001", 00:26:02.037 "model_number": "SPDK bdev Controller", 00:26:02.037 "max_namespaces": 2, 00:26:02.037 "min_cntlid": 1, 00:26:02.037 "max_cntlid": 65519, 00:26:02.037 "namespaces": [ 00:26:02.037 { 00:26:02.037 "nsid": 1, 00:26:02.037 "bdev_name": "Malloc0", 00:26:02.037 "name": "Malloc0", 00:26:02.037 "nguid": "ABF2F200D0F24738B584304CDC29E815", 00:26:02.037 "uuid": "abf2f200-d0f2-4738-b584-304cdc29e815" 00:26:02.037 }, 00:26:02.037 { 00:26:02.037 "nsid": 2, 00:26:02.037 "bdev_name": "Malloc1", 00:26:02.037 "name": "Malloc1", 00:26:02.037 "nguid": "3523DFB03EB443B2AE496B6FA41C63D7", 00:26:02.037 "uuid": "3523dfb0-3eb4-43b2-ae49-6b6fa41c63d7" 00:26:02.037 } 00:26:02.037 ] 00:26:02.037 } 00:26:02.037 ] 00:26:02.037 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.037 16:12:25 -- host/aer.sh@43 -- # wait 1667333 00:26:02.037 16:12:25 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:26:02.037 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.037 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:02.037 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.037 16:12:25 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:26:02.037 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.037 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:02.037 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.037 16:12:25 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:02.037 16:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.037 16:12:25 -- common/autotest_common.sh@10 -- # set +x 00:26:02.037 16:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.037 16:12:25 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:26:02.037 16:12:25 -- host/aer.sh@51 -- # nvmftestfini 00:26:02.037 16:12:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:02.037 16:12:25 -- nvmf/common.sh@116 -- # sync 00:26:02.037 16:12:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:02.037 16:12:25 -- nvmf/common.sh@119 -- # set +e 00:26:02.037 16:12:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:02.037 16:12:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:02.037 rmmod nvme_tcp 00:26:02.037 rmmod nvme_fabrics 00:26:02.037 rmmod nvme_keyring 00:26:02.037 16:12:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:02.037 16:12:25 -- nvmf/common.sh@123 -- # set -e 00:26:02.037 16:12:25 -- nvmf/common.sh@124 -- # return 0 00:26:02.037 16:12:25 -- nvmf/common.sh@477 -- # '[' -n 1667173 ']' 00:26:02.037 16:12:25 -- nvmf/common.sh@478 -- # killprocess 1667173 00:26:02.037 16:12:25 -- common/autotest_common.sh@936 -- # '[' -z 1667173 ']' 00:26:02.037 16:12:25 -- common/autotest_common.sh@940 -- # kill -0 1667173 00:26:02.037 16:12:25 -- common/autotest_common.sh@941 -- # uname 00:26:02.037 16:12:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:02.037 16:12:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1667173 00:26:02.037 16:12:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:02.037 16:12:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:02.037 16:12:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1667173' 00:26:02.037 killing process with pid 1667173 00:26:02.037 16:12:25 -- common/autotest_common.sh@955 -- # kill 1667173 00:26:02.037 [2024-11-18 16:12:25.623556] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:02.037 16:12:25 -- common/autotest_common.sh@960 -- # wait 1667173 00:26:02.295 16:12:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:02.295 16:12:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:02.295 16:12:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:02.295 16:12:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:02.295 16:12:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:02.295 16:12:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:02.295 16:12:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:02.295 16:12:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:04.826 16:12:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:04.826 00:26:04.826 real 0m6.236s 00:26:04.826 user 0m7.423s 00:26:04.826 sys 0m1.998s 00:26:04.826 16:12:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:04.826 16:12:27 -- common/autotest_common.sh@10 -- # set +x 00:26:04.826 ************************************ 00:26:04.826 END TEST nvmf_aer 00:26:04.826 ************************************ 00:26:04.826 16:12:27 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:04.826 16:12:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:04.826 16:12:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:04.826 16:12:27 -- common/autotest_common.sh@10 -- # set +x 00:26:04.826 ************************************ 00:26:04.826 START TEST nvmf_async_init 00:26:04.826 ************************************ 00:26:04.826 16:12:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:26:04.826 * Looking for test storage... 00:26:04.826 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:04.826 16:12:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:04.826 16:12:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:04.826 16:12:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:04.827 16:12:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:04.827 16:12:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:04.827 16:12:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:04.827 16:12:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:04.827 16:12:28 -- scripts/common.sh@335 -- # IFS=.-: 00:26:04.827 16:12:28 -- scripts/common.sh@335 -- # read -ra ver1 00:26:04.827 16:12:28 -- scripts/common.sh@336 -- # IFS=.-: 00:26:04.827 16:12:28 -- scripts/common.sh@336 -- # read -ra ver2 00:26:04.827 16:12:28 -- scripts/common.sh@337 -- # local 'op=<' 00:26:04.827 16:12:28 -- scripts/common.sh@339 -- # ver1_l=2 00:26:04.827 16:12:28 -- scripts/common.sh@340 -- # ver2_l=1 00:26:04.827 16:12:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:04.827 16:12:28 -- scripts/common.sh@343 -- # case "$op" in 00:26:04.827 16:12:28 -- scripts/common.sh@344 -- # : 1 00:26:04.827 16:12:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:04.827 16:12:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:04.827 16:12:28 -- scripts/common.sh@364 -- # decimal 1 00:26:04.827 16:12:28 -- scripts/common.sh@352 -- # local d=1 00:26:04.827 16:12:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:04.827 16:12:28 -- scripts/common.sh@354 -- # echo 1 00:26:04.827 16:12:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:04.827 16:12:28 -- scripts/common.sh@365 -- # decimal 2 00:26:04.827 16:12:28 -- scripts/common.sh@352 -- # local d=2 00:26:04.827 16:12:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:04.827 16:12:28 -- scripts/common.sh@354 -- # echo 2 00:26:04.827 16:12:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:04.827 16:12:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:04.827 16:12:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:04.827 16:12:28 -- scripts/common.sh@367 -- # return 0 00:26:04.827 16:12:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:04.827 16:12:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:04.827 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:04.827 --rc genhtml_branch_coverage=1 00:26:04.827 --rc genhtml_function_coverage=1 00:26:04.827 --rc genhtml_legend=1 00:26:04.827 --rc geninfo_all_blocks=1 00:26:04.827 --rc geninfo_unexecuted_blocks=1 00:26:04.827 00:26:04.827 ' 00:26:04.827 16:12:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:04.827 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:04.827 --rc genhtml_branch_coverage=1 00:26:04.827 --rc genhtml_function_coverage=1 00:26:04.827 --rc genhtml_legend=1 00:26:04.827 --rc geninfo_all_blocks=1 00:26:04.827 --rc geninfo_unexecuted_blocks=1 00:26:04.827 00:26:04.827 ' 00:26:04.827 16:12:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:04.827 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:04.827 --rc genhtml_branch_coverage=1 00:26:04.827 --rc genhtml_function_coverage=1 00:26:04.827 --rc genhtml_legend=1 00:26:04.827 --rc geninfo_all_blocks=1 00:26:04.827 --rc geninfo_unexecuted_blocks=1 00:26:04.827 00:26:04.827 ' 00:26:04.827 16:12:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:04.827 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:04.827 --rc genhtml_branch_coverage=1 00:26:04.827 --rc genhtml_function_coverage=1 00:26:04.827 --rc genhtml_legend=1 00:26:04.827 --rc geninfo_all_blocks=1 00:26:04.827 --rc geninfo_unexecuted_blocks=1 00:26:04.827 00:26:04.827 ' 00:26:04.827 16:12:28 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:04.827 16:12:28 -- nvmf/common.sh@7 -- # uname -s 00:26:04.827 16:12:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:04.827 16:12:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:04.827 16:12:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:04.827 16:12:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:04.827 16:12:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:04.827 16:12:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:04.827 16:12:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:04.827 16:12:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:04.827 16:12:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:04.827 16:12:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:04.827 16:12:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:04.827 16:12:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:04.827 16:12:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:04.827 16:12:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:04.827 16:12:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:04.827 16:12:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:04.827 16:12:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:04.827 16:12:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:04.827 16:12:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:04.827 16:12:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:04.827 16:12:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:04.827 16:12:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:04.827 16:12:28 -- paths/export.sh@5 -- # export PATH 00:26:04.827 16:12:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:04.827 16:12:28 -- nvmf/common.sh@46 -- # : 0 00:26:04.827 16:12:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:04.827 16:12:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:04.827 16:12:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:04.827 16:12:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:04.827 16:12:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:04.827 16:12:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:04.827 16:12:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:04.827 16:12:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:04.827 16:12:28 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:26:04.827 16:12:28 -- host/async_init.sh@14 -- # null_block_size=512 00:26:04.827 16:12:28 -- host/async_init.sh@15 -- # null_bdev=null0 00:26:04.827 16:12:28 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:26:04.827 16:12:28 -- host/async_init.sh@20 -- # uuidgen 00:26:04.827 16:12:28 -- host/async_init.sh@20 -- # tr -d - 00:26:04.827 16:12:28 -- host/async_init.sh@20 -- # nguid=efcaa84b583f4be28d387e80fdc66855 00:26:04.827 16:12:28 -- host/async_init.sh@22 -- # nvmftestinit 00:26:04.827 16:12:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:04.827 16:12:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:04.827 16:12:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:04.827 16:12:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:04.827 16:12:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:04.827 16:12:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:04.827 16:12:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:04.827 16:12:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:04.827 16:12:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:04.827 16:12:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:04.827 16:12:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:04.827 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:26:06.730 16:12:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:06.730 16:12:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:06.730 16:12:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:06.730 16:12:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:06.730 16:12:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:06.730 16:12:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:06.730 16:12:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:06.730 16:12:30 -- nvmf/common.sh@294 -- # net_devs=() 00:26:06.730 16:12:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:06.730 16:12:30 -- nvmf/common.sh@295 -- # e810=() 00:26:06.730 16:12:30 -- nvmf/common.sh@295 -- # local -ga e810 00:26:06.730 16:12:30 -- nvmf/common.sh@296 -- # x722=() 00:26:06.730 16:12:30 -- nvmf/common.sh@296 -- # local -ga x722 00:26:06.730 16:12:30 -- nvmf/common.sh@297 -- # mlx=() 00:26:06.730 16:12:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:06.730 16:12:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:06.730 16:12:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:06.730 16:12:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:06.730 16:12:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:06.730 16:12:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:06.730 16:12:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:06.731 16:12:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:06.731 16:12:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:06.731 16:12:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:06.731 16:12:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:06.731 16:12:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:06.731 16:12:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:06.731 16:12:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:06.731 16:12:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:06.731 16:12:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:06.731 16:12:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:06.731 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:06.731 16:12:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:06.731 16:12:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:06.731 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:06.731 16:12:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:06.731 16:12:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:06.731 16:12:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:06.731 16:12:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:06.731 16:12:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:06.731 16:12:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:06.731 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:06.731 16:12:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:06.731 16:12:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:06.731 16:12:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:06.731 16:12:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:06.731 16:12:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:06.731 16:12:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:06.731 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:06.731 16:12:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:06.731 16:12:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:06.731 16:12:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:06.731 16:12:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:06.731 16:12:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:06.731 16:12:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:06.731 16:12:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:06.731 16:12:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:06.731 16:12:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:06.731 16:12:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:06.731 16:12:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:06.731 16:12:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:06.731 16:12:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:06.731 16:12:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:06.731 16:12:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:06.731 16:12:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:06.731 16:12:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:06.731 16:12:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:06.989 16:12:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:06.989 16:12:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:06.989 16:12:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:06.989 16:12:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:06.989 16:12:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:06.989 16:12:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:06.989 16:12:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:06.989 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:06.989 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.256 ms 00:26:06.989 00:26:06.989 --- 10.0.0.2 ping statistics --- 00:26:06.989 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:06.989 rtt min/avg/max/mdev = 0.256/0.256/0.256/0.000 ms 00:26:06.989 16:12:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:06.989 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:06.989 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:26:06.989 00:26:06.989 --- 10.0.0.1 ping statistics --- 00:26:06.989 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:06.989 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:26:06.989 16:12:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:06.989 16:12:30 -- nvmf/common.sh@410 -- # return 0 00:26:06.989 16:12:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:06.989 16:12:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:06.989 16:12:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:06.989 16:12:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:06.989 16:12:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:06.989 16:12:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:06.989 16:12:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:06.989 16:12:30 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:26:06.989 16:12:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:06.989 16:12:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:06.989 16:12:30 -- common/autotest_common.sh@10 -- # set +x 00:26:06.989 16:12:30 -- nvmf/common.sh@469 -- # nvmfpid=1669408 00:26:06.989 16:12:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:26:06.989 16:12:30 -- nvmf/common.sh@470 -- # waitforlisten 1669408 00:26:06.989 16:12:30 -- common/autotest_common.sh@829 -- # '[' -z 1669408 ']' 00:26:06.989 16:12:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:06.989 16:12:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:06.989 16:12:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:06.989 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:06.989 16:12:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:06.989 16:12:30 -- common/autotest_common.sh@10 -- # set +x 00:26:06.989 [2024-11-18 16:12:30.496989] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:06.990 [2024-11-18 16:12:30.497070] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:06.990 EAL: No free 2048 kB hugepages reported on node 1 00:26:06.990 [2024-11-18 16:12:30.566338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:07.248 [2024-11-18 16:12:30.656519] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:07.248 [2024-11-18 16:12:30.656690] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:07.248 [2024-11-18 16:12:30.656710] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:07.248 [2024-11-18 16:12:30.656725] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:07.248 [2024-11-18 16:12:30.656755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:08.180 16:12:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:08.180 16:12:31 -- common/autotest_common.sh@862 -- # return 0 00:26:08.180 16:12:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:08.180 16:12:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:08.180 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.180 16:12:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:08.180 16:12:31 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:26:08.180 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.180 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.180 [2024-11-18 16:12:31.493023] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:08.180 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.180 16:12:31 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:26:08.180 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.180 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.180 null0 00:26:08.180 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.180 16:12:31 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:26:08.180 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.180 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.180 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.180 16:12:31 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:26:08.180 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.180 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.180 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.180 16:12:31 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g efcaa84b583f4be28d387e80fdc66855 00:26:08.180 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.180 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.180 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.180 16:12:31 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:08.180 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.180 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.180 [2024-11-18 16:12:31.533282] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:08.180 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.180 16:12:31 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:26:08.180 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.180 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.180 nvme0n1 00:26:08.180 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.180 16:12:31 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:08.180 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.180 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.439 [ 00:26:08.439 { 00:26:08.439 "name": "nvme0n1", 00:26:08.439 "aliases": [ 00:26:08.439 "efcaa84b-583f-4be2-8d38-7e80fdc66855" 00:26:08.439 ], 00:26:08.439 "product_name": "NVMe disk", 00:26:08.439 "block_size": 512, 00:26:08.439 "num_blocks": 2097152, 00:26:08.439 "uuid": "efcaa84b-583f-4be2-8d38-7e80fdc66855", 00:26:08.439 "assigned_rate_limits": { 00:26:08.439 "rw_ios_per_sec": 0, 00:26:08.439 "rw_mbytes_per_sec": 0, 00:26:08.439 "r_mbytes_per_sec": 0, 00:26:08.439 "w_mbytes_per_sec": 0 00:26:08.439 }, 00:26:08.439 "claimed": false, 00:26:08.439 "zoned": false, 00:26:08.439 "supported_io_types": { 00:26:08.439 "read": true, 00:26:08.439 "write": true, 00:26:08.439 "unmap": false, 00:26:08.439 "write_zeroes": true, 00:26:08.439 "flush": true, 00:26:08.439 "reset": true, 00:26:08.439 "compare": true, 00:26:08.439 "compare_and_write": true, 00:26:08.439 "abort": true, 00:26:08.439 "nvme_admin": true, 00:26:08.439 "nvme_io": true 00:26:08.439 }, 00:26:08.439 "driver_specific": { 00:26:08.439 "nvme": [ 00:26:08.439 { 00:26:08.439 "trid": { 00:26:08.439 "trtype": "TCP", 00:26:08.439 "adrfam": "IPv4", 00:26:08.439 "traddr": "10.0.0.2", 00:26:08.439 "trsvcid": "4420", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:08.439 }, 00:26:08.439 "ctrlr_data": { 00:26:08.439 "cntlid": 1, 00:26:08.439 "vendor_id": "0x8086", 00:26:08.439 "model_number": "SPDK bdev Controller", 00:26:08.439 "serial_number": "00000000000000000000", 00:26:08.439 "firmware_revision": "24.01.1", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:08.439 "oacs": { 00:26:08.439 "security": 0, 00:26:08.439 "format": 0, 00:26:08.439 "firmware": 0, 00:26:08.439 "ns_manage": 0 00:26:08.439 }, 00:26:08.439 "multi_ctrlr": true, 00:26:08.439 "ana_reporting": false 00:26:08.439 }, 00:26:08.439 "vs": { 00:26:08.439 "nvme_version": "1.3" 00:26:08.439 }, 00:26:08.439 "ns_data": { 00:26:08.439 "id": 1, 00:26:08.439 "can_share": true 00:26:08.439 } 00:26:08.439 } 00:26:08.439 ], 00:26:08.439 "mp_policy": "active_passive" 00:26:08.439 } 00:26:08.439 } 00:26:08.439 ] 00:26:08.439 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.439 16:12:31 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:26:08.439 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.439 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.439 [2024-11-18 16:12:31.781902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:08.439 [2024-11-18 16:12:31.781991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x221f3f0 (9): Bad file descriptor 00:26:08.439 [2024-11-18 16:12:31.913753] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:08.439 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.439 16:12:31 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:08.439 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.439 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.439 [ 00:26:08.439 { 00:26:08.439 "name": "nvme0n1", 00:26:08.439 "aliases": [ 00:26:08.439 "efcaa84b-583f-4be2-8d38-7e80fdc66855" 00:26:08.439 ], 00:26:08.439 "product_name": "NVMe disk", 00:26:08.439 "block_size": 512, 00:26:08.439 "num_blocks": 2097152, 00:26:08.439 "uuid": "efcaa84b-583f-4be2-8d38-7e80fdc66855", 00:26:08.439 "assigned_rate_limits": { 00:26:08.439 "rw_ios_per_sec": 0, 00:26:08.439 "rw_mbytes_per_sec": 0, 00:26:08.439 "r_mbytes_per_sec": 0, 00:26:08.439 "w_mbytes_per_sec": 0 00:26:08.439 }, 00:26:08.439 "claimed": false, 00:26:08.439 "zoned": false, 00:26:08.439 "supported_io_types": { 00:26:08.439 "read": true, 00:26:08.439 "write": true, 00:26:08.439 "unmap": false, 00:26:08.439 "write_zeroes": true, 00:26:08.439 "flush": true, 00:26:08.439 "reset": true, 00:26:08.439 "compare": true, 00:26:08.439 "compare_and_write": true, 00:26:08.439 "abort": true, 00:26:08.439 "nvme_admin": true, 00:26:08.439 "nvme_io": true 00:26:08.439 }, 00:26:08.439 "driver_specific": { 00:26:08.439 "nvme": [ 00:26:08.439 { 00:26:08.439 "trid": { 00:26:08.439 "trtype": "TCP", 00:26:08.439 "adrfam": "IPv4", 00:26:08.439 "traddr": "10.0.0.2", 00:26:08.439 "trsvcid": "4420", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:08.439 }, 00:26:08.439 "ctrlr_data": { 00:26:08.439 "cntlid": 2, 00:26:08.439 "vendor_id": "0x8086", 00:26:08.439 "model_number": "SPDK bdev Controller", 00:26:08.439 "serial_number": "00000000000000000000", 00:26:08.439 "firmware_revision": "24.01.1", 00:26:08.439 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:08.439 "oacs": { 00:26:08.439 "security": 0, 00:26:08.439 "format": 0, 00:26:08.439 "firmware": 0, 00:26:08.439 "ns_manage": 0 00:26:08.439 }, 00:26:08.439 "multi_ctrlr": true, 00:26:08.439 "ana_reporting": false 00:26:08.439 }, 00:26:08.439 "vs": { 00:26:08.439 "nvme_version": "1.3" 00:26:08.439 }, 00:26:08.439 "ns_data": { 00:26:08.439 "id": 1, 00:26:08.439 "can_share": true 00:26:08.439 } 00:26:08.439 } 00:26:08.439 ], 00:26:08.439 "mp_policy": "active_passive" 00:26:08.439 } 00:26:08.439 } 00:26:08.439 ] 00:26:08.439 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.439 16:12:31 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:08.439 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.439 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.439 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.440 16:12:31 -- host/async_init.sh@53 -- # mktemp 00:26:08.440 16:12:31 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.djfhhK7xWP 00:26:08.440 16:12:31 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:26:08.440 16:12:31 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.djfhhK7xWP 00:26:08.440 16:12:31 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:26:08.440 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.440 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.440 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.440 16:12:31 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:26:08.440 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.440 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.440 [2024-11-18 16:12:31.958480] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:26:08.440 [2024-11-18 16:12:31.958623] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:08.440 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.440 16:12:31 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.djfhhK7xWP 00:26:08.440 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.440 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.440 16:12:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.440 16:12:31 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.djfhhK7xWP 00:26:08.440 16:12:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.440 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.440 [2024-11-18 16:12:31.974523] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:26:08.697 nvme0n1 00:26:08.697 16:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.697 16:12:32 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:08.697 16:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.697 16:12:32 -- common/autotest_common.sh@10 -- # set +x 00:26:08.697 [ 00:26:08.697 { 00:26:08.697 "name": "nvme0n1", 00:26:08.697 "aliases": [ 00:26:08.697 "efcaa84b-583f-4be2-8d38-7e80fdc66855" 00:26:08.697 ], 00:26:08.697 "product_name": "NVMe disk", 00:26:08.697 "block_size": 512, 00:26:08.697 "num_blocks": 2097152, 00:26:08.697 "uuid": "efcaa84b-583f-4be2-8d38-7e80fdc66855", 00:26:08.697 "assigned_rate_limits": { 00:26:08.697 "rw_ios_per_sec": 0, 00:26:08.697 "rw_mbytes_per_sec": 0, 00:26:08.697 "r_mbytes_per_sec": 0, 00:26:08.697 "w_mbytes_per_sec": 0 00:26:08.697 }, 00:26:08.697 "claimed": false, 00:26:08.697 "zoned": false, 00:26:08.697 "supported_io_types": { 00:26:08.697 "read": true, 00:26:08.697 "write": true, 00:26:08.697 "unmap": false, 00:26:08.697 "write_zeroes": true, 00:26:08.697 "flush": true, 00:26:08.697 "reset": true, 00:26:08.697 "compare": true, 00:26:08.697 "compare_and_write": true, 00:26:08.697 "abort": true, 00:26:08.697 "nvme_admin": true, 00:26:08.697 "nvme_io": true 00:26:08.697 }, 00:26:08.697 "driver_specific": { 00:26:08.697 "nvme": [ 00:26:08.697 { 00:26:08.698 "trid": { 00:26:08.698 "trtype": "TCP", 00:26:08.698 "adrfam": "IPv4", 00:26:08.698 "traddr": "10.0.0.2", 00:26:08.698 "trsvcid": "4421", 00:26:08.698 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:08.698 }, 00:26:08.698 "ctrlr_data": { 00:26:08.698 "cntlid": 3, 00:26:08.698 "vendor_id": "0x8086", 00:26:08.698 "model_number": "SPDK bdev Controller", 00:26:08.698 "serial_number": "00000000000000000000", 00:26:08.698 "firmware_revision": "24.01.1", 00:26:08.698 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:08.698 "oacs": { 00:26:08.698 "security": 0, 00:26:08.698 "format": 0, 00:26:08.698 "firmware": 0, 00:26:08.698 "ns_manage": 0 00:26:08.698 }, 00:26:08.698 "multi_ctrlr": true, 00:26:08.698 "ana_reporting": false 00:26:08.698 }, 00:26:08.698 "vs": { 00:26:08.698 "nvme_version": "1.3" 00:26:08.698 }, 00:26:08.698 "ns_data": { 00:26:08.698 "id": 1, 00:26:08.698 "can_share": true 00:26:08.698 } 00:26:08.698 } 00:26:08.698 ], 00:26:08.698 "mp_policy": "active_passive" 00:26:08.698 } 00:26:08.698 } 00:26:08.698 ] 00:26:08.698 16:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.698 16:12:32 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:08.698 16:12:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.698 16:12:32 -- common/autotest_common.sh@10 -- # set +x 00:26:08.698 16:12:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.698 16:12:32 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.djfhhK7xWP 00:26:08.698 16:12:32 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:26:08.698 16:12:32 -- host/async_init.sh@78 -- # nvmftestfini 00:26:08.698 16:12:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:08.698 16:12:32 -- nvmf/common.sh@116 -- # sync 00:26:08.698 16:12:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:08.698 16:12:32 -- nvmf/common.sh@119 -- # set +e 00:26:08.698 16:12:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:08.698 16:12:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:08.698 rmmod nvme_tcp 00:26:08.698 rmmod nvme_fabrics 00:26:08.698 rmmod nvme_keyring 00:26:08.698 16:12:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:08.698 16:12:32 -- nvmf/common.sh@123 -- # set -e 00:26:08.698 16:12:32 -- nvmf/common.sh@124 -- # return 0 00:26:08.698 16:12:32 -- nvmf/common.sh@477 -- # '[' -n 1669408 ']' 00:26:08.698 16:12:32 -- nvmf/common.sh@478 -- # killprocess 1669408 00:26:08.698 16:12:32 -- common/autotest_common.sh@936 -- # '[' -z 1669408 ']' 00:26:08.698 16:12:32 -- common/autotest_common.sh@940 -- # kill -0 1669408 00:26:08.698 16:12:32 -- common/autotest_common.sh@941 -- # uname 00:26:08.698 16:12:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:08.698 16:12:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1669408 00:26:08.698 16:12:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:08.698 16:12:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:08.698 16:12:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1669408' 00:26:08.698 killing process with pid 1669408 00:26:08.698 16:12:32 -- common/autotest_common.sh@955 -- # kill 1669408 00:26:08.698 16:12:32 -- common/autotest_common.sh@960 -- # wait 1669408 00:26:08.956 16:12:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:08.956 16:12:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:08.956 16:12:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:08.956 16:12:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:08.956 16:12:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:08.956 16:12:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:08.956 16:12:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:08.956 16:12:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:10.857 16:12:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:10.857 00:26:10.857 real 0m6.526s 00:26:10.857 user 0m3.099s 00:26:10.857 sys 0m1.961s 00:26:10.857 16:12:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:10.857 16:12:34 -- common/autotest_common.sh@10 -- # set +x 00:26:10.857 ************************************ 00:26:10.857 END TEST nvmf_async_init 00:26:10.857 ************************************ 00:26:11.115 16:12:34 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:11.115 16:12:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:11.115 16:12:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:11.115 16:12:34 -- common/autotest_common.sh@10 -- # set +x 00:26:11.115 ************************************ 00:26:11.115 START TEST dma 00:26:11.115 ************************************ 00:26:11.115 16:12:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:11.115 * Looking for test storage... 00:26:11.115 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:11.115 16:12:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:11.115 16:12:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:11.115 16:12:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:11.115 16:12:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:11.115 16:12:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:11.115 16:12:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:11.115 16:12:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:11.115 16:12:34 -- scripts/common.sh@335 -- # IFS=.-: 00:26:11.115 16:12:34 -- scripts/common.sh@335 -- # read -ra ver1 00:26:11.115 16:12:34 -- scripts/common.sh@336 -- # IFS=.-: 00:26:11.115 16:12:34 -- scripts/common.sh@336 -- # read -ra ver2 00:26:11.115 16:12:34 -- scripts/common.sh@337 -- # local 'op=<' 00:26:11.115 16:12:34 -- scripts/common.sh@339 -- # ver1_l=2 00:26:11.115 16:12:34 -- scripts/common.sh@340 -- # ver2_l=1 00:26:11.115 16:12:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:11.115 16:12:34 -- scripts/common.sh@343 -- # case "$op" in 00:26:11.115 16:12:34 -- scripts/common.sh@344 -- # : 1 00:26:11.115 16:12:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:11.115 16:12:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:11.115 16:12:34 -- scripts/common.sh@364 -- # decimal 1 00:26:11.115 16:12:34 -- scripts/common.sh@352 -- # local d=1 00:26:11.115 16:12:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:11.115 16:12:34 -- scripts/common.sh@354 -- # echo 1 00:26:11.115 16:12:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:11.115 16:12:34 -- scripts/common.sh@365 -- # decimal 2 00:26:11.115 16:12:34 -- scripts/common.sh@352 -- # local d=2 00:26:11.115 16:12:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:11.115 16:12:34 -- scripts/common.sh@354 -- # echo 2 00:26:11.115 16:12:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:11.115 16:12:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:11.115 16:12:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:11.115 16:12:34 -- scripts/common.sh@367 -- # return 0 00:26:11.116 16:12:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:11.116 16:12:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:11.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.116 --rc genhtml_branch_coverage=1 00:26:11.116 --rc genhtml_function_coverage=1 00:26:11.116 --rc genhtml_legend=1 00:26:11.116 --rc geninfo_all_blocks=1 00:26:11.116 --rc geninfo_unexecuted_blocks=1 00:26:11.116 00:26:11.116 ' 00:26:11.116 16:12:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:11.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.116 --rc genhtml_branch_coverage=1 00:26:11.116 --rc genhtml_function_coverage=1 00:26:11.116 --rc genhtml_legend=1 00:26:11.116 --rc geninfo_all_blocks=1 00:26:11.116 --rc geninfo_unexecuted_blocks=1 00:26:11.116 00:26:11.116 ' 00:26:11.116 16:12:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:11.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.116 --rc genhtml_branch_coverage=1 00:26:11.116 --rc genhtml_function_coverage=1 00:26:11.116 --rc genhtml_legend=1 00:26:11.116 --rc geninfo_all_blocks=1 00:26:11.116 --rc geninfo_unexecuted_blocks=1 00:26:11.116 00:26:11.116 ' 00:26:11.116 16:12:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:11.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.116 --rc genhtml_branch_coverage=1 00:26:11.116 --rc genhtml_function_coverage=1 00:26:11.116 --rc genhtml_legend=1 00:26:11.116 --rc geninfo_all_blocks=1 00:26:11.116 --rc geninfo_unexecuted_blocks=1 00:26:11.116 00:26:11.116 ' 00:26:11.116 16:12:34 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:11.116 16:12:34 -- nvmf/common.sh@7 -- # uname -s 00:26:11.116 16:12:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:11.116 16:12:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:11.116 16:12:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:11.116 16:12:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:11.116 16:12:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:11.116 16:12:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:11.116 16:12:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:11.116 16:12:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:11.116 16:12:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:11.116 16:12:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:11.116 16:12:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:11.116 16:12:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:11.116 16:12:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:11.116 16:12:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:11.116 16:12:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:11.116 16:12:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:11.116 16:12:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:11.116 16:12:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:11.116 16:12:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:11.116 16:12:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.116 16:12:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.116 16:12:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.116 16:12:34 -- paths/export.sh@5 -- # export PATH 00:26:11.116 16:12:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.116 16:12:34 -- nvmf/common.sh@46 -- # : 0 00:26:11.116 16:12:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:11.116 16:12:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:11.116 16:12:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:11.116 16:12:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:11.116 16:12:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:11.116 16:12:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:11.116 16:12:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:11.116 16:12:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:11.116 16:12:34 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:26:11.116 16:12:34 -- host/dma.sh@13 -- # exit 0 00:26:11.116 00:26:11.116 real 0m0.154s 00:26:11.116 user 0m0.104s 00:26:11.116 sys 0m0.059s 00:26:11.116 16:12:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:11.116 16:12:34 -- common/autotest_common.sh@10 -- # set +x 00:26:11.116 ************************************ 00:26:11.116 END TEST dma 00:26:11.116 ************************************ 00:26:11.116 16:12:34 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:11.116 16:12:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:11.116 16:12:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:11.116 16:12:34 -- common/autotest_common.sh@10 -- # set +x 00:26:11.116 ************************************ 00:26:11.116 START TEST nvmf_identify 00:26:11.116 ************************************ 00:26:11.116 16:12:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:11.116 * Looking for test storage... 00:26:11.116 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:11.116 16:12:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:11.116 16:12:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:11.116 16:12:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:11.374 16:12:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:11.374 16:12:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:11.374 16:12:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:11.374 16:12:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:11.374 16:12:34 -- scripts/common.sh@335 -- # IFS=.-: 00:26:11.374 16:12:34 -- scripts/common.sh@335 -- # read -ra ver1 00:26:11.374 16:12:34 -- scripts/common.sh@336 -- # IFS=.-: 00:26:11.374 16:12:34 -- scripts/common.sh@336 -- # read -ra ver2 00:26:11.374 16:12:34 -- scripts/common.sh@337 -- # local 'op=<' 00:26:11.374 16:12:34 -- scripts/common.sh@339 -- # ver1_l=2 00:26:11.374 16:12:34 -- scripts/common.sh@340 -- # ver2_l=1 00:26:11.374 16:12:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:11.374 16:12:34 -- scripts/common.sh@343 -- # case "$op" in 00:26:11.374 16:12:34 -- scripts/common.sh@344 -- # : 1 00:26:11.374 16:12:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:11.374 16:12:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:11.374 16:12:34 -- scripts/common.sh@364 -- # decimal 1 00:26:11.374 16:12:34 -- scripts/common.sh@352 -- # local d=1 00:26:11.374 16:12:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:11.374 16:12:34 -- scripts/common.sh@354 -- # echo 1 00:26:11.374 16:12:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:11.375 16:12:34 -- scripts/common.sh@365 -- # decimal 2 00:26:11.375 16:12:34 -- scripts/common.sh@352 -- # local d=2 00:26:11.375 16:12:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:11.375 16:12:34 -- scripts/common.sh@354 -- # echo 2 00:26:11.375 16:12:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:11.375 16:12:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:11.375 16:12:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:11.375 16:12:34 -- scripts/common.sh@367 -- # return 0 00:26:11.375 16:12:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:11.375 16:12:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:11.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.375 --rc genhtml_branch_coverage=1 00:26:11.375 --rc genhtml_function_coverage=1 00:26:11.375 --rc genhtml_legend=1 00:26:11.375 --rc geninfo_all_blocks=1 00:26:11.375 --rc geninfo_unexecuted_blocks=1 00:26:11.375 00:26:11.375 ' 00:26:11.375 16:12:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:11.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.375 --rc genhtml_branch_coverage=1 00:26:11.375 --rc genhtml_function_coverage=1 00:26:11.375 --rc genhtml_legend=1 00:26:11.375 --rc geninfo_all_blocks=1 00:26:11.375 --rc geninfo_unexecuted_blocks=1 00:26:11.375 00:26:11.375 ' 00:26:11.375 16:12:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:11.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.375 --rc genhtml_branch_coverage=1 00:26:11.375 --rc genhtml_function_coverage=1 00:26:11.375 --rc genhtml_legend=1 00:26:11.375 --rc geninfo_all_blocks=1 00:26:11.375 --rc geninfo_unexecuted_blocks=1 00:26:11.375 00:26:11.375 ' 00:26:11.375 16:12:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:11.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:11.375 --rc genhtml_branch_coverage=1 00:26:11.375 --rc genhtml_function_coverage=1 00:26:11.375 --rc genhtml_legend=1 00:26:11.375 --rc geninfo_all_blocks=1 00:26:11.375 --rc geninfo_unexecuted_blocks=1 00:26:11.375 00:26:11.375 ' 00:26:11.375 16:12:34 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:11.375 16:12:34 -- nvmf/common.sh@7 -- # uname -s 00:26:11.375 16:12:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:11.375 16:12:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:11.375 16:12:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:11.375 16:12:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:11.375 16:12:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:11.375 16:12:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:11.375 16:12:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:11.375 16:12:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:11.375 16:12:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:11.375 16:12:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:11.375 16:12:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:11.375 16:12:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:11.375 16:12:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:11.375 16:12:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:11.375 16:12:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:11.375 16:12:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:11.375 16:12:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:11.375 16:12:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:11.375 16:12:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:11.375 16:12:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.375 16:12:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.375 16:12:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.375 16:12:34 -- paths/export.sh@5 -- # export PATH 00:26:11.375 16:12:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:11.375 16:12:34 -- nvmf/common.sh@46 -- # : 0 00:26:11.375 16:12:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:11.375 16:12:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:11.375 16:12:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:11.375 16:12:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:11.375 16:12:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:11.375 16:12:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:11.375 16:12:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:11.375 16:12:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:11.375 16:12:34 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:11.375 16:12:34 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:11.375 16:12:34 -- host/identify.sh@14 -- # nvmftestinit 00:26:11.375 16:12:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:11.375 16:12:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:11.375 16:12:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:11.375 16:12:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:11.375 16:12:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:11.375 16:12:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:11.375 16:12:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:11.375 16:12:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:11.375 16:12:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:11.375 16:12:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:11.375 16:12:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:11.375 16:12:34 -- common/autotest_common.sh@10 -- # set +x 00:26:13.906 16:12:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:13.906 16:12:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:13.906 16:12:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:13.906 16:12:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:13.906 16:12:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:13.906 16:12:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:13.906 16:12:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:13.906 16:12:36 -- nvmf/common.sh@294 -- # net_devs=() 00:26:13.906 16:12:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:13.906 16:12:36 -- nvmf/common.sh@295 -- # e810=() 00:26:13.906 16:12:36 -- nvmf/common.sh@295 -- # local -ga e810 00:26:13.906 16:12:36 -- nvmf/common.sh@296 -- # x722=() 00:26:13.906 16:12:36 -- nvmf/common.sh@296 -- # local -ga x722 00:26:13.906 16:12:36 -- nvmf/common.sh@297 -- # mlx=() 00:26:13.906 16:12:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:13.906 16:12:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:13.906 16:12:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:13.906 16:12:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:13.906 16:12:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:13.906 16:12:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:13.906 16:12:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:13.906 16:12:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:13.906 16:12:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:13.906 16:12:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:13.906 16:12:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:13.906 16:12:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:13.906 16:12:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:13.906 16:12:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:13.906 16:12:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:13.906 16:12:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:13.906 16:12:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:13.906 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:13.906 16:12:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:13.906 16:12:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:13.906 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:13.906 16:12:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:13.906 16:12:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:13.906 16:12:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:13.906 16:12:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:13.906 16:12:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:13.906 16:12:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:13.906 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:13.906 16:12:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:13.906 16:12:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:13.906 16:12:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:13.906 16:12:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:13.906 16:12:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:13.906 16:12:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:13.906 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:13.906 16:12:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:13.906 16:12:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:13.906 16:12:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:13.906 16:12:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:13.906 16:12:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:13.906 16:12:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:13.906 16:12:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:13.906 16:12:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:13.906 16:12:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:13.906 16:12:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:13.906 16:12:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:13.906 16:12:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:13.906 16:12:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:13.906 16:12:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:13.906 16:12:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:13.906 16:12:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:13.907 16:12:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:13.907 16:12:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:13.907 16:12:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:13.907 16:12:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:13.907 16:12:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:13.907 16:12:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:13.907 16:12:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:13.907 16:12:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:13.907 16:12:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:13.907 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:13.907 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:26:13.907 00:26:13.907 --- 10.0.0.2 ping statistics --- 00:26:13.907 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:13.907 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:26:13.907 16:12:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:13.907 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:13.907 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.172 ms 00:26:13.907 00:26:13.907 --- 10.0.0.1 ping statistics --- 00:26:13.907 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:13.907 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:26:13.907 16:12:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:13.907 16:12:37 -- nvmf/common.sh@410 -- # return 0 00:26:13.907 16:12:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:13.907 16:12:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:13.907 16:12:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:13.907 16:12:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:13.907 16:12:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:13.907 16:12:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:13.907 16:12:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:13.907 16:12:37 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:26:13.907 16:12:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:13.907 16:12:37 -- common/autotest_common.sh@10 -- # set +x 00:26:13.907 16:12:37 -- host/identify.sh@19 -- # nvmfpid=1671694 00:26:13.907 16:12:37 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:13.907 16:12:37 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:13.907 16:12:37 -- host/identify.sh@23 -- # waitforlisten 1671694 00:26:13.907 16:12:37 -- common/autotest_common.sh@829 -- # '[' -z 1671694 ']' 00:26:13.907 16:12:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:13.907 16:12:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:13.907 16:12:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:13.907 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:13.907 16:12:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:13.907 16:12:37 -- common/autotest_common.sh@10 -- # set +x 00:26:13.907 [2024-11-18 16:12:37.128456] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:13.907 [2024-11-18 16:12:37.128534] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:13.907 EAL: No free 2048 kB hugepages reported on node 1 00:26:13.907 [2024-11-18 16:12:37.194264] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:13.907 [2024-11-18 16:12:37.285419] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:13.907 [2024-11-18 16:12:37.285578] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:13.907 [2024-11-18 16:12:37.285616] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:13.907 [2024-11-18 16:12:37.285632] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:13.907 [2024-11-18 16:12:37.285685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:13.907 [2024-11-18 16:12:37.285719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:13.907 [2024-11-18 16:12:37.285780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:13.907 [2024-11-18 16:12:37.285781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:14.843 16:12:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:14.843 16:12:38 -- common/autotest_common.sh@862 -- # return 0 00:26:14.843 16:12:38 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:14.843 16:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.843 16:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:14.843 [2024-11-18 16:12:38.128254] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:14.843 16:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.843 16:12:38 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:14.843 16:12:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:14.844 16:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:14.844 16:12:38 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:14.844 16:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.844 16:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:14.844 Malloc0 00:26:14.844 16:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.844 16:12:38 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:14.844 16:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.844 16:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:14.844 16:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.844 16:12:38 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:14.844 16:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.844 16:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:14.844 16:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.844 16:12:38 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:14.844 16:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.844 16:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:14.844 [2024-11-18 16:12:38.199214] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:14.844 16:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.844 16:12:38 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:14.844 16:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.844 16:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:14.844 16:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.844 16:12:38 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:14.844 16:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.844 16:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:14.844 [2024-11-18 16:12:38.215009] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:14.844 [ 00:26:14.844 { 00:26:14.844 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:14.844 "subtype": "Discovery", 00:26:14.844 "listen_addresses": [ 00:26:14.844 { 00:26:14.844 "transport": "TCP", 00:26:14.844 "trtype": "TCP", 00:26:14.844 "adrfam": "IPv4", 00:26:14.844 "traddr": "10.0.0.2", 00:26:14.844 "trsvcid": "4420" 00:26:14.844 } 00:26:14.844 ], 00:26:14.844 "allow_any_host": true, 00:26:14.844 "hosts": [] 00:26:14.844 }, 00:26:14.844 { 00:26:14.844 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:14.844 "subtype": "NVMe", 00:26:14.844 "listen_addresses": [ 00:26:14.844 { 00:26:14.844 "transport": "TCP", 00:26:14.844 "trtype": "TCP", 00:26:14.844 "adrfam": "IPv4", 00:26:14.844 "traddr": "10.0.0.2", 00:26:14.844 "trsvcid": "4420" 00:26:14.844 } 00:26:14.844 ], 00:26:14.844 "allow_any_host": true, 00:26:14.844 "hosts": [], 00:26:14.844 "serial_number": "SPDK00000000000001", 00:26:14.844 "model_number": "SPDK bdev Controller", 00:26:14.844 "max_namespaces": 32, 00:26:14.844 "min_cntlid": 1, 00:26:14.844 "max_cntlid": 65519, 00:26:14.844 "namespaces": [ 00:26:14.844 { 00:26:14.844 "nsid": 1, 00:26:14.844 "bdev_name": "Malloc0", 00:26:14.844 "name": "Malloc0", 00:26:14.844 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:14.844 "eui64": "ABCDEF0123456789", 00:26:14.844 "uuid": "1d0f5589-bc6d-4edb-ac33-de1c9b30a7d0" 00:26:14.844 } 00:26:14.844 ] 00:26:14.844 } 00:26:14.844 ] 00:26:14.844 16:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.844 16:12:38 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:14.844 [2024-11-18 16:12:38.236648] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:14.844 [2024-11-18 16:12:38.236690] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1671858 ] 00:26:14.844 EAL: No free 2048 kB hugepages reported on node 1 00:26:14.844 [2024-11-18 16:12:38.267694] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:14.844 [2024-11-18 16:12:38.267751] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:14.844 [2024-11-18 16:12:38.267762] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:14.844 [2024-11-18 16:12:38.267778] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:14.844 [2024-11-18 16:12:38.267791] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:14.844 [2024-11-18 16:12:38.271697] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:14.844 [2024-11-18 16:12:38.271778] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x13a6420 0 00:26:14.844 [2024-11-18 16:12:38.271887] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:14.844 [2024-11-18 16:12:38.271906] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:14.844 [2024-11-18 16:12:38.271916] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:14.844 [2024-11-18 16:12:38.271922] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:14.844 [2024-11-18 16:12:38.271973] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.271986] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.271994] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13a6420) 00:26:14.844 [2024-11-18 16:12:38.272014] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:14.844 [2024-11-18 16:12:38.272041] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bb00, cid 0, qid 0 00:26:14.844 [2024-11-18 16:12:38.279619] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.844 [2024-11-18 16:12:38.279638] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.844 [2024-11-18 16:12:38.279646] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.279654] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bb00) on tqpair=0x13a6420 00:26:14.844 [2024-11-18 16:12:38.279677] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:14.844 [2024-11-18 16:12:38.279703] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:14.844 [2024-11-18 16:12:38.279713] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:14.844 [2024-11-18 16:12:38.279734] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.279743] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.279750] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13a6420) 00:26:14.844 [2024-11-18 16:12:38.279762] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.844 [2024-11-18 16:12:38.279786] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bb00, cid 0, qid 0 00:26:14.844 [2024-11-18 16:12:38.279933] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.844 [2024-11-18 16:12:38.279946] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.844 [2024-11-18 16:12:38.279953] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.279960] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bb00) on tqpair=0x13a6420 00:26:14.844 [2024-11-18 16:12:38.279972] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:14.844 [2024-11-18 16:12:38.279985] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:14.844 [2024-11-18 16:12:38.280004] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.280013] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.280019] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13a6420) 00:26:14.844 [2024-11-18 16:12:38.280030] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.844 [2024-11-18 16:12:38.280052] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bb00, cid 0, qid 0 00:26:14.844 [2024-11-18 16:12:38.280144] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.844 [2024-11-18 16:12:38.280158] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.844 [2024-11-18 16:12:38.280166] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.280172] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bb00) on tqpair=0x13a6420 00:26:14.844 [2024-11-18 16:12:38.280183] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:14.844 [2024-11-18 16:12:38.280198] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:14.844 [2024-11-18 16:12:38.280211] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.280218] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.280225] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13a6420) 00:26:14.844 [2024-11-18 16:12:38.280236] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.844 [2024-11-18 16:12:38.280257] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bb00, cid 0, qid 0 00:26:14.844 [2024-11-18 16:12:38.280337] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.844 [2024-11-18 16:12:38.280349] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.844 [2024-11-18 16:12:38.280356] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.844 [2024-11-18 16:12:38.280363] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bb00) on tqpair=0x13a6420 00:26:14.844 [2024-11-18 16:12:38.280373] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:14.844 [2024-11-18 16:12:38.280390] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.280399] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.280406] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13a6420) 00:26:14.845 [2024-11-18 16:12:38.280416] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.845 [2024-11-18 16:12:38.280437] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bb00, cid 0, qid 0 00:26:14.845 [2024-11-18 16:12:38.280512] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.845 [2024-11-18 16:12:38.280527] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.845 [2024-11-18 16:12:38.280534] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.280541] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bb00) on tqpair=0x13a6420 00:26:14.845 [2024-11-18 16:12:38.280551] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:14.845 [2024-11-18 16:12:38.280560] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:14.845 [2024-11-18 16:12:38.280573] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:14.845 [2024-11-18 16:12:38.280687] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:14.845 [2024-11-18 16:12:38.280699] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:14.845 [2024-11-18 16:12:38.280715] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.280723] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.280729] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13a6420) 00:26:14.845 [2024-11-18 16:12:38.280740] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.845 [2024-11-18 16:12:38.280762] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bb00, cid 0, qid 0 00:26:14.845 [2024-11-18 16:12:38.280881] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.845 [2024-11-18 16:12:38.280901] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.845 [2024-11-18 16:12:38.280908] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.280915] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bb00) on tqpair=0x13a6420 00:26:14.845 [2024-11-18 16:12:38.280925] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:14.845 [2024-11-18 16:12:38.280942] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.280951] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.280958] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13a6420) 00:26:14.845 [2024-11-18 16:12:38.280969] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.845 [2024-11-18 16:12:38.280990] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bb00, cid 0, qid 0 00:26:14.845 [2024-11-18 16:12:38.281060] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.845 [2024-11-18 16:12:38.281073] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.845 [2024-11-18 16:12:38.281080] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.281086] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bb00) on tqpair=0x13a6420 00:26:14.845 [2024-11-18 16:12:38.281096] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:14.845 [2024-11-18 16:12:38.281104] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:14.845 [2024-11-18 16:12:38.281117] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:14.845 [2024-11-18 16:12:38.281132] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:14.845 [2024-11-18 16:12:38.281148] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.281156] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.281162] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13a6420) 00:26:14.845 [2024-11-18 16:12:38.281173] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.845 [2024-11-18 16:12:38.281195] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bb00, cid 0, qid 0 00:26:14.845 [2024-11-18 16:12:38.281317] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:14.845 [2024-11-18 16:12:38.281329] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:14.845 [2024-11-18 16:12:38.281340] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.281348] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x13a6420): datao=0, datal=4096, cccid=0 00:26:14.845 [2024-11-18 16:12:38.281356] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x140bb00) on tqpair(0x13a6420): expected_datao=0, payload_size=4096 00:26:14.845 [2024-11-18 16:12:38.281377] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.281388] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.321719] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.845 [2024-11-18 16:12:38.321740] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.845 [2024-11-18 16:12:38.321748] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.321755] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bb00) on tqpair=0x13a6420 00:26:14.845 [2024-11-18 16:12:38.321770] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:14.845 [2024-11-18 16:12:38.321780] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:14.845 [2024-11-18 16:12:38.321787] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:14.845 [2024-11-18 16:12:38.321796] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:14.845 [2024-11-18 16:12:38.321804] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:14.845 [2024-11-18 16:12:38.321812] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:14.845 [2024-11-18 16:12:38.321833] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:14.845 [2024-11-18 16:12:38.321847] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.321855] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.321862] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13a6420) 00:26:14.845 [2024-11-18 16:12:38.321874] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:14.845 [2024-11-18 16:12:38.321898] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bb00, cid 0, qid 0 00:26:14.845 [2024-11-18 16:12:38.321998] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.845 [2024-11-18 16:12:38.322013] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.845 [2024-11-18 16:12:38.322020] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.322026] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bb00) on tqpair=0x13a6420 00:26:14.845 [2024-11-18 16:12:38.322041] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.322049] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.322056] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13a6420) 00:26:14.845 [2024-11-18 16:12:38.322066] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:14.845 [2024-11-18 16:12:38.322077] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.322084] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.322090] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x13a6420) 00:26:14.845 [2024-11-18 16:12:38.322099] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:14.845 [2024-11-18 16:12:38.322114] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.322122] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.322128] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x13a6420) 00:26:14.845 [2024-11-18 16:12:38.322137] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:14.845 [2024-11-18 16:12:38.322147] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.322154] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.322161] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.845 [2024-11-18 16:12:38.322169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:14.845 [2024-11-18 16:12:38.322179] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:14.845 [2024-11-18 16:12:38.322199] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:14.845 [2024-11-18 16:12:38.322212] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.322219] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.845 [2024-11-18 16:12:38.322225] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x13a6420) 00:26:14.845 [2024-11-18 16:12:38.322236] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.845 [2024-11-18 16:12:38.322274] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bb00, cid 0, qid 0 00:26:14.845 [2024-11-18 16:12:38.322286] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bc60, cid 1, qid 0 00:26:14.845 [2024-11-18 16:12:38.322294] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bdc0, cid 2, qid 0 00:26:14.845 [2024-11-18 16:12:38.322301] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.846 [2024-11-18 16:12:38.322309] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140c080, cid 4, qid 0 00:26:14.846 [2024-11-18 16:12:38.322499] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.846 [2024-11-18 16:12:38.322512] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.846 [2024-11-18 16:12:38.322519] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.322526] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140c080) on tqpair=0x13a6420 00:26:14.846 [2024-11-18 16:12:38.322537] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:14.846 [2024-11-18 16:12:38.322546] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:14.846 [2024-11-18 16:12:38.322563] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.322572] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.322579] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x13a6420) 00:26:14.846 [2024-11-18 16:12:38.322589] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.846 [2024-11-18 16:12:38.322617] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140c080, cid 4, qid 0 00:26:14.846 [2024-11-18 16:12:38.322749] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:14.846 [2024-11-18 16:12:38.322764] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:14.846 [2024-11-18 16:12:38.322771] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.322778] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x13a6420): datao=0, datal=4096, cccid=4 00:26:14.846 [2024-11-18 16:12:38.322790] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x140c080) on tqpair(0x13a6420): expected_datao=0, payload_size=4096 00:26:14.846 [2024-11-18 16:12:38.322802] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.322810] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.322823] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.846 [2024-11-18 16:12:38.322833] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.846 [2024-11-18 16:12:38.322839] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.322846] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140c080) on tqpair=0x13a6420 00:26:14.846 [2024-11-18 16:12:38.322866] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:14.846 [2024-11-18 16:12:38.322905] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.322916] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.322923] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x13a6420) 00:26:14.846 [2024-11-18 16:12:38.322934] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.846 [2024-11-18 16:12:38.322946] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.322954] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.322960] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x13a6420) 00:26:14.846 [2024-11-18 16:12:38.322969] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:14.846 [2024-11-18 16:12:38.322996] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140c080, cid 4, qid 0 00:26:14.846 [2024-11-18 16:12:38.323008] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140c1e0, cid 5, qid 0 00:26:14.846 [2024-11-18 16:12:38.323139] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:14.846 [2024-11-18 16:12:38.323152] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:14.846 [2024-11-18 16:12:38.323159] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.323165] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x13a6420): datao=0, datal=1024, cccid=4 00:26:14.846 [2024-11-18 16:12:38.323173] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x140c080) on tqpair(0x13a6420): expected_datao=0, payload_size=1024 00:26:14.846 [2024-11-18 16:12:38.323183] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.323191] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.323200] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.846 [2024-11-18 16:12:38.323209] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.846 [2024-11-18 16:12:38.323215] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.323222] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140c1e0) on tqpair=0x13a6420 00:26:14.846 [2024-11-18 16:12:38.367625] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.846 [2024-11-18 16:12:38.367645] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.846 [2024-11-18 16:12:38.367653] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.367660] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140c080) on tqpair=0x13a6420 00:26:14.846 [2024-11-18 16:12:38.367680] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.367689] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.367696] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x13a6420) 00:26:14.846 [2024-11-18 16:12:38.367712] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.846 [2024-11-18 16:12:38.367745] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140c080, cid 4, qid 0 00:26:14.846 [2024-11-18 16:12:38.367881] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:14.846 [2024-11-18 16:12:38.367897] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:14.846 [2024-11-18 16:12:38.367904] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.367910] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x13a6420): datao=0, datal=3072, cccid=4 00:26:14.846 [2024-11-18 16:12:38.367918] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x140c080) on tqpair(0x13a6420): expected_datao=0, payload_size=3072 00:26:14.846 [2024-11-18 16:12:38.367930] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.367938] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.367950] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.846 [2024-11-18 16:12:38.367960] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.846 [2024-11-18 16:12:38.367967] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.367974] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140c080) on tqpair=0x13a6420 00:26:14.846 [2024-11-18 16:12:38.367990] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.367999] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.368006] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x13a6420) 00:26:14.846 [2024-11-18 16:12:38.368017] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.846 [2024-11-18 16:12:38.368045] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140c080, cid 4, qid 0 00:26:14.846 [2024-11-18 16:12:38.368141] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:14.846 [2024-11-18 16:12:38.368154] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:14.846 [2024-11-18 16:12:38.368161] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.368167] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x13a6420): datao=0, datal=8, cccid=4 00:26:14.846 [2024-11-18 16:12:38.368175] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x140c080) on tqpair(0x13a6420): expected_datao=0, payload_size=8 00:26:14.846 [2024-11-18 16:12:38.368185] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.368193] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.408684] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.846 [2024-11-18 16:12:38.408702] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.846 [2024-11-18 16:12:38.408710] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.846 [2024-11-18 16:12:38.408717] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140c080) on tqpair=0x13a6420 00:26:14.846 ===================================================== 00:26:14.846 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:14.846 ===================================================== 00:26:14.846 Controller Capabilities/Features 00:26:14.846 ================================ 00:26:14.846 Vendor ID: 0000 00:26:14.846 Subsystem Vendor ID: 0000 00:26:14.846 Serial Number: .................... 00:26:14.846 Model Number: ........................................ 00:26:14.846 Firmware Version: 24.01.1 00:26:14.846 Recommended Arb Burst: 0 00:26:14.846 IEEE OUI Identifier: 00 00 00 00:26:14.846 Multi-path I/O 00:26:14.846 May have multiple subsystem ports: No 00:26:14.846 May have multiple controllers: No 00:26:14.846 Associated with SR-IOV VF: No 00:26:14.846 Max Data Transfer Size: 131072 00:26:14.846 Max Number of Namespaces: 0 00:26:14.846 Max Number of I/O Queues: 1024 00:26:14.846 NVMe Specification Version (VS): 1.3 00:26:14.846 NVMe Specification Version (Identify): 1.3 00:26:14.846 Maximum Queue Entries: 128 00:26:14.846 Contiguous Queues Required: Yes 00:26:14.846 Arbitration Mechanisms Supported 00:26:14.846 Weighted Round Robin: Not Supported 00:26:14.846 Vendor Specific: Not Supported 00:26:14.846 Reset Timeout: 15000 ms 00:26:14.846 Doorbell Stride: 4 bytes 00:26:14.846 NVM Subsystem Reset: Not Supported 00:26:14.846 Command Sets Supported 00:26:14.846 NVM Command Set: Supported 00:26:14.846 Boot Partition: Not Supported 00:26:14.846 Memory Page Size Minimum: 4096 bytes 00:26:14.846 Memory Page Size Maximum: 4096 bytes 00:26:14.846 Persistent Memory Region: Not Supported 00:26:14.846 Optional Asynchronous Events Supported 00:26:14.846 Namespace Attribute Notices: Not Supported 00:26:14.846 Firmware Activation Notices: Not Supported 00:26:14.846 ANA Change Notices: Not Supported 00:26:14.846 PLE Aggregate Log Change Notices: Not Supported 00:26:14.846 LBA Status Info Alert Notices: Not Supported 00:26:14.846 EGE Aggregate Log Change Notices: Not Supported 00:26:14.847 Normal NVM Subsystem Shutdown event: Not Supported 00:26:14.847 Zone Descriptor Change Notices: Not Supported 00:26:14.847 Discovery Log Change Notices: Supported 00:26:14.847 Controller Attributes 00:26:14.847 128-bit Host Identifier: Not Supported 00:26:14.847 Non-Operational Permissive Mode: Not Supported 00:26:14.847 NVM Sets: Not Supported 00:26:14.847 Read Recovery Levels: Not Supported 00:26:14.847 Endurance Groups: Not Supported 00:26:14.847 Predictable Latency Mode: Not Supported 00:26:14.847 Traffic Based Keep ALive: Not Supported 00:26:14.847 Namespace Granularity: Not Supported 00:26:14.847 SQ Associations: Not Supported 00:26:14.847 UUID List: Not Supported 00:26:14.847 Multi-Domain Subsystem: Not Supported 00:26:14.847 Fixed Capacity Management: Not Supported 00:26:14.847 Variable Capacity Management: Not Supported 00:26:14.847 Delete Endurance Group: Not Supported 00:26:14.847 Delete NVM Set: Not Supported 00:26:14.847 Extended LBA Formats Supported: Not Supported 00:26:14.847 Flexible Data Placement Supported: Not Supported 00:26:14.847 00:26:14.847 Controller Memory Buffer Support 00:26:14.847 ================================ 00:26:14.847 Supported: No 00:26:14.847 00:26:14.847 Persistent Memory Region Support 00:26:14.847 ================================ 00:26:14.847 Supported: No 00:26:14.847 00:26:14.847 Admin Command Set Attributes 00:26:14.847 ============================ 00:26:14.847 Security Send/Receive: Not Supported 00:26:14.847 Format NVM: Not Supported 00:26:14.847 Firmware Activate/Download: Not Supported 00:26:14.847 Namespace Management: Not Supported 00:26:14.847 Device Self-Test: Not Supported 00:26:14.847 Directives: Not Supported 00:26:14.847 NVMe-MI: Not Supported 00:26:14.847 Virtualization Management: Not Supported 00:26:14.847 Doorbell Buffer Config: Not Supported 00:26:14.847 Get LBA Status Capability: Not Supported 00:26:14.847 Command & Feature Lockdown Capability: Not Supported 00:26:14.847 Abort Command Limit: 1 00:26:14.847 Async Event Request Limit: 4 00:26:14.847 Number of Firmware Slots: N/A 00:26:14.847 Firmware Slot 1 Read-Only: N/A 00:26:14.847 Firmware Activation Without Reset: N/A 00:26:14.847 Multiple Update Detection Support: N/A 00:26:14.847 Firmware Update Granularity: No Information Provided 00:26:14.847 Per-Namespace SMART Log: No 00:26:14.847 Asymmetric Namespace Access Log Page: Not Supported 00:26:14.847 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:14.847 Command Effects Log Page: Not Supported 00:26:14.847 Get Log Page Extended Data: Supported 00:26:14.847 Telemetry Log Pages: Not Supported 00:26:14.847 Persistent Event Log Pages: Not Supported 00:26:14.847 Supported Log Pages Log Page: May Support 00:26:14.847 Commands Supported & Effects Log Page: Not Supported 00:26:14.847 Feature Identifiers & Effects Log Page:May Support 00:26:14.847 NVMe-MI Commands & Effects Log Page: May Support 00:26:14.847 Data Area 4 for Telemetry Log: Not Supported 00:26:14.847 Error Log Page Entries Supported: 128 00:26:14.847 Keep Alive: Not Supported 00:26:14.847 00:26:14.847 NVM Command Set Attributes 00:26:14.847 ========================== 00:26:14.847 Submission Queue Entry Size 00:26:14.847 Max: 1 00:26:14.847 Min: 1 00:26:14.847 Completion Queue Entry Size 00:26:14.847 Max: 1 00:26:14.847 Min: 1 00:26:14.847 Number of Namespaces: 0 00:26:14.847 Compare Command: Not Supported 00:26:14.847 Write Uncorrectable Command: Not Supported 00:26:14.847 Dataset Management Command: Not Supported 00:26:14.847 Write Zeroes Command: Not Supported 00:26:14.847 Set Features Save Field: Not Supported 00:26:14.847 Reservations: Not Supported 00:26:14.847 Timestamp: Not Supported 00:26:14.847 Copy: Not Supported 00:26:14.847 Volatile Write Cache: Not Present 00:26:14.847 Atomic Write Unit (Normal): 1 00:26:14.847 Atomic Write Unit (PFail): 1 00:26:14.847 Atomic Compare & Write Unit: 1 00:26:14.847 Fused Compare & Write: Supported 00:26:14.847 Scatter-Gather List 00:26:14.847 SGL Command Set: Supported 00:26:14.847 SGL Keyed: Supported 00:26:14.847 SGL Bit Bucket Descriptor: Not Supported 00:26:14.847 SGL Metadata Pointer: Not Supported 00:26:14.847 Oversized SGL: Not Supported 00:26:14.847 SGL Metadata Address: Not Supported 00:26:14.847 SGL Offset: Supported 00:26:14.847 Transport SGL Data Block: Not Supported 00:26:14.847 Replay Protected Memory Block: Not Supported 00:26:14.847 00:26:14.847 Firmware Slot Information 00:26:14.847 ========================= 00:26:14.847 Active slot: 0 00:26:14.847 00:26:14.847 00:26:14.847 Error Log 00:26:14.847 ========= 00:26:14.847 00:26:14.847 Active Namespaces 00:26:14.847 ================= 00:26:14.847 Discovery Log Page 00:26:14.847 ================== 00:26:14.847 Generation Counter: 2 00:26:14.847 Number of Records: 2 00:26:14.847 Record Format: 0 00:26:14.847 00:26:14.847 Discovery Log Entry 0 00:26:14.847 ---------------------- 00:26:14.847 Transport Type: 3 (TCP) 00:26:14.847 Address Family: 1 (IPv4) 00:26:14.847 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:14.847 Entry Flags: 00:26:14.847 Duplicate Returned Information: 1 00:26:14.847 Explicit Persistent Connection Support for Discovery: 1 00:26:14.847 Transport Requirements: 00:26:14.847 Secure Channel: Not Required 00:26:14.847 Port ID: 0 (0x0000) 00:26:14.847 Controller ID: 65535 (0xffff) 00:26:14.847 Admin Max SQ Size: 128 00:26:14.847 Transport Service Identifier: 4420 00:26:14.847 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:14.847 Transport Address: 10.0.0.2 00:26:14.847 Discovery Log Entry 1 00:26:14.847 ---------------------- 00:26:14.847 Transport Type: 3 (TCP) 00:26:14.847 Address Family: 1 (IPv4) 00:26:14.847 Subsystem Type: 2 (NVM Subsystem) 00:26:14.847 Entry Flags: 00:26:14.847 Duplicate Returned Information: 0 00:26:14.847 Explicit Persistent Connection Support for Discovery: 0 00:26:14.847 Transport Requirements: 00:26:14.847 Secure Channel: Not Required 00:26:14.847 Port ID: 0 (0x0000) 00:26:14.847 Controller ID: 65535 (0xffff) 00:26:14.847 Admin Max SQ Size: 128 00:26:14.847 Transport Service Identifier: 4420 00:26:14.847 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:14.847 Transport Address: 10.0.0.2 [2024-11-18 16:12:38.408836] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:14.847 [2024-11-18 16:12:38.408862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:14.847 [2024-11-18 16:12:38.408875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:14.847 [2024-11-18 16:12:38.408885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:14.847 [2024-11-18 16:12:38.408895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:14.847 [2024-11-18 16:12:38.408913] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.847 [2024-11-18 16:12:38.408922] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.847 [2024-11-18 16:12:38.408928] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.847 [2024-11-18 16:12:38.408940] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.847 [2024-11-18 16:12:38.408981] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.847 [2024-11-18 16:12:38.409138] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.847 [2024-11-18 16:12:38.409153] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.847 [2024-11-18 16:12:38.409161] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.847 [2024-11-18 16:12:38.409168] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.847 [2024-11-18 16:12:38.409181] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.847 [2024-11-18 16:12:38.409189] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.847 [2024-11-18 16:12:38.409196] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.847 [2024-11-18 16:12:38.409207] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.847 [2024-11-18 16:12:38.409234] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.847 [2024-11-18 16:12:38.409352] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.847 [2024-11-18 16:12:38.409364] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.847 [2024-11-18 16:12:38.409371] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.847 [2024-11-18 16:12:38.409378] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.847 [2024-11-18 16:12:38.409388] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:14.847 [2024-11-18 16:12:38.409397] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:14.847 [2024-11-18 16:12:38.409413] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.409422] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.409428] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.848 [2024-11-18 16:12:38.409439] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.848 [2024-11-18 16:12:38.409460] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.848 [2024-11-18 16:12:38.409543] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.848 [2024-11-18 16:12:38.409558] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.848 [2024-11-18 16:12:38.409565] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.409572] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.848 [2024-11-18 16:12:38.409591] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.409600] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.409615] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.848 [2024-11-18 16:12:38.409627] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.848 [2024-11-18 16:12:38.409649] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.848 [2024-11-18 16:12:38.409741] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.848 [2024-11-18 16:12:38.409754] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.848 [2024-11-18 16:12:38.409761] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.409771] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.848 [2024-11-18 16:12:38.409790] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.409800] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.409806] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.848 [2024-11-18 16:12:38.409817] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.848 [2024-11-18 16:12:38.409838] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.848 [2024-11-18 16:12:38.409929] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.848 [2024-11-18 16:12:38.409942] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.848 [2024-11-18 16:12:38.409948] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.409955] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.848 [2024-11-18 16:12:38.409973] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.409982] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.409988] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.848 [2024-11-18 16:12:38.409999] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.848 [2024-11-18 16:12:38.410020] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.848 [2024-11-18 16:12:38.410115] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.848 [2024-11-18 16:12:38.410129] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.848 [2024-11-18 16:12:38.410136] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410143] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.848 [2024-11-18 16:12:38.410161] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410171] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410177] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.848 [2024-11-18 16:12:38.410188] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.848 [2024-11-18 16:12:38.410209] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.848 [2024-11-18 16:12:38.410297] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.848 [2024-11-18 16:12:38.410311] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.848 [2024-11-18 16:12:38.410318] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410325] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.848 [2024-11-18 16:12:38.410343] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410352] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410359] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.848 [2024-11-18 16:12:38.410369] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.848 [2024-11-18 16:12:38.410390] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.848 [2024-11-18 16:12:38.410468] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.848 [2024-11-18 16:12:38.410480] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.848 [2024-11-18 16:12:38.410487] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410498] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.848 [2024-11-18 16:12:38.410516] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410526] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410532] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.848 [2024-11-18 16:12:38.410543] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.848 [2024-11-18 16:12:38.410564] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.848 [2024-11-18 16:12:38.410661] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.848 [2024-11-18 16:12:38.410676] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.848 [2024-11-18 16:12:38.410683] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410690] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.848 [2024-11-18 16:12:38.410709] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410718] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410725] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.848 [2024-11-18 16:12:38.410736] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.848 [2024-11-18 16:12:38.410757] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.848 [2024-11-18 16:12:38.410827] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.848 [2024-11-18 16:12:38.410839] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.848 [2024-11-18 16:12:38.410846] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410853] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.848 [2024-11-18 16:12:38.410870] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410880] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.410887] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.848 [2024-11-18 16:12:38.410898] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.848 [2024-11-18 16:12:38.410918] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.848 [2024-11-18 16:12:38.411008] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.848 [2024-11-18 16:12:38.411022] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.848 [2024-11-18 16:12:38.411029] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.411036] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.848 [2024-11-18 16:12:38.411054] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.411063] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.848 [2024-11-18 16:12:38.411070] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.848 [2024-11-18 16:12:38.411080] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.848 [2024-11-18 16:12:38.411101] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.848 [2024-11-18 16:12:38.411196] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.848 [2024-11-18 16:12:38.411210] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.849 [2024-11-18 16:12:38.411218] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.849 [2024-11-18 16:12:38.411224] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.849 [2024-11-18 16:12:38.411247] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.849 [2024-11-18 16:12:38.411257] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.849 [2024-11-18 16:12:38.411264] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.849 [2024-11-18 16:12:38.411274] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.849 [2024-11-18 16:12:38.411295] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.849 [2024-11-18 16:12:38.411367] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.849 [2024-11-18 16:12:38.411380] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.849 [2024-11-18 16:12:38.411387] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.849 [2024-11-18 16:12:38.411394] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.849 [2024-11-18 16:12:38.411411] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.849 [2024-11-18 16:12:38.411421] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.849 [2024-11-18 16:12:38.411427] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.849 [2024-11-18 16:12:38.411438] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.849 [2024-11-18 16:12:38.411459] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.849 [2024-11-18 16:12:38.411534] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.849 [2024-11-18 16:12:38.411547] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.849 [2024-11-18 16:12:38.411554] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.849 [2024-11-18 16:12:38.411560] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.849 [2024-11-18 16:12:38.411578] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:14.849 [2024-11-18 16:12:38.411587] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:14.849 [2024-11-18 16:12:38.411594] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13a6420) 00:26:14.849 [2024-11-18 16:12:38.411605] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:14.849 [2024-11-18 16:12:38.415654] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x140bf20, cid 3, qid 0 00:26:14.849 [2024-11-18 16:12:38.415803] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:14.849 [2024-11-18 16:12:38.415818] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:14.849 [2024-11-18 16:12:38.415825] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:14.849 [2024-11-18 16:12:38.415832] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x140bf20) on tqpair=0x13a6420 00:26:14.849 [2024-11-18 16:12:38.415848] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:26:14.849 00:26:15.111 16:12:38 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:15.111 [2024-11-18 16:12:38.446019] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:15.111 [2024-11-18 16:12:38.446059] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1671861 ] 00:26:15.111 EAL: No free 2048 kB hugepages reported on node 1 00:26:15.111 [2024-11-18 16:12:38.477476] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:15.111 [2024-11-18 16:12:38.477520] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:15.111 [2024-11-18 16:12:38.477530] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:15.111 [2024-11-18 16:12:38.477543] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:15.111 [2024-11-18 16:12:38.477554] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:15.111 [2024-11-18 16:12:38.481665] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:15.111 [2024-11-18 16:12:38.481707] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x650420 0 00:26:15.111 [2024-11-18 16:12:38.489635] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:15.111 [2024-11-18 16:12:38.489655] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:15.111 [2024-11-18 16:12:38.489663] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:15.111 [2024-11-18 16:12:38.489669] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:15.111 [2024-11-18 16:12:38.489721] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.489734] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.489741] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x650420) 00:26:15.111 [2024-11-18 16:12:38.489755] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:15.111 [2024-11-18 16:12:38.489782] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5b00, cid 0, qid 0 00:26:15.111 [2024-11-18 16:12:38.497634] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.111 [2024-11-18 16:12:38.497652] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.111 [2024-11-18 16:12:38.497660] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.497666] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5b00) on tqpair=0x650420 00:26:15.111 [2024-11-18 16:12:38.497699] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:15.111 [2024-11-18 16:12:38.497711] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:15.111 [2024-11-18 16:12:38.497721] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:15.111 [2024-11-18 16:12:38.497738] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.497748] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.497755] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x650420) 00:26:15.111 [2024-11-18 16:12:38.497766] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.111 [2024-11-18 16:12:38.497791] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5b00, cid 0, qid 0 00:26:15.111 [2024-11-18 16:12:38.497888] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.111 [2024-11-18 16:12:38.497901] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.111 [2024-11-18 16:12:38.497908] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.497915] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5b00) on tqpair=0x650420 00:26:15.111 [2024-11-18 16:12:38.497923] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:15.111 [2024-11-18 16:12:38.497936] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:15.111 [2024-11-18 16:12:38.497949] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.497961] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.497968] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x650420) 00:26:15.111 [2024-11-18 16:12:38.497979] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.111 [2024-11-18 16:12:38.498001] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5b00, cid 0, qid 0 00:26:15.111 [2024-11-18 16:12:38.498093] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.111 [2024-11-18 16:12:38.498107] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.111 [2024-11-18 16:12:38.498114] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498120] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5b00) on tqpair=0x650420 00:26:15.111 [2024-11-18 16:12:38.498129] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:15.111 [2024-11-18 16:12:38.498143] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:15.111 [2024-11-18 16:12:38.498156] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498164] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498170] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x650420) 00:26:15.111 [2024-11-18 16:12:38.498181] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.111 [2024-11-18 16:12:38.498202] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5b00, cid 0, qid 0 00:26:15.111 [2024-11-18 16:12:38.498279] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.111 [2024-11-18 16:12:38.498293] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.111 [2024-11-18 16:12:38.498300] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498306] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5b00) on tqpair=0x650420 00:26:15.111 [2024-11-18 16:12:38.498315] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:15.111 [2024-11-18 16:12:38.498332] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498342] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498348] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x650420) 00:26:15.111 [2024-11-18 16:12:38.498359] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.111 [2024-11-18 16:12:38.498380] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5b00, cid 0, qid 0 00:26:15.111 [2024-11-18 16:12:38.498455] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.111 [2024-11-18 16:12:38.498469] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.111 [2024-11-18 16:12:38.498476] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498483] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5b00) on tqpair=0x650420 00:26:15.111 [2024-11-18 16:12:38.498490] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:15.111 [2024-11-18 16:12:38.498499] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:15.111 [2024-11-18 16:12:38.498512] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:15.111 [2024-11-18 16:12:38.498622] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:15.111 [2024-11-18 16:12:38.498638] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:15.111 [2024-11-18 16:12:38.498655] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498664] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498671] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x650420) 00:26:15.111 [2024-11-18 16:12:38.498682] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.111 [2024-11-18 16:12:38.498704] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5b00, cid 0, qid 0 00:26:15.111 [2024-11-18 16:12:38.498781] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.111 [2024-11-18 16:12:38.498795] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.111 [2024-11-18 16:12:38.498802] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498809] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5b00) on tqpair=0x650420 00:26:15.111 [2024-11-18 16:12:38.498817] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:15.111 [2024-11-18 16:12:38.498834] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498844] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.111 [2024-11-18 16:12:38.498850] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x650420) 00:26:15.111 [2024-11-18 16:12:38.498861] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.111 [2024-11-18 16:12:38.498882] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5b00, cid 0, qid 0 00:26:15.111 [2024-11-18 16:12:38.498960] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.111 [2024-11-18 16:12:38.498974] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.112 [2024-11-18 16:12:38.498981] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.498987] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5b00) on tqpair=0x650420 00:26:15.112 [2024-11-18 16:12:38.498995] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:15.112 [2024-11-18 16:12:38.499004] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:15.112 [2024-11-18 16:12:38.499017] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:15.112 [2024-11-18 16:12:38.499032] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:15.112 [2024-11-18 16:12:38.499045] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.499053] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.499060] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x650420) 00:26:15.112 [2024-11-18 16:12:38.499071] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.112 [2024-11-18 16:12:38.499092] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5b00, cid 0, qid 0 00:26:15.112 [2024-11-18 16:12:38.499214] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:15.112 [2024-11-18 16:12:38.499226] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:15.112 [2024-11-18 16:12:38.499233] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.499239] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x650420): datao=0, datal=4096, cccid=0 00:26:15.112 [2024-11-18 16:12:38.499247] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x6b5b00) on tqpair(0x650420): expected_datao=0, payload_size=4096 00:26:15.112 [2024-11-18 16:12:38.499268] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.499278] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.539748] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.112 [2024-11-18 16:12:38.539767] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.112 [2024-11-18 16:12:38.539775] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.539782] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5b00) on tqpair=0x650420 00:26:15.112 [2024-11-18 16:12:38.539793] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:15.112 [2024-11-18 16:12:38.539802] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:15.112 [2024-11-18 16:12:38.539809] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:15.112 [2024-11-18 16:12:38.539816] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:15.112 [2024-11-18 16:12:38.539824] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:15.112 [2024-11-18 16:12:38.539832] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:15.112 [2024-11-18 16:12:38.539851] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:15.112 [2024-11-18 16:12:38.539865] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.539873] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.539880] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x650420) 00:26:15.112 [2024-11-18 16:12:38.539892] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:15.112 [2024-11-18 16:12:38.539916] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5b00, cid 0, qid 0 00:26:15.112 [2024-11-18 16:12:38.540006] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.112 [2024-11-18 16:12:38.540020] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.112 [2024-11-18 16:12:38.540027] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540034] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5b00) on tqpair=0x650420 00:26:15.112 [2024-11-18 16:12:38.540044] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540052] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540058] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x650420) 00:26:15.112 [2024-11-18 16:12:38.540068] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:15.112 [2024-11-18 16:12:38.540079] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540086] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540093] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x650420) 00:26:15.112 [2024-11-18 16:12:38.540101] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:15.112 [2024-11-18 16:12:38.540111] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540118] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540125] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x650420) 00:26:15.112 [2024-11-18 16:12:38.540134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:15.112 [2024-11-18 16:12:38.540148] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540156] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540162] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x650420) 00:26:15.112 [2024-11-18 16:12:38.540171] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:15.112 [2024-11-18 16:12:38.540180] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:15.112 [2024-11-18 16:12:38.540199] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:15.112 [2024-11-18 16:12:38.540212] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540220] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540226] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x650420) 00:26:15.112 [2024-11-18 16:12:38.540237] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.112 [2024-11-18 16:12:38.540275] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5b00, cid 0, qid 0 00:26:15.112 [2024-11-18 16:12:38.540287] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5c60, cid 1, qid 0 00:26:15.112 [2024-11-18 16:12:38.540294] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5dc0, cid 2, qid 0 00:26:15.112 [2024-11-18 16:12:38.540301] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5f20, cid 3, qid 0 00:26:15.112 [2024-11-18 16:12:38.540309] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b6080, cid 4, qid 0 00:26:15.112 [2024-11-18 16:12:38.540498] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.112 [2024-11-18 16:12:38.540513] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.112 [2024-11-18 16:12:38.540520] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540526] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b6080) on tqpair=0x650420 00:26:15.112 [2024-11-18 16:12:38.540534] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:15.112 [2024-11-18 16:12:38.540543] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:15.112 [2024-11-18 16:12:38.540558] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:15.112 [2024-11-18 16:12:38.540574] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:15.112 [2024-11-18 16:12:38.540587] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540594] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540601] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x650420) 00:26:15.112 [2024-11-18 16:12:38.540620] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:15.112 [2024-11-18 16:12:38.540644] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b6080, cid 4, qid 0 00:26:15.112 [2024-11-18 16:12:38.540771] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.112 [2024-11-18 16:12:38.540785] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.112 [2024-11-18 16:12:38.540791] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540798] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b6080) on tqpair=0x650420 00:26:15.112 [2024-11-18 16:12:38.540862] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:15.112 [2024-11-18 16:12:38.540886] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:15.112 [2024-11-18 16:12:38.540902] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540910] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.540916] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x650420) 00:26:15.112 [2024-11-18 16:12:38.540927] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.112 [2024-11-18 16:12:38.540949] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b6080, cid 4, qid 0 00:26:15.112 [2024-11-18 16:12:38.541091] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:15.112 [2024-11-18 16:12:38.541104] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:15.112 [2024-11-18 16:12:38.541110] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.541117] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x650420): datao=0, datal=4096, cccid=4 00:26:15.112 [2024-11-18 16:12:38.541124] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x6b6080) on tqpair(0x650420): expected_datao=0, payload_size=4096 00:26:15.112 [2024-11-18 16:12:38.541135] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.541142] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:15.112 [2024-11-18 16:12:38.541154] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.112 [2024-11-18 16:12:38.541163] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.113 [2024-11-18 16:12:38.541170] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.541176] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b6080) on tqpair=0x650420 00:26:15.113 [2024-11-18 16:12:38.541198] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:15.113 [2024-11-18 16:12:38.541220] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:15.113 [2024-11-18 16:12:38.541239] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:15.113 [2024-11-18 16:12:38.541253] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.541261] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.541267] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x650420) 00:26:15.113 [2024-11-18 16:12:38.541278] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.113 [2024-11-18 16:12:38.541300] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b6080, cid 4, qid 0 00:26:15.113 [2024-11-18 16:12:38.541407] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:15.113 [2024-11-18 16:12:38.541419] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:15.113 [2024-11-18 16:12:38.541426] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.541432] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x650420): datao=0, datal=4096, cccid=4 00:26:15.113 [2024-11-18 16:12:38.541439] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x6b6080) on tqpair(0x650420): expected_datao=0, payload_size=4096 00:26:15.113 [2024-11-18 16:12:38.541456] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.541465] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.585638] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.113 [2024-11-18 16:12:38.585658] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.113 [2024-11-18 16:12:38.585666] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.585677] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b6080) on tqpair=0x650420 00:26:15.113 [2024-11-18 16:12:38.585704] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:15.113 [2024-11-18 16:12:38.585725] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:15.113 [2024-11-18 16:12:38.585740] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.585749] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.585756] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x650420) 00:26:15.113 [2024-11-18 16:12:38.585767] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.113 [2024-11-18 16:12:38.585793] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b6080, cid 4, qid 0 00:26:15.113 [2024-11-18 16:12:38.585894] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:15.113 [2024-11-18 16:12:38.585907] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:15.113 [2024-11-18 16:12:38.585913] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.585920] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x650420): datao=0, datal=4096, cccid=4 00:26:15.113 [2024-11-18 16:12:38.585927] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x6b6080) on tqpair(0x650420): expected_datao=0, payload_size=4096 00:26:15.113 [2024-11-18 16:12:38.585944] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.585954] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.626685] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.113 [2024-11-18 16:12:38.626705] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.113 [2024-11-18 16:12:38.626712] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.626719] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b6080) on tqpair=0x650420 00:26:15.113 [2024-11-18 16:12:38.626734] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:15.113 [2024-11-18 16:12:38.626750] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:15.113 [2024-11-18 16:12:38.626768] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:15.113 [2024-11-18 16:12:38.626779] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:15.113 [2024-11-18 16:12:38.626788] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:15.113 [2024-11-18 16:12:38.626797] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:15.113 [2024-11-18 16:12:38.626805] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:15.113 [2024-11-18 16:12:38.626814] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:15.113 [2024-11-18 16:12:38.626834] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.626843] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.626850] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x650420) 00:26:15.113 [2024-11-18 16:12:38.626862] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.113 [2024-11-18 16:12:38.626878] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.626887] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.626894] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x650420) 00:26:15.113 [2024-11-18 16:12:38.626903] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:15.113 [2024-11-18 16:12:38.626931] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b6080, cid 4, qid 0 00:26:15.113 [2024-11-18 16:12:38.626944] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b61e0, cid 5, qid 0 00:26:15.113 [2024-11-18 16:12:38.627034] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.113 [2024-11-18 16:12:38.627049] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.113 [2024-11-18 16:12:38.627055] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627062] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b6080) on tqpair=0x650420 00:26:15.113 [2024-11-18 16:12:38.627073] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.113 [2024-11-18 16:12:38.627082] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.113 [2024-11-18 16:12:38.627088] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627095] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b61e0) on tqpair=0x650420 00:26:15.113 [2024-11-18 16:12:38.627111] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627120] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627127] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x650420) 00:26:15.113 [2024-11-18 16:12:38.627138] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.113 [2024-11-18 16:12:38.627159] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b61e0, cid 5, qid 0 00:26:15.113 [2024-11-18 16:12:38.627248] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.113 [2024-11-18 16:12:38.627260] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.113 [2024-11-18 16:12:38.627266] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627273] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b61e0) on tqpair=0x650420 00:26:15.113 [2024-11-18 16:12:38.627288] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627298] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627304] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x650420) 00:26:15.113 [2024-11-18 16:12:38.627315] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.113 [2024-11-18 16:12:38.627335] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b61e0, cid 5, qid 0 00:26:15.113 [2024-11-18 16:12:38.627413] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.113 [2024-11-18 16:12:38.627427] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.113 [2024-11-18 16:12:38.627434] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627441] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b61e0) on tqpair=0x650420 00:26:15.113 [2024-11-18 16:12:38.627457] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627466] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627473] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x650420) 00:26:15.113 [2024-11-18 16:12:38.627483] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.113 [2024-11-18 16:12:38.627508] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b61e0, cid 5, qid 0 00:26:15.113 [2024-11-18 16:12:38.627590] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.113 [2024-11-18 16:12:38.627605] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.113 [2024-11-18 16:12:38.627626] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627636] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b61e0) on tqpair=0x650420 00:26:15.113 [2024-11-18 16:12:38.627658] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627668] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627675] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x650420) 00:26:15.113 [2024-11-18 16:12:38.627686] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.113 [2024-11-18 16:12:38.627698] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627706] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.113 [2024-11-18 16:12:38.627713] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x650420) 00:26:15.114 [2024-11-18 16:12:38.627722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.114 [2024-11-18 16:12:38.627734] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.627742] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.627749] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x650420) 00:26:15.114 [2024-11-18 16:12:38.627758] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.114 [2024-11-18 16:12:38.627771] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.627779] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.627785] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x650420) 00:26:15.114 [2024-11-18 16:12:38.627795] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.114 [2024-11-18 16:12:38.627818] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b61e0, cid 5, qid 0 00:26:15.114 [2024-11-18 16:12:38.627830] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b6080, cid 4, qid 0 00:26:15.114 [2024-11-18 16:12:38.627838] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b6340, cid 6, qid 0 00:26:15.114 [2024-11-18 16:12:38.627845] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b64a0, cid 7, qid 0 00:26:15.114 [2024-11-18 16:12:38.628001] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:15.114 [2024-11-18 16:12:38.628016] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:15.114 [2024-11-18 16:12:38.628022] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628029] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x650420): datao=0, datal=8192, cccid=5 00:26:15.114 [2024-11-18 16:12:38.628036] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x6b61e0) on tqpair(0x650420): expected_datao=0, payload_size=8192 00:26:15.114 [2024-11-18 16:12:38.628056] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628065] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628078] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:15.114 [2024-11-18 16:12:38.628088] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:15.114 [2024-11-18 16:12:38.628094] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628104] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x650420): datao=0, datal=512, cccid=4 00:26:15.114 [2024-11-18 16:12:38.628112] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x6b6080) on tqpair(0x650420): expected_datao=0, payload_size=512 00:26:15.114 [2024-11-18 16:12:38.628122] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628129] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628137] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:15.114 [2024-11-18 16:12:38.628146] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:15.114 [2024-11-18 16:12:38.628152] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628158] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x650420): datao=0, datal=512, cccid=6 00:26:15.114 [2024-11-18 16:12:38.628166] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x6b6340) on tqpair(0x650420): expected_datao=0, payload_size=512 00:26:15.114 [2024-11-18 16:12:38.628175] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628182] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628190] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:15.114 [2024-11-18 16:12:38.628199] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:15.114 [2024-11-18 16:12:38.628205] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628211] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x650420): datao=0, datal=4096, cccid=7 00:26:15.114 [2024-11-18 16:12:38.628219] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x6b64a0) on tqpair(0x650420): expected_datao=0, payload_size=4096 00:26:15.114 [2024-11-18 16:12:38.628229] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628236] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628247] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.114 [2024-11-18 16:12:38.628257] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.114 [2024-11-18 16:12:38.628263] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628270] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b61e0) on tqpair=0x650420 00:26:15.114 [2024-11-18 16:12:38.628289] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.114 [2024-11-18 16:12:38.628301] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.114 [2024-11-18 16:12:38.628308] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628314] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b6080) on tqpair=0x650420 00:26:15.114 [2024-11-18 16:12:38.628328] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.114 [2024-11-18 16:12:38.628339] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.114 [2024-11-18 16:12:38.628345] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628366] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b6340) on tqpair=0x650420 00:26:15.114 [2024-11-18 16:12:38.628377] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.114 [2024-11-18 16:12:38.628386] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.114 [2024-11-18 16:12:38.628392] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.114 [2024-11-18 16:12:38.628398] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b64a0) on tqpair=0x650420 00:26:15.114 ===================================================== 00:26:15.114 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:15.114 ===================================================== 00:26:15.114 Controller Capabilities/Features 00:26:15.114 ================================ 00:26:15.114 Vendor ID: 8086 00:26:15.114 Subsystem Vendor ID: 8086 00:26:15.114 Serial Number: SPDK00000000000001 00:26:15.114 Model Number: SPDK bdev Controller 00:26:15.114 Firmware Version: 24.01.1 00:26:15.114 Recommended Arb Burst: 6 00:26:15.114 IEEE OUI Identifier: e4 d2 5c 00:26:15.114 Multi-path I/O 00:26:15.114 May have multiple subsystem ports: Yes 00:26:15.114 May have multiple controllers: Yes 00:26:15.114 Associated with SR-IOV VF: No 00:26:15.114 Max Data Transfer Size: 131072 00:26:15.114 Max Number of Namespaces: 32 00:26:15.114 Max Number of I/O Queues: 127 00:26:15.114 NVMe Specification Version (VS): 1.3 00:26:15.114 NVMe Specification Version (Identify): 1.3 00:26:15.114 Maximum Queue Entries: 128 00:26:15.114 Contiguous Queues Required: Yes 00:26:15.114 Arbitration Mechanisms Supported 00:26:15.114 Weighted Round Robin: Not Supported 00:26:15.114 Vendor Specific: Not Supported 00:26:15.114 Reset Timeout: 15000 ms 00:26:15.114 Doorbell Stride: 4 bytes 00:26:15.114 NVM Subsystem Reset: Not Supported 00:26:15.114 Command Sets Supported 00:26:15.114 NVM Command Set: Supported 00:26:15.114 Boot Partition: Not Supported 00:26:15.114 Memory Page Size Minimum: 4096 bytes 00:26:15.114 Memory Page Size Maximum: 4096 bytes 00:26:15.114 Persistent Memory Region: Not Supported 00:26:15.114 Optional Asynchronous Events Supported 00:26:15.114 Namespace Attribute Notices: Supported 00:26:15.114 Firmware Activation Notices: Not Supported 00:26:15.114 ANA Change Notices: Not Supported 00:26:15.114 PLE Aggregate Log Change Notices: Not Supported 00:26:15.114 LBA Status Info Alert Notices: Not Supported 00:26:15.114 EGE Aggregate Log Change Notices: Not Supported 00:26:15.114 Normal NVM Subsystem Shutdown event: Not Supported 00:26:15.114 Zone Descriptor Change Notices: Not Supported 00:26:15.114 Discovery Log Change Notices: Not Supported 00:26:15.114 Controller Attributes 00:26:15.114 128-bit Host Identifier: Supported 00:26:15.114 Non-Operational Permissive Mode: Not Supported 00:26:15.114 NVM Sets: Not Supported 00:26:15.114 Read Recovery Levels: Not Supported 00:26:15.114 Endurance Groups: Not Supported 00:26:15.114 Predictable Latency Mode: Not Supported 00:26:15.114 Traffic Based Keep ALive: Not Supported 00:26:15.114 Namespace Granularity: Not Supported 00:26:15.114 SQ Associations: Not Supported 00:26:15.114 UUID List: Not Supported 00:26:15.114 Multi-Domain Subsystem: Not Supported 00:26:15.114 Fixed Capacity Management: Not Supported 00:26:15.114 Variable Capacity Management: Not Supported 00:26:15.114 Delete Endurance Group: Not Supported 00:26:15.114 Delete NVM Set: Not Supported 00:26:15.114 Extended LBA Formats Supported: Not Supported 00:26:15.114 Flexible Data Placement Supported: Not Supported 00:26:15.114 00:26:15.114 Controller Memory Buffer Support 00:26:15.114 ================================ 00:26:15.114 Supported: No 00:26:15.114 00:26:15.114 Persistent Memory Region Support 00:26:15.114 ================================ 00:26:15.114 Supported: No 00:26:15.114 00:26:15.114 Admin Command Set Attributes 00:26:15.114 ============================ 00:26:15.114 Security Send/Receive: Not Supported 00:26:15.114 Format NVM: Not Supported 00:26:15.114 Firmware Activate/Download: Not Supported 00:26:15.114 Namespace Management: Not Supported 00:26:15.114 Device Self-Test: Not Supported 00:26:15.114 Directives: Not Supported 00:26:15.114 NVMe-MI: Not Supported 00:26:15.114 Virtualization Management: Not Supported 00:26:15.114 Doorbell Buffer Config: Not Supported 00:26:15.114 Get LBA Status Capability: Not Supported 00:26:15.115 Command & Feature Lockdown Capability: Not Supported 00:26:15.115 Abort Command Limit: 4 00:26:15.115 Async Event Request Limit: 4 00:26:15.115 Number of Firmware Slots: N/A 00:26:15.115 Firmware Slot 1 Read-Only: N/A 00:26:15.115 Firmware Activation Without Reset: N/A 00:26:15.115 Multiple Update Detection Support: N/A 00:26:15.115 Firmware Update Granularity: No Information Provided 00:26:15.115 Per-Namespace SMART Log: No 00:26:15.115 Asymmetric Namespace Access Log Page: Not Supported 00:26:15.115 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:15.115 Command Effects Log Page: Supported 00:26:15.115 Get Log Page Extended Data: Supported 00:26:15.115 Telemetry Log Pages: Not Supported 00:26:15.115 Persistent Event Log Pages: Not Supported 00:26:15.115 Supported Log Pages Log Page: May Support 00:26:15.115 Commands Supported & Effects Log Page: Not Supported 00:26:15.115 Feature Identifiers & Effects Log Page:May Support 00:26:15.115 NVMe-MI Commands & Effects Log Page: May Support 00:26:15.115 Data Area 4 for Telemetry Log: Not Supported 00:26:15.115 Error Log Page Entries Supported: 128 00:26:15.115 Keep Alive: Supported 00:26:15.115 Keep Alive Granularity: 10000 ms 00:26:15.115 00:26:15.115 NVM Command Set Attributes 00:26:15.115 ========================== 00:26:15.115 Submission Queue Entry Size 00:26:15.115 Max: 64 00:26:15.115 Min: 64 00:26:15.115 Completion Queue Entry Size 00:26:15.115 Max: 16 00:26:15.115 Min: 16 00:26:15.115 Number of Namespaces: 32 00:26:15.115 Compare Command: Supported 00:26:15.115 Write Uncorrectable Command: Not Supported 00:26:15.115 Dataset Management Command: Supported 00:26:15.115 Write Zeroes Command: Supported 00:26:15.115 Set Features Save Field: Not Supported 00:26:15.115 Reservations: Supported 00:26:15.115 Timestamp: Not Supported 00:26:15.115 Copy: Supported 00:26:15.115 Volatile Write Cache: Present 00:26:15.115 Atomic Write Unit (Normal): 1 00:26:15.115 Atomic Write Unit (PFail): 1 00:26:15.115 Atomic Compare & Write Unit: 1 00:26:15.115 Fused Compare & Write: Supported 00:26:15.115 Scatter-Gather List 00:26:15.115 SGL Command Set: Supported 00:26:15.115 SGL Keyed: Supported 00:26:15.115 SGL Bit Bucket Descriptor: Not Supported 00:26:15.115 SGL Metadata Pointer: Not Supported 00:26:15.115 Oversized SGL: Not Supported 00:26:15.115 SGL Metadata Address: Not Supported 00:26:15.115 SGL Offset: Supported 00:26:15.115 Transport SGL Data Block: Not Supported 00:26:15.115 Replay Protected Memory Block: Not Supported 00:26:15.115 00:26:15.115 Firmware Slot Information 00:26:15.115 ========================= 00:26:15.115 Active slot: 1 00:26:15.115 Slot 1 Firmware Revision: 24.01.1 00:26:15.115 00:26:15.115 00:26:15.115 Commands Supported and Effects 00:26:15.115 ============================== 00:26:15.115 Admin Commands 00:26:15.115 -------------- 00:26:15.115 Get Log Page (02h): Supported 00:26:15.115 Identify (06h): Supported 00:26:15.115 Abort (08h): Supported 00:26:15.115 Set Features (09h): Supported 00:26:15.115 Get Features (0Ah): Supported 00:26:15.115 Asynchronous Event Request (0Ch): Supported 00:26:15.115 Keep Alive (18h): Supported 00:26:15.115 I/O Commands 00:26:15.115 ------------ 00:26:15.115 Flush (00h): Supported LBA-Change 00:26:15.115 Write (01h): Supported LBA-Change 00:26:15.115 Read (02h): Supported 00:26:15.115 Compare (05h): Supported 00:26:15.115 Write Zeroes (08h): Supported LBA-Change 00:26:15.115 Dataset Management (09h): Supported LBA-Change 00:26:15.115 Copy (19h): Supported LBA-Change 00:26:15.115 Unknown (79h): Supported LBA-Change 00:26:15.115 Unknown (7Ah): Supported 00:26:15.115 00:26:15.115 Error Log 00:26:15.115 ========= 00:26:15.115 00:26:15.115 Arbitration 00:26:15.115 =========== 00:26:15.115 Arbitration Burst: 1 00:26:15.115 00:26:15.115 Power Management 00:26:15.115 ================ 00:26:15.115 Number of Power States: 1 00:26:15.115 Current Power State: Power State #0 00:26:15.115 Power State #0: 00:26:15.115 Max Power: 0.00 W 00:26:15.115 Non-Operational State: Operational 00:26:15.115 Entry Latency: Not Reported 00:26:15.115 Exit Latency: Not Reported 00:26:15.115 Relative Read Throughput: 0 00:26:15.115 Relative Read Latency: 0 00:26:15.115 Relative Write Throughput: 0 00:26:15.115 Relative Write Latency: 0 00:26:15.115 Idle Power: Not Reported 00:26:15.115 Active Power: Not Reported 00:26:15.115 Non-Operational Permissive Mode: Not Supported 00:26:15.115 00:26:15.115 Health Information 00:26:15.115 ================== 00:26:15.115 Critical Warnings: 00:26:15.115 Available Spare Space: OK 00:26:15.115 Temperature: OK 00:26:15.115 Device Reliability: OK 00:26:15.115 Read Only: No 00:26:15.115 Volatile Memory Backup: OK 00:26:15.115 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:15.115 Temperature Threshold: [2024-11-18 16:12:38.628547] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.115 [2024-11-18 16:12:38.628559] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.115 [2024-11-18 16:12:38.628565] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x650420) 00:26:15.115 [2024-11-18 16:12:38.628576] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.115 [2024-11-18 16:12:38.628601] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b64a0, cid 7, qid 0 00:26:15.115 [2024-11-18 16:12:38.628737] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.115 [2024-11-18 16:12:38.628751] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.115 [2024-11-18 16:12:38.628757] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.115 [2024-11-18 16:12:38.628764] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b64a0) on tqpair=0x650420 00:26:15.115 [2024-11-18 16:12:38.628805] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:15.115 [2024-11-18 16:12:38.628827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:15.115 [2024-11-18 16:12:38.628839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:15.115 [2024-11-18 16:12:38.628849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:15.115 [2024-11-18 16:12:38.628859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:15.115 [2024-11-18 16:12:38.628871] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.115 [2024-11-18 16:12:38.628880] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.115 [2024-11-18 16:12:38.628886] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x650420) 00:26:15.115 [2024-11-18 16:12:38.628897] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.115 [2024-11-18 16:12:38.628920] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5f20, cid 3, qid 0 00:26:15.115 [2024-11-18 16:12:38.629031] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.115 [2024-11-18 16:12:38.629046] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.115 [2024-11-18 16:12:38.629052] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.115 [2024-11-18 16:12:38.629059] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5f20) on tqpair=0x650420 00:26:15.115 [2024-11-18 16:12:38.629070] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.115 [2024-11-18 16:12:38.629078] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.115 [2024-11-18 16:12:38.629085] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x650420) 00:26:15.115 [2024-11-18 16:12:38.629095] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.116 [2024-11-18 16:12:38.629122] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5f20, cid 3, qid 0 00:26:15.116 [2024-11-18 16:12:38.629212] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.116 [2024-11-18 16:12:38.629226] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.116 [2024-11-18 16:12:38.629233] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.116 [2024-11-18 16:12:38.629239] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5f20) on tqpair=0x650420 00:26:15.116 [2024-11-18 16:12:38.629247] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:15.116 [2024-11-18 16:12:38.629255] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:15.116 [2024-11-18 16:12:38.629271] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.116 [2024-11-18 16:12:38.629280] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.116 [2024-11-18 16:12:38.629287] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x650420) 00:26:15.116 [2024-11-18 16:12:38.629298] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.116 [2024-11-18 16:12:38.629322] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5f20, cid 3, qid 0 00:26:15.116 [2024-11-18 16:12:38.629400] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.116 [2024-11-18 16:12:38.629414] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.116 [2024-11-18 16:12:38.629421] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.116 [2024-11-18 16:12:38.629427] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5f20) on tqpair=0x650420 00:26:15.116 [2024-11-18 16:12:38.629444] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.116 [2024-11-18 16:12:38.629454] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.116 [2024-11-18 16:12:38.629460] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x650420) 00:26:15.116 [2024-11-18 16:12:38.629471] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.116 [2024-11-18 16:12:38.629492] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5f20, cid 3, qid 0 00:26:15.116 [2024-11-18 16:12:38.629566] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.116 [2024-11-18 16:12:38.629579] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.116 [2024-11-18 16:12:38.629585] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.116 [2024-11-18 16:12:38.629592] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5f20) on tqpair=0x650420 00:26:15.116 [2024-11-18 16:12:38.633615] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:15.116 [2024-11-18 16:12:38.633644] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:15.116 [2024-11-18 16:12:38.633652] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x650420) 00:26:15.116 [2024-11-18 16:12:38.633662] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:15.116 [2024-11-18 16:12:38.633685] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x6b5f20, cid 3, qid 0 00:26:15.116 [2024-11-18 16:12:38.633799] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:15.116 [2024-11-18 16:12:38.633812] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:15.116 [2024-11-18 16:12:38.633819] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:15.116 [2024-11-18 16:12:38.633825] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x6b5f20) on tqpair=0x650420 00:26:15.116 [2024-11-18 16:12:38.633839] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:26:15.116 0 Kelvin (-273 Celsius) 00:26:15.116 Available Spare: 0% 00:26:15.116 Available Spare Threshold: 0% 00:26:15.116 Life Percentage Used: 0% 00:26:15.116 Data Units Read: 0 00:26:15.116 Data Units Written: 0 00:26:15.116 Host Read Commands: 0 00:26:15.116 Host Write Commands: 0 00:26:15.116 Controller Busy Time: 0 minutes 00:26:15.116 Power Cycles: 0 00:26:15.116 Power On Hours: 0 hours 00:26:15.116 Unsafe Shutdowns: 0 00:26:15.116 Unrecoverable Media Errors: 0 00:26:15.116 Lifetime Error Log Entries: 0 00:26:15.116 Warning Temperature Time: 0 minutes 00:26:15.116 Critical Temperature Time: 0 minutes 00:26:15.116 00:26:15.116 Number of Queues 00:26:15.116 ================ 00:26:15.116 Number of I/O Submission Queues: 127 00:26:15.116 Number of I/O Completion Queues: 127 00:26:15.116 00:26:15.116 Active Namespaces 00:26:15.116 ================= 00:26:15.116 Namespace ID:1 00:26:15.116 Error Recovery Timeout: Unlimited 00:26:15.116 Command Set Identifier: NVM (00h) 00:26:15.116 Deallocate: Supported 00:26:15.116 Deallocated/Unwritten Error: Not Supported 00:26:15.116 Deallocated Read Value: Unknown 00:26:15.116 Deallocate in Write Zeroes: Not Supported 00:26:15.116 Deallocated Guard Field: 0xFFFF 00:26:15.116 Flush: Supported 00:26:15.116 Reservation: Supported 00:26:15.116 Namespace Sharing Capabilities: Multiple Controllers 00:26:15.116 Size (in LBAs): 131072 (0GiB) 00:26:15.116 Capacity (in LBAs): 131072 (0GiB) 00:26:15.116 Utilization (in LBAs): 131072 (0GiB) 00:26:15.116 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:15.116 EUI64: ABCDEF0123456789 00:26:15.116 UUID: 1d0f5589-bc6d-4edb-ac33-de1c9b30a7d0 00:26:15.116 Thin Provisioning: Not Supported 00:26:15.116 Per-NS Atomic Units: Yes 00:26:15.116 Atomic Boundary Size (Normal): 0 00:26:15.116 Atomic Boundary Size (PFail): 0 00:26:15.116 Atomic Boundary Offset: 0 00:26:15.116 Maximum Single Source Range Length: 65535 00:26:15.116 Maximum Copy Length: 65535 00:26:15.116 Maximum Source Range Count: 1 00:26:15.116 NGUID/EUI64 Never Reused: No 00:26:15.116 Namespace Write Protected: No 00:26:15.116 Number of LBA Formats: 1 00:26:15.116 Current LBA Format: LBA Format #00 00:26:15.116 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:15.116 00:26:15.116 16:12:38 -- host/identify.sh@51 -- # sync 00:26:15.116 16:12:38 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:15.116 16:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.116 16:12:38 -- common/autotest_common.sh@10 -- # set +x 00:26:15.116 16:12:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.116 16:12:38 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:15.116 16:12:38 -- host/identify.sh@56 -- # nvmftestfini 00:26:15.116 16:12:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:15.116 16:12:38 -- nvmf/common.sh@116 -- # sync 00:26:15.116 16:12:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:15.116 16:12:38 -- nvmf/common.sh@119 -- # set +e 00:26:15.116 16:12:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:15.116 16:12:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:15.116 rmmod nvme_tcp 00:26:15.116 rmmod nvme_fabrics 00:26:15.374 rmmod nvme_keyring 00:26:15.374 16:12:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:15.374 16:12:38 -- nvmf/common.sh@123 -- # set -e 00:26:15.374 16:12:38 -- nvmf/common.sh@124 -- # return 0 00:26:15.374 16:12:38 -- nvmf/common.sh@477 -- # '[' -n 1671694 ']' 00:26:15.374 16:12:38 -- nvmf/common.sh@478 -- # killprocess 1671694 00:26:15.374 16:12:38 -- common/autotest_common.sh@936 -- # '[' -z 1671694 ']' 00:26:15.374 16:12:38 -- common/autotest_common.sh@940 -- # kill -0 1671694 00:26:15.374 16:12:38 -- common/autotest_common.sh@941 -- # uname 00:26:15.374 16:12:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:15.374 16:12:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1671694 00:26:15.374 16:12:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:15.374 16:12:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:15.374 16:12:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1671694' 00:26:15.374 killing process with pid 1671694 00:26:15.374 16:12:38 -- common/autotest_common.sh@955 -- # kill 1671694 00:26:15.374 [2024-11-18 16:12:38.769055] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:15.374 16:12:38 -- common/autotest_common.sh@960 -- # wait 1671694 00:26:15.633 16:12:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:15.633 16:12:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:15.633 16:12:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:15.633 16:12:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:15.633 16:12:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:15.633 16:12:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:15.633 16:12:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:15.633 16:12:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:17.533 16:12:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:17.533 00:26:17.533 real 0m6.443s 00:26:17.533 user 0m7.923s 00:26:17.533 sys 0m2.061s 00:26:17.533 16:12:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:17.533 16:12:41 -- common/autotest_common.sh@10 -- # set +x 00:26:17.533 ************************************ 00:26:17.533 END TEST nvmf_identify 00:26:17.533 ************************************ 00:26:17.533 16:12:41 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:17.533 16:12:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:17.533 16:12:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:17.533 16:12:41 -- common/autotest_common.sh@10 -- # set +x 00:26:17.533 ************************************ 00:26:17.533 START TEST nvmf_perf 00:26:17.533 ************************************ 00:26:17.533 16:12:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:17.792 * Looking for test storage... 00:26:17.792 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:17.792 16:12:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:17.792 16:12:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:17.792 16:12:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:17.792 16:12:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:17.792 16:12:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:17.792 16:12:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:17.792 16:12:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:17.792 16:12:41 -- scripts/common.sh@335 -- # IFS=.-: 00:26:17.792 16:12:41 -- scripts/common.sh@335 -- # read -ra ver1 00:26:17.792 16:12:41 -- scripts/common.sh@336 -- # IFS=.-: 00:26:17.792 16:12:41 -- scripts/common.sh@336 -- # read -ra ver2 00:26:17.792 16:12:41 -- scripts/common.sh@337 -- # local 'op=<' 00:26:17.792 16:12:41 -- scripts/common.sh@339 -- # ver1_l=2 00:26:17.792 16:12:41 -- scripts/common.sh@340 -- # ver2_l=1 00:26:17.792 16:12:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:17.792 16:12:41 -- scripts/common.sh@343 -- # case "$op" in 00:26:17.792 16:12:41 -- scripts/common.sh@344 -- # : 1 00:26:17.792 16:12:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:17.792 16:12:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:17.792 16:12:41 -- scripts/common.sh@364 -- # decimal 1 00:26:17.792 16:12:41 -- scripts/common.sh@352 -- # local d=1 00:26:17.792 16:12:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:17.792 16:12:41 -- scripts/common.sh@354 -- # echo 1 00:26:17.792 16:12:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:17.792 16:12:41 -- scripts/common.sh@365 -- # decimal 2 00:26:17.792 16:12:41 -- scripts/common.sh@352 -- # local d=2 00:26:17.792 16:12:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:17.792 16:12:41 -- scripts/common.sh@354 -- # echo 2 00:26:17.792 16:12:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:17.792 16:12:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:17.792 16:12:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:17.792 16:12:41 -- scripts/common.sh@367 -- # return 0 00:26:17.792 16:12:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:17.792 16:12:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:17.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.792 --rc genhtml_branch_coverage=1 00:26:17.792 --rc genhtml_function_coverage=1 00:26:17.792 --rc genhtml_legend=1 00:26:17.792 --rc geninfo_all_blocks=1 00:26:17.792 --rc geninfo_unexecuted_blocks=1 00:26:17.792 00:26:17.792 ' 00:26:17.792 16:12:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:17.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.792 --rc genhtml_branch_coverage=1 00:26:17.792 --rc genhtml_function_coverage=1 00:26:17.792 --rc genhtml_legend=1 00:26:17.792 --rc geninfo_all_blocks=1 00:26:17.792 --rc geninfo_unexecuted_blocks=1 00:26:17.792 00:26:17.792 ' 00:26:17.792 16:12:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:17.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.792 --rc genhtml_branch_coverage=1 00:26:17.792 --rc genhtml_function_coverage=1 00:26:17.792 --rc genhtml_legend=1 00:26:17.792 --rc geninfo_all_blocks=1 00:26:17.792 --rc geninfo_unexecuted_blocks=1 00:26:17.792 00:26:17.792 ' 00:26:17.792 16:12:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:17.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:17.792 --rc genhtml_branch_coverage=1 00:26:17.792 --rc genhtml_function_coverage=1 00:26:17.792 --rc genhtml_legend=1 00:26:17.792 --rc geninfo_all_blocks=1 00:26:17.792 --rc geninfo_unexecuted_blocks=1 00:26:17.792 00:26:17.792 ' 00:26:17.792 16:12:41 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:17.792 16:12:41 -- nvmf/common.sh@7 -- # uname -s 00:26:17.792 16:12:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:17.792 16:12:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:17.792 16:12:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:17.792 16:12:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:17.792 16:12:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:17.792 16:12:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:17.792 16:12:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:17.792 16:12:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:17.792 16:12:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:17.792 16:12:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:17.792 16:12:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:17.792 16:12:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:17.792 16:12:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:17.792 16:12:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:17.792 16:12:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:17.792 16:12:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:17.792 16:12:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:17.792 16:12:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:17.792 16:12:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:17.792 16:12:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.792 16:12:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.792 16:12:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.792 16:12:41 -- paths/export.sh@5 -- # export PATH 00:26:17.792 16:12:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:17.792 16:12:41 -- nvmf/common.sh@46 -- # : 0 00:26:17.792 16:12:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:17.792 16:12:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:17.792 16:12:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:17.792 16:12:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:17.792 16:12:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:17.792 16:12:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:17.792 16:12:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:17.792 16:12:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:17.792 16:12:41 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:17.792 16:12:41 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:17.792 16:12:41 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:17.792 16:12:41 -- host/perf.sh@17 -- # nvmftestinit 00:26:17.792 16:12:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:17.792 16:12:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:17.792 16:12:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:17.792 16:12:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:17.792 16:12:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:17.792 16:12:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:17.792 16:12:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:17.792 16:12:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:17.792 16:12:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:17.792 16:12:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:17.792 16:12:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:17.792 16:12:41 -- common/autotest_common.sh@10 -- # set +x 00:26:19.693 16:12:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:19.693 16:12:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:19.693 16:12:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:19.693 16:12:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:19.693 16:12:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:19.693 16:12:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:19.693 16:12:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:19.693 16:12:43 -- nvmf/common.sh@294 -- # net_devs=() 00:26:19.693 16:12:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:19.693 16:12:43 -- nvmf/common.sh@295 -- # e810=() 00:26:19.693 16:12:43 -- nvmf/common.sh@295 -- # local -ga e810 00:26:19.693 16:12:43 -- nvmf/common.sh@296 -- # x722=() 00:26:19.693 16:12:43 -- nvmf/common.sh@296 -- # local -ga x722 00:26:19.693 16:12:43 -- nvmf/common.sh@297 -- # mlx=() 00:26:19.693 16:12:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:19.693 16:12:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:19.693 16:12:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:19.693 16:12:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:19.693 16:12:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:19.693 16:12:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:19.693 16:12:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:19.693 16:12:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:19.693 16:12:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:19.693 16:12:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:19.693 16:12:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:19.693 16:12:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:19.693 16:12:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:19.693 16:12:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:19.693 16:12:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:19.693 16:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:19.693 16:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:19.693 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:19.693 16:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:19.693 16:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:19.693 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:19.693 16:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:19.693 16:12:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:19.693 16:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:19.693 16:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:19.693 16:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:19.693 16:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:19.693 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:19.693 16:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:19.693 16:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:19.693 16:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:19.693 16:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:19.693 16:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:19.693 16:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:19.693 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:19.693 16:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:19.693 16:12:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:19.693 16:12:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:19.693 16:12:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:19.693 16:12:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:19.693 16:12:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:19.693 16:12:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:19.693 16:12:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:19.693 16:12:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:19.693 16:12:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:19.693 16:12:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:19.693 16:12:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:19.693 16:12:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:19.693 16:12:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:19.693 16:12:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:19.693 16:12:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:19.693 16:12:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:19.693 16:12:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:19.952 16:12:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:19.952 16:12:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:19.952 16:12:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:19.952 16:12:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:19.952 16:12:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:19.952 16:12:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:19.952 16:12:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:19.952 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:19.952 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:26:19.952 00:26:19.952 --- 10.0.0.2 ping statistics --- 00:26:19.952 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:19.952 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:26:19.952 16:12:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:19.952 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:19.952 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:26:19.952 00:26:19.952 --- 10.0.0.1 ping statistics --- 00:26:19.952 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:19.952 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:26:19.952 16:12:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:19.952 16:12:43 -- nvmf/common.sh@410 -- # return 0 00:26:19.952 16:12:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:19.952 16:12:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:19.952 16:12:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:19.952 16:12:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:19.952 16:12:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:19.952 16:12:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:19.952 16:12:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:19.952 16:12:43 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:19.952 16:12:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:19.952 16:12:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:19.952 16:12:43 -- common/autotest_common.sh@10 -- # set +x 00:26:19.952 16:12:43 -- nvmf/common.sh@469 -- # nvmfpid=1673815 00:26:19.952 16:12:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:19.952 16:12:43 -- nvmf/common.sh@470 -- # waitforlisten 1673815 00:26:19.952 16:12:43 -- common/autotest_common.sh@829 -- # '[' -z 1673815 ']' 00:26:19.952 16:12:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:19.952 16:12:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:19.952 16:12:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:19.952 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:19.952 16:12:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:19.952 16:12:43 -- common/autotest_common.sh@10 -- # set +x 00:26:19.952 [2024-11-18 16:12:43.466719] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:19.952 [2024-11-18 16:12:43.466790] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:19.952 EAL: No free 2048 kB hugepages reported on node 1 00:26:19.952 [2024-11-18 16:12:43.534441] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:20.210 [2024-11-18 16:12:43.624779] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:20.210 [2024-11-18 16:12:43.624946] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:20.210 [2024-11-18 16:12:43.624979] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:20.210 [2024-11-18 16:12:43.624992] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:20.210 [2024-11-18 16:12:43.625042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:20.210 [2024-11-18 16:12:43.625098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:20.210 [2024-11-18 16:12:43.625101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:20.210 [2024-11-18 16:12:43.625073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:20.210 16:12:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:20.210 16:12:43 -- common/autotest_common.sh@862 -- # return 0 00:26:20.210 16:12:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:20.210 16:12:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:20.210 16:12:43 -- common/autotest_common.sh@10 -- # set +x 00:26:20.210 16:12:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:20.210 16:12:43 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:20.210 16:12:43 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:23.512 16:12:46 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:23.512 16:12:46 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:23.770 16:12:47 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:23.770 16:12:47 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:24.028 16:12:47 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:24.028 16:12:47 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:24.028 16:12:47 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:24.028 16:12:47 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:24.028 16:12:47 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:24.285 [2024-11-18 16:12:47.649834] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:24.285 16:12:47 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:24.542 16:12:47 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:24.542 16:12:47 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:24.800 16:12:48 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:24.800 16:12:48 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:25.058 16:12:48 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:25.316 [2024-11-18 16:12:48.665579] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:25.316 16:12:48 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:25.575 16:12:48 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:25.575 16:12:48 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:25.575 16:12:48 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:25.575 16:12:48 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:26.947 Initializing NVMe Controllers 00:26:26.947 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:26.947 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:26.947 Initialization complete. Launching workers. 00:26:26.947 ======================================================== 00:26:26.947 Latency(us) 00:26:26.947 Device Information : IOPS MiB/s Average min max 00:26:26.947 PCIE (0000:88:00.0) NSID 1 from core 0: 85696.68 334.75 372.77 36.86 4333.50 00:26:26.947 ======================================================== 00:26:26.947 Total : 85696.68 334.75 372.77 36.86 4333.50 00:26:26.947 00:26:26.947 16:12:50 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:26.947 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.881 Initializing NVMe Controllers 00:26:27.881 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:27.881 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:27.881 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:27.881 Initialization complete. Launching workers. 00:26:27.881 ======================================================== 00:26:27.881 Latency(us) 00:26:27.881 Device Information : IOPS MiB/s Average min max 00:26:27.881 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 64.77 0.25 15855.18 136.44 46839.75 00:26:27.881 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 44.84 0.18 22654.55 7925.79 55866.20 00:26:27.881 ======================================================== 00:26:27.881 Total : 109.61 0.43 18636.74 136.44 55866.20 00:26:27.881 00:26:27.881 16:12:51 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:27.881 EAL: No free 2048 kB hugepages reported on node 1 00:26:29.256 Initializing NVMe Controllers 00:26:29.256 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:29.256 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:29.256 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:29.256 Initialization complete. Launching workers. 00:26:29.256 ======================================================== 00:26:29.256 Latency(us) 00:26:29.256 Device Information : IOPS MiB/s Average min max 00:26:29.256 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8505.43 33.22 3763.34 558.48 10326.09 00:26:29.256 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3656.87 14.28 8763.89 4953.87 23378.39 00:26:29.256 ======================================================== 00:26:29.256 Total : 12162.30 47.51 5266.86 558.48 23378.39 00:26:29.256 00:26:29.256 16:12:52 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:29.256 16:12:52 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:29.256 16:12:52 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:29.256 EAL: No free 2048 kB hugepages reported on node 1 00:26:32.538 Initializing NVMe Controllers 00:26:32.538 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:32.538 Controller IO queue size 128, less than required. 00:26:32.538 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:32.538 Controller IO queue size 128, less than required. 00:26:32.538 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:32.538 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:32.538 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:32.538 Initialization complete. Launching workers. 00:26:32.538 ======================================================== 00:26:32.538 Latency(us) 00:26:32.538 Device Information : IOPS MiB/s Average min max 00:26:32.538 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1689.39 422.35 77377.47 55235.17 142791.67 00:26:32.538 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 601.78 150.45 220440.23 78063.51 326475.25 00:26:32.538 ======================================================== 00:26:32.538 Total : 2291.17 572.79 114953.29 55235.17 326475.25 00:26:32.538 00:26:32.538 16:12:55 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:32.538 EAL: No free 2048 kB hugepages reported on node 1 00:26:32.538 No valid NVMe controllers or AIO or URING devices found 00:26:32.538 Initializing NVMe Controllers 00:26:32.538 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:32.538 Controller IO queue size 128, less than required. 00:26:32.538 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:32.538 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:32.538 Controller IO queue size 128, less than required. 00:26:32.538 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:32.538 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:32.538 WARNING: Some requested NVMe devices were skipped 00:26:32.538 16:12:55 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:32.538 EAL: No free 2048 kB hugepages reported on node 1 00:26:35.070 Initializing NVMe Controllers 00:26:35.070 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:35.070 Controller IO queue size 128, less than required. 00:26:35.070 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:35.070 Controller IO queue size 128, less than required. 00:26:35.070 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:35.070 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:35.070 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:35.070 Initialization complete. Launching workers. 00:26:35.070 00:26:35.070 ==================== 00:26:35.070 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:35.070 TCP transport: 00:26:35.070 polls: 11590 00:26:35.070 idle_polls: 8408 00:26:35.070 sock_completions: 3182 00:26:35.070 nvme_completions: 5791 00:26:35.070 submitted_requests: 8825 00:26:35.070 queued_requests: 1 00:26:35.070 00:26:35.070 ==================== 00:26:35.070 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:35.070 TCP transport: 00:26:35.070 polls: 9121 00:26:35.070 idle_polls: 5799 00:26:35.070 sock_completions: 3322 00:26:35.070 nvme_completions: 6096 00:26:35.070 submitted_requests: 9316 00:26:35.070 queued_requests: 1 00:26:35.070 ======================================================== 00:26:35.070 Latency(us) 00:26:35.070 Device Information : IOPS MiB/s Average min max 00:26:35.070 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1509.77 377.44 86738.27 48352.87 132073.97 00:26:35.070 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1585.68 396.42 81175.52 40344.49 121550.33 00:26:35.070 ======================================================== 00:26:35.070 Total : 3095.45 773.86 83888.69 40344.49 132073.97 00:26:35.070 00:26:35.070 16:12:58 -- host/perf.sh@66 -- # sync 00:26:35.070 16:12:58 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:35.382 16:12:58 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:35.382 16:12:58 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:35.382 16:12:58 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:38.694 16:13:01 -- host/perf.sh@72 -- # ls_guid=a157e64f-1ae8-4beb-8728-9bb9490f345d 00:26:38.694 16:13:01 -- host/perf.sh@73 -- # get_lvs_free_mb a157e64f-1ae8-4beb-8728-9bb9490f345d 00:26:38.694 16:13:01 -- common/autotest_common.sh@1353 -- # local lvs_uuid=a157e64f-1ae8-4beb-8728-9bb9490f345d 00:26:38.694 16:13:01 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:38.694 16:13:01 -- common/autotest_common.sh@1355 -- # local fc 00:26:38.694 16:13:01 -- common/autotest_common.sh@1356 -- # local cs 00:26:38.694 16:13:01 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:38.694 16:13:02 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:38.694 { 00:26:38.694 "uuid": "a157e64f-1ae8-4beb-8728-9bb9490f345d", 00:26:38.694 "name": "lvs_0", 00:26:38.694 "base_bdev": "Nvme0n1", 00:26:38.694 "total_data_clusters": 238234, 00:26:38.694 "free_clusters": 238234, 00:26:38.694 "block_size": 512, 00:26:38.694 "cluster_size": 4194304 00:26:38.694 } 00:26:38.694 ]' 00:26:38.694 16:13:02 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="a157e64f-1ae8-4beb-8728-9bb9490f345d") .free_clusters' 00:26:38.952 16:13:02 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:38.952 16:13:02 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="a157e64f-1ae8-4beb-8728-9bb9490f345d") .cluster_size' 00:26:38.952 16:13:02 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:38.952 16:13:02 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:38.952 16:13:02 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:38.952 952936 00:26:38.952 16:13:02 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:38.952 16:13:02 -- host/perf.sh@78 -- # free_mb=20480 00:26:38.952 16:13:02 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u a157e64f-1ae8-4beb-8728-9bb9490f345d lbd_0 20480 00:26:39.210 16:13:02 -- host/perf.sh@80 -- # lb_guid=6769f8a6-37c4-4748-99d5-97cf6abecc90 00:26:39.210 16:13:02 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 6769f8a6-37c4-4748-99d5-97cf6abecc90 lvs_n_0 00:26:40.144 16:13:03 -- host/perf.sh@83 -- # ls_nested_guid=edb3ec04-40b7-44f6-9378-fb1f0f62eb82 00:26:40.144 16:13:03 -- host/perf.sh@84 -- # get_lvs_free_mb edb3ec04-40b7-44f6-9378-fb1f0f62eb82 00:26:40.144 16:13:03 -- common/autotest_common.sh@1353 -- # local lvs_uuid=edb3ec04-40b7-44f6-9378-fb1f0f62eb82 00:26:40.144 16:13:03 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:40.144 16:13:03 -- common/autotest_common.sh@1355 -- # local fc 00:26:40.144 16:13:03 -- common/autotest_common.sh@1356 -- # local cs 00:26:40.144 16:13:03 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:40.402 16:13:03 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:40.402 { 00:26:40.402 "uuid": "a157e64f-1ae8-4beb-8728-9bb9490f345d", 00:26:40.402 "name": "lvs_0", 00:26:40.402 "base_bdev": "Nvme0n1", 00:26:40.402 "total_data_clusters": 238234, 00:26:40.402 "free_clusters": 233114, 00:26:40.402 "block_size": 512, 00:26:40.402 "cluster_size": 4194304 00:26:40.402 }, 00:26:40.402 { 00:26:40.402 "uuid": "edb3ec04-40b7-44f6-9378-fb1f0f62eb82", 00:26:40.402 "name": "lvs_n_0", 00:26:40.402 "base_bdev": "6769f8a6-37c4-4748-99d5-97cf6abecc90", 00:26:40.402 "total_data_clusters": 5114, 00:26:40.402 "free_clusters": 5114, 00:26:40.402 "block_size": 512, 00:26:40.402 "cluster_size": 4194304 00:26:40.402 } 00:26:40.402 ]' 00:26:40.402 16:13:03 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="edb3ec04-40b7-44f6-9378-fb1f0f62eb82") .free_clusters' 00:26:40.402 16:13:03 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:40.402 16:13:03 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="edb3ec04-40b7-44f6-9378-fb1f0f62eb82") .cluster_size' 00:26:40.402 16:13:03 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:40.402 16:13:03 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:40.402 16:13:03 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:40.402 20456 00:26:40.402 16:13:03 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:40.402 16:13:03 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u edb3ec04-40b7-44f6-9378-fb1f0f62eb82 lbd_nest_0 20456 00:26:40.660 16:13:04 -- host/perf.sh@88 -- # lb_nested_guid=2a77a517-4c4b-4361-8612-9061682a86da 00:26:40.660 16:13:04 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:40.917 16:13:04 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:40.917 16:13:04 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 2a77a517-4c4b-4361-8612-9061682a86da 00:26:41.175 16:13:04 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:41.432 16:13:04 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:41.433 16:13:04 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:41.433 16:13:04 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:41.433 16:13:04 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:41.433 16:13:04 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:41.433 EAL: No free 2048 kB hugepages reported on node 1 00:26:53.632 Initializing NVMe Controllers 00:26:53.632 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:53.632 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:53.632 Initialization complete. Launching workers. 00:26:53.632 ======================================================== 00:26:53.632 Latency(us) 00:26:53.632 Device Information : IOPS MiB/s Average min max 00:26:53.632 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 42.60 0.02 23577.90 173.30 47883.05 00:26:53.632 ======================================================== 00:26:53.632 Total : 42.60 0.02 23577.90 173.30 47883.05 00:26:53.632 00:26:53.632 16:13:15 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:53.632 16:13:15 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:53.632 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.592 Initializing NVMe Controllers 00:27:03.592 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:03.592 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:03.592 Initialization complete. Launching workers. 00:27:03.592 ======================================================== 00:27:03.592 Latency(us) 00:27:03.592 Device Information : IOPS MiB/s Average min max 00:27:03.592 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 79.77 9.97 12545.18 4805.05 48835.43 00:27:03.592 ======================================================== 00:27:03.592 Total : 79.77 9.97 12545.18 4805.05 48835.43 00:27:03.592 00:27:03.592 16:13:25 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:03.592 16:13:25 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:03.592 16:13:25 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:03.592 EAL: No free 2048 kB hugepages reported on node 1 00:27:13.557 Initializing NVMe Controllers 00:27:13.557 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:13.557 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:13.557 Initialization complete. Launching workers. 00:27:13.557 ======================================================== 00:27:13.557 Latency(us) 00:27:13.557 Device Information : IOPS MiB/s Average min max 00:27:13.557 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7307.92 3.57 4383.03 301.93 47135.54 00:27:13.557 ======================================================== 00:27:13.557 Total : 7307.92 3.57 4383.03 301.93 47135.54 00:27:13.557 00:27:13.557 16:13:35 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:13.557 16:13:35 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:13.557 EAL: No free 2048 kB hugepages reported on node 1 00:27:23.522 Initializing NVMe Controllers 00:27:23.522 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:23.522 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:23.522 Initialization complete. Launching workers. 00:27:23.522 ======================================================== 00:27:23.522 Latency(us) 00:27:23.522 Device Information : IOPS MiB/s Average min max 00:27:23.522 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4107.47 513.43 7791.00 732.37 18621.80 00:27:23.522 ======================================================== 00:27:23.522 Total : 4107.47 513.43 7791.00 732.37 18621.80 00:27:23.522 00:27:23.522 16:13:46 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:23.522 16:13:46 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:23.522 16:13:46 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:23.522 EAL: No free 2048 kB hugepages reported on node 1 00:27:33.488 Initializing NVMe Controllers 00:27:33.488 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:33.488 Controller IO queue size 128, less than required. 00:27:33.488 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:33.488 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:33.488 Initialization complete. Launching workers. 00:27:33.488 ======================================================== 00:27:33.488 Latency(us) 00:27:33.488 Device Information : IOPS MiB/s Average min max 00:27:33.488 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11939.24 5.83 10722.98 1742.07 42969.00 00:27:33.488 ======================================================== 00:27:33.488 Total : 11939.24 5.83 10722.98 1742.07 42969.00 00:27:33.488 00:27:33.488 16:13:56 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:33.488 16:13:56 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:33.488 EAL: No free 2048 kB hugepages reported on node 1 00:27:43.476 Initializing NVMe Controllers 00:27:43.476 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:43.476 Controller IO queue size 128, less than required. 00:27:43.476 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:43.476 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:43.476 Initialization complete. Launching workers. 00:27:43.476 ======================================================== 00:27:43.476 Latency(us) 00:27:43.476 Device Information : IOPS MiB/s Average min max 00:27:43.476 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1184.00 148.00 108620.28 16882.13 231306.11 00:27:43.476 ======================================================== 00:27:43.476 Total : 1184.00 148.00 108620.28 16882.13 231306.11 00:27:43.476 00:27:43.734 16:14:07 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:43.991 16:14:07 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 2a77a517-4c4b-4361-8612-9061682a86da 00:27:44.923 16:14:08 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:44.923 16:14:08 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 6769f8a6-37c4-4748-99d5-97cf6abecc90 00:27:45.181 16:14:08 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:45.438 16:14:08 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:45.438 16:14:08 -- host/perf.sh@114 -- # nvmftestfini 00:27:45.438 16:14:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:45.438 16:14:08 -- nvmf/common.sh@116 -- # sync 00:27:45.438 16:14:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:45.439 16:14:08 -- nvmf/common.sh@119 -- # set +e 00:27:45.439 16:14:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:45.439 16:14:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:45.439 rmmod nvme_tcp 00:27:45.439 rmmod nvme_fabrics 00:27:45.439 rmmod nvme_keyring 00:27:45.697 16:14:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:45.697 16:14:09 -- nvmf/common.sh@123 -- # set -e 00:27:45.697 16:14:09 -- nvmf/common.sh@124 -- # return 0 00:27:45.697 16:14:09 -- nvmf/common.sh@477 -- # '[' -n 1673815 ']' 00:27:45.697 16:14:09 -- nvmf/common.sh@478 -- # killprocess 1673815 00:27:45.697 16:14:09 -- common/autotest_common.sh@936 -- # '[' -z 1673815 ']' 00:27:45.697 16:14:09 -- common/autotest_common.sh@940 -- # kill -0 1673815 00:27:45.697 16:14:09 -- common/autotest_common.sh@941 -- # uname 00:27:45.697 16:14:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:45.697 16:14:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1673815 00:27:45.697 16:14:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:45.697 16:14:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:45.697 16:14:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1673815' 00:27:45.697 killing process with pid 1673815 00:27:45.697 16:14:09 -- common/autotest_common.sh@955 -- # kill 1673815 00:27:45.697 16:14:09 -- common/autotest_common.sh@960 -- # wait 1673815 00:27:47.593 16:14:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:47.593 16:14:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:47.593 16:14:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:47.593 16:14:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:47.593 16:14:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:47.593 16:14:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:47.593 16:14:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:47.593 16:14:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:49.533 16:14:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:49.533 00:27:49.533 real 1m31.655s 00:27:49.533 user 5m38.802s 00:27:49.533 sys 0m15.616s 00:27:49.533 16:14:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:49.533 16:14:12 -- common/autotest_common.sh@10 -- # set +x 00:27:49.533 ************************************ 00:27:49.533 END TEST nvmf_perf 00:27:49.533 ************************************ 00:27:49.533 16:14:12 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:49.533 16:14:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:49.533 16:14:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:49.533 16:14:12 -- common/autotest_common.sh@10 -- # set +x 00:27:49.533 ************************************ 00:27:49.533 START TEST nvmf_fio_host 00:27:49.533 ************************************ 00:27:49.533 16:14:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:49.533 * Looking for test storage... 00:27:49.533 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:49.533 16:14:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:49.533 16:14:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:49.533 16:14:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:49.533 16:14:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:49.533 16:14:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:49.533 16:14:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:49.533 16:14:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:49.533 16:14:12 -- scripts/common.sh@335 -- # IFS=.-: 00:27:49.533 16:14:12 -- scripts/common.sh@335 -- # read -ra ver1 00:27:49.533 16:14:12 -- scripts/common.sh@336 -- # IFS=.-: 00:27:49.533 16:14:12 -- scripts/common.sh@336 -- # read -ra ver2 00:27:49.533 16:14:12 -- scripts/common.sh@337 -- # local 'op=<' 00:27:49.533 16:14:12 -- scripts/common.sh@339 -- # ver1_l=2 00:27:49.533 16:14:12 -- scripts/common.sh@340 -- # ver2_l=1 00:27:49.533 16:14:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:49.533 16:14:12 -- scripts/common.sh@343 -- # case "$op" in 00:27:49.533 16:14:12 -- scripts/common.sh@344 -- # : 1 00:27:49.533 16:14:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:49.533 16:14:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:49.533 16:14:12 -- scripts/common.sh@364 -- # decimal 1 00:27:49.533 16:14:12 -- scripts/common.sh@352 -- # local d=1 00:27:49.533 16:14:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:49.533 16:14:12 -- scripts/common.sh@354 -- # echo 1 00:27:49.533 16:14:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:49.533 16:14:12 -- scripts/common.sh@365 -- # decimal 2 00:27:49.533 16:14:12 -- scripts/common.sh@352 -- # local d=2 00:27:49.533 16:14:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:49.533 16:14:12 -- scripts/common.sh@354 -- # echo 2 00:27:49.533 16:14:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:49.533 16:14:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:49.533 16:14:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:49.533 16:14:12 -- scripts/common.sh@367 -- # return 0 00:27:49.533 16:14:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:49.533 16:14:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:49.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.533 --rc genhtml_branch_coverage=1 00:27:49.533 --rc genhtml_function_coverage=1 00:27:49.533 --rc genhtml_legend=1 00:27:49.533 --rc geninfo_all_blocks=1 00:27:49.533 --rc geninfo_unexecuted_blocks=1 00:27:49.533 00:27:49.533 ' 00:27:49.533 16:14:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:49.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.533 --rc genhtml_branch_coverage=1 00:27:49.533 --rc genhtml_function_coverage=1 00:27:49.533 --rc genhtml_legend=1 00:27:49.533 --rc geninfo_all_blocks=1 00:27:49.533 --rc geninfo_unexecuted_blocks=1 00:27:49.533 00:27:49.533 ' 00:27:49.533 16:14:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:49.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.533 --rc genhtml_branch_coverage=1 00:27:49.533 --rc genhtml_function_coverage=1 00:27:49.533 --rc genhtml_legend=1 00:27:49.533 --rc geninfo_all_blocks=1 00:27:49.533 --rc geninfo_unexecuted_blocks=1 00:27:49.533 00:27:49.533 ' 00:27:49.533 16:14:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:49.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.533 --rc genhtml_branch_coverage=1 00:27:49.533 --rc genhtml_function_coverage=1 00:27:49.533 --rc genhtml_legend=1 00:27:49.533 --rc geninfo_all_blocks=1 00:27:49.533 --rc geninfo_unexecuted_blocks=1 00:27:49.533 00:27:49.533 ' 00:27:49.533 16:14:12 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:49.533 16:14:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:49.533 16:14:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:49.533 16:14:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:49.533 16:14:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.533 16:14:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.534 16:14:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.534 16:14:12 -- paths/export.sh@5 -- # export PATH 00:27:49.534 16:14:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.534 16:14:12 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:49.534 16:14:12 -- nvmf/common.sh@7 -- # uname -s 00:27:49.534 16:14:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:49.534 16:14:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:49.534 16:14:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:49.534 16:14:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:49.534 16:14:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:49.534 16:14:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:49.534 16:14:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:49.534 16:14:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:49.534 16:14:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:49.534 16:14:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:49.534 16:14:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:49.534 16:14:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:49.534 16:14:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:49.534 16:14:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:49.534 16:14:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:49.534 16:14:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:49.534 16:14:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:49.534 16:14:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:49.534 16:14:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:49.534 16:14:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.534 16:14:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.534 16:14:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.534 16:14:12 -- paths/export.sh@5 -- # export PATH 00:27:49.534 16:14:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.534 16:14:12 -- nvmf/common.sh@46 -- # : 0 00:27:49.534 16:14:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:49.534 16:14:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:49.534 16:14:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:49.534 16:14:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:49.534 16:14:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:49.534 16:14:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:49.534 16:14:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:49.534 16:14:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:49.534 16:14:12 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:49.534 16:14:12 -- host/fio.sh@14 -- # nvmftestinit 00:27:49.534 16:14:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:49.534 16:14:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:49.534 16:14:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:49.534 16:14:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:49.534 16:14:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:49.534 16:14:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:49.534 16:14:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:49.534 16:14:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:49.534 16:14:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:49.534 16:14:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:49.534 16:14:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:49.534 16:14:12 -- common/autotest_common.sh@10 -- # set +x 00:27:51.460 16:14:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:51.460 16:14:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:51.460 16:14:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:51.460 16:14:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:51.460 16:14:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:51.460 16:14:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:51.460 16:14:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:51.460 16:14:14 -- nvmf/common.sh@294 -- # net_devs=() 00:27:51.460 16:14:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:51.460 16:14:14 -- nvmf/common.sh@295 -- # e810=() 00:27:51.460 16:14:14 -- nvmf/common.sh@295 -- # local -ga e810 00:27:51.460 16:14:14 -- nvmf/common.sh@296 -- # x722=() 00:27:51.460 16:14:14 -- nvmf/common.sh@296 -- # local -ga x722 00:27:51.460 16:14:14 -- nvmf/common.sh@297 -- # mlx=() 00:27:51.460 16:14:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:51.460 16:14:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:51.460 16:14:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:51.460 16:14:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:51.460 16:14:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:51.460 16:14:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:51.460 16:14:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:51.460 16:14:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:51.460 16:14:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:51.460 16:14:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:51.460 16:14:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:51.460 16:14:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:51.460 16:14:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:51.460 16:14:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:51.460 16:14:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:51.460 16:14:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:51.460 16:14:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:51.460 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:51.460 16:14:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:51.460 16:14:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:51.460 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:51.460 16:14:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:51.460 16:14:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:51.460 16:14:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:51.460 16:14:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:51.460 16:14:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:51.460 16:14:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:51.460 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:51.460 16:14:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:51.460 16:14:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:51.460 16:14:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:51.460 16:14:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:51.460 16:14:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:51.460 16:14:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:51.460 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:51.460 16:14:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:51.460 16:14:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:51.460 16:14:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:51.460 16:14:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:51.460 16:14:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:51.460 16:14:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:51.460 16:14:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:51.460 16:14:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:51.460 16:14:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:51.460 16:14:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:51.460 16:14:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:51.460 16:14:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:51.460 16:14:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:51.460 16:14:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:51.460 16:14:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:51.460 16:14:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:51.460 16:14:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:51.460 16:14:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:51.460 16:14:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:51.460 16:14:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:51.460 16:14:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:51.460 16:14:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:51.460 16:14:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:51.460 16:14:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:51.460 16:14:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:51.460 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:51.460 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.271 ms 00:27:51.460 00:27:51.460 --- 10.0.0.2 ping statistics --- 00:27:51.460 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:51.460 rtt min/avg/max/mdev = 0.271/0.271/0.271/0.000 ms 00:27:51.460 16:14:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:51.460 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:51.460 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.162 ms 00:27:51.460 00:27:51.460 --- 10.0.0.1 ping statistics --- 00:27:51.460 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:51.460 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:27:51.460 16:14:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:51.460 16:14:15 -- nvmf/common.sh@410 -- # return 0 00:27:51.460 16:14:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:51.460 16:14:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:51.460 16:14:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:51.460 16:14:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:51.460 16:14:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:51.460 16:14:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:51.460 16:14:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:51.718 16:14:15 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:51.718 16:14:15 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:51.718 16:14:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:51.718 16:14:15 -- common/autotest_common.sh@10 -- # set +x 00:27:51.718 16:14:15 -- host/fio.sh@24 -- # nvmfpid=1686245 00:27:51.718 16:14:15 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:51.718 16:14:15 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:51.718 16:14:15 -- host/fio.sh@28 -- # waitforlisten 1686245 00:27:51.718 16:14:15 -- common/autotest_common.sh@829 -- # '[' -z 1686245 ']' 00:27:51.718 16:14:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:51.718 16:14:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:51.718 16:14:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:51.718 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:51.718 16:14:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:51.718 16:14:15 -- common/autotest_common.sh@10 -- # set +x 00:27:51.718 [2024-11-18 16:14:15.103276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:51.718 [2024-11-18 16:14:15.103349] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:51.718 EAL: No free 2048 kB hugepages reported on node 1 00:27:51.718 [2024-11-18 16:14:15.166472] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:51.718 [2024-11-18 16:14:15.252390] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:51.718 [2024-11-18 16:14:15.252534] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:51.718 [2024-11-18 16:14:15.252553] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:51.718 [2024-11-18 16:14:15.252566] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:51.718 [2024-11-18 16:14:15.252652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:51.718 [2024-11-18 16:14:15.252673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:51.718 [2024-11-18 16:14:15.252725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:51.718 [2024-11-18 16:14:15.252727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:52.651 16:14:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:52.651 16:14:16 -- common/autotest_common.sh@862 -- # return 0 00:27:52.651 16:14:16 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:52.909 [2024-11-18 16:14:16.394307] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:52.909 16:14:16 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:52.909 16:14:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:52.909 16:14:16 -- common/autotest_common.sh@10 -- # set +x 00:27:52.909 16:14:16 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:53.167 Malloc1 00:27:53.167 16:14:16 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:53.425 16:14:17 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:53.682 16:14:17 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:53.940 [2024-11-18 16:14:17.481014] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:53.940 16:14:17 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:54.198 16:14:17 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:54.198 16:14:17 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:54.198 16:14:17 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:54.198 16:14:17 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:54.198 16:14:17 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:54.198 16:14:17 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:54.198 16:14:17 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:54.198 16:14:17 -- common/autotest_common.sh@1330 -- # shift 00:27:54.198 16:14:17 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:54.198 16:14:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:54.198 16:14:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:54.198 16:14:17 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:54.198 16:14:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:54.198 16:14:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:54.198 16:14:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:54.198 16:14:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:54.198 16:14:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:54.198 16:14:17 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:54.198 16:14:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:54.457 16:14:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:54.457 16:14:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:54.457 16:14:17 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:54.457 16:14:17 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:54.457 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:54.457 fio-3.35 00:27:54.457 Starting 1 thread 00:27:54.457 EAL: No free 2048 kB hugepages reported on node 1 00:27:56.984 00:27:56.984 test: (groupid=0, jobs=1): err= 0: pid=1686742: Mon Nov 18 16:14:20 2024 00:27:56.984 read: IOPS=9673, BW=37.8MiB/s (39.6MB/s)(75.8MiB/2006msec) 00:27:56.984 slat (nsec): min=1900, max=152056, avg=2569.15, stdev=2077.02 00:27:56.984 clat (usec): min=2127, max=12355, avg=7228.98, stdev=582.19 00:27:56.984 lat (usec): min=2150, max=12358, avg=7231.55, stdev=582.07 00:27:56.984 clat percentiles (usec): 00:27:56.984 | 1.00th=[ 5866], 5.00th=[ 6325], 10.00th=[ 6521], 20.00th=[ 6783], 00:27:56.984 | 30.00th=[ 6980], 40.00th=[ 7111], 50.00th=[ 7242], 60.00th=[ 7373], 00:27:56.984 | 70.00th=[ 7504], 80.00th=[ 7701], 90.00th=[ 7898], 95.00th=[ 8094], 00:27:56.984 | 99.00th=[ 8455], 99.50th=[ 8586], 99.90th=[11338], 99.95th=[11863], 00:27:56.984 | 99.99th=[12387] 00:27:56.984 bw ( KiB/s): min=37456, max=39584, per=99.94%, avg=38670.00, stdev=995.40, samples=4 00:27:56.984 iops : min= 9364, max= 9896, avg=9667.50, stdev=248.85, samples=4 00:27:56.984 write: IOPS=9683, BW=37.8MiB/s (39.7MB/s)(75.9MiB/2006msec); 0 zone resets 00:27:56.984 slat (nsec): min=1989, max=128225, avg=2688.59, stdev=1792.57 00:27:56.984 clat (usec): min=1599, max=11500, avg=5907.47, stdev=488.29 00:27:56.984 lat (usec): min=1608, max=11503, avg=5910.16, stdev=488.27 00:27:56.984 clat percentiles (usec): 00:27:56.984 | 1.00th=[ 4817], 5.00th=[ 5211], 10.00th=[ 5342], 20.00th=[ 5538], 00:27:56.984 | 30.00th=[ 5669], 40.00th=[ 5800], 50.00th=[ 5932], 60.00th=[ 5997], 00:27:56.984 | 70.00th=[ 6128], 80.00th=[ 6259], 90.00th=[ 6456], 95.00th=[ 6652], 00:27:56.984 | 99.00th=[ 7046], 99.50th=[ 7177], 99.90th=[ 8717], 99.95th=[10290], 00:27:56.984 | 99.99th=[11469] 00:27:56.984 bw ( KiB/s): min=38176, max=38976, per=100.00%, avg=38736.00, stdev=375.46, samples=4 00:27:56.984 iops : min= 9544, max= 9744, avg=9684.00, stdev=93.87, samples=4 00:27:56.984 lat (msec) : 2=0.02%, 4=0.10%, 10=99.77%, 20=0.11% 00:27:56.984 cpu : usr=64.54%, sys=33.47%, ctx=53, majf=0, minf=41 00:27:56.984 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:56.984 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:56.984 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:56.984 issued rwts: total=19405,19425,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:56.984 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:56.984 00:27:56.984 Run status group 0 (all jobs): 00:27:56.984 READ: bw=37.8MiB/s (39.6MB/s), 37.8MiB/s-37.8MiB/s (39.6MB/s-39.6MB/s), io=75.8MiB (79.5MB), run=2006-2006msec 00:27:56.984 WRITE: bw=37.8MiB/s (39.7MB/s), 37.8MiB/s-37.8MiB/s (39.7MB/s-39.7MB/s), io=75.9MiB (79.6MB), run=2006-2006msec 00:27:56.984 16:14:20 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:56.984 16:14:20 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:56.984 16:14:20 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:56.984 16:14:20 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:56.984 16:14:20 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:56.984 16:14:20 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:56.984 16:14:20 -- common/autotest_common.sh@1330 -- # shift 00:27:56.984 16:14:20 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:56.984 16:14:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:56.984 16:14:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:56.984 16:14:20 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:56.984 16:14:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:56.984 16:14:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:56.984 16:14:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:56.984 16:14:20 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:56.984 16:14:20 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:56.984 16:14:20 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:56.984 16:14:20 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:56.984 16:14:20 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:56.984 16:14:20 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:56.984 16:14:20 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:56.984 16:14:20 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:57.241 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:57.241 fio-3.35 00:27:57.241 Starting 1 thread 00:27:57.241 EAL: No free 2048 kB hugepages reported on node 1 00:27:59.769 00:27:59.769 test: (groupid=0, jobs=1): err= 0: pid=1687208: Mon Nov 18 16:14:23 2024 00:27:59.769 read: IOPS=8391, BW=131MiB/s (137MB/s)(269MiB/2048msec) 00:27:59.769 slat (nsec): min=2692, max=94627, avg=3583.70, stdev=1681.79 00:27:59.769 clat (usec): min=2193, max=52058, avg=8938.15, stdev=5171.56 00:27:59.769 lat (usec): min=2196, max=52061, avg=8941.73, stdev=5171.57 00:27:59.769 clat percentiles (usec): 00:27:59.769 | 1.00th=[ 4555], 5.00th=[ 5276], 10.00th=[ 5866], 20.00th=[ 6587], 00:27:59.769 | 30.00th=[ 7177], 40.00th=[ 7767], 50.00th=[ 8291], 60.00th=[ 8848], 00:27:59.769 | 70.00th=[ 9503], 80.00th=[10159], 90.00th=[11207], 95.00th=[12125], 00:27:59.769 | 99.00th=[46924], 99.50th=[49021], 99.90th=[51119], 99.95th=[51643], 00:27:59.769 | 99.99th=[52167] 00:27:59.769 bw ( KiB/s): min=58432, max=82752, per=53.35%, avg=71624.00, stdev=11566.91, samples=4 00:27:59.769 iops : min= 3652, max= 5172, avg=4476.50, stdev=722.93, samples=4 00:27:59.769 write: IOPS=5195, BW=81.2MiB/s (85.1MB/s)(146MiB/1800msec); 0 zone resets 00:27:59.769 slat (usec): min=30, max=180, avg=33.16, stdev= 4.98 00:27:59.769 clat (usec): min=4624, max=19146, avg=10748.56, stdev=1980.29 00:27:59.769 lat (usec): min=4655, max=19177, avg=10781.72, stdev=1980.52 00:27:59.769 clat percentiles (usec): 00:27:59.769 | 1.00th=[ 7308], 5.00th=[ 8029], 10.00th=[ 8455], 20.00th=[ 9110], 00:27:59.769 | 30.00th=[ 9503], 40.00th=[10028], 50.00th=[10421], 60.00th=[10945], 00:27:59.769 | 70.00th=[11600], 80.00th=[12256], 90.00th=[13566], 95.00th=[14484], 00:27:59.769 | 99.00th=[15795], 99.50th=[17433], 99.90th=[18744], 99.95th=[19006], 00:27:59.769 | 99.99th=[19268] 00:27:59.769 bw ( KiB/s): min=60960, max=86240, per=90.00%, avg=74808.00, stdev=11693.14, samples=4 00:27:59.769 iops : min= 3810, max= 5390, avg=4675.50, stdev=730.82, samples=4 00:27:59.769 lat (msec) : 4=0.20%, 10=63.99%, 20=34.86%, 50=0.75%, 100=0.20% 00:27:59.769 cpu : usr=77.49%, sys=21.14%, ctx=49, majf=0, minf=72 00:27:59.769 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:27:59.769 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:59.769 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:59.769 issued rwts: total=17186,9351,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:59.769 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:59.769 00:27:59.769 Run status group 0 (all jobs): 00:27:59.769 READ: bw=131MiB/s (137MB/s), 131MiB/s-131MiB/s (137MB/s-137MB/s), io=269MiB (282MB), run=2048-2048msec 00:27:59.769 WRITE: bw=81.2MiB/s (85.1MB/s), 81.2MiB/s-81.2MiB/s (85.1MB/s-85.1MB/s), io=146MiB (153MB), run=1800-1800msec 00:27:59.769 16:14:23 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:00.026 16:14:23 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:28:00.026 16:14:23 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:28:00.026 16:14:23 -- host/fio.sh@51 -- # get_nvme_bdfs 00:28:00.026 16:14:23 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:00.026 16:14:23 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:00.026 16:14:23 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:00.026 16:14:23 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:00.026 16:14:23 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:00.026 16:14:23 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:00.026 16:14:23 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:00.026 16:14:23 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:28:03.305 Nvme0n1 00:28:03.305 16:14:26 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:28:06.581 16:14:29 -- host/fio.sh@53 -- # ls_guid=e514e2b2-9bcd-494d-86da-f04a1486fd86 00:28:06.581 16:14:29 -- host/fio.sh@54 -- # get_lvs_free_mb e514e2b2-9bcd-494d-86da-f04a1486fd86 00:28:06.581 16:14:29 -- common/autotest_common.sh@1353 -- # local lvs_uuid=e514e2b2-9bcd-494d-86da-f04a1486fd86 00:28:06.581 16:14:29 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:06.581 16:14:29 -- common/autotest_common.sh@1355 -- # local fc 00:28:06.581 16:14:29 -- common/autotest_common.sh@1356 -- # local cs 00:28:06.581 16:14:29 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:06.581 16:14:29 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:06.581 { 00:28:06.581 "uuid": "e514e2b2-9bcd-494d-86da-f04a1486fd86", 00:28:06.581 "name": "lvs_0", 00:28:06.581 "base_bdev": "Nvme0n1", 00:28:06.581 "total_data_clusters": 930, 00:28:06.581 "free_clusters": 930, 00:28:06.581 "block_size": 512, 00:28:06.581 "cluster_size": 1073741824 00:28:06.581 } 00:28:06.581 ]' 00:28:06.581 16:14:29 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="e514e2b2-9bcd-494d-86da-f04a1486fd86") .free_clusters' 00:28:06.581 16:14:29 -- common/autotest_common.sh@1358 -- # fc=930 00:28:06.581 16:14:29 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="e514e2b2-9bcd-494d-86da-f04a1486fd86") .cluster_size' 00:28:06.581 16:14:29 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:28:06.581 16:14:29 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:28:06.581 16:14:29 -- common/autotest_common.sh@1363 -- # echo 952320 00:28:06.581 952320 00:28:06.581 16:14:29 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:28:06.581 fde5d390-810d-4d26-b2a2-d76b6f70d520 00:28:06.838 16:14:30 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:28:07.096 16:14:30 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:28:07.354 16:14:30 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:07.611 16:14:30 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:07.611 16:14:30 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:07.611 16:14:30 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:07.611 16:14:30 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:07.611 16:14:30 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:07.611 16:14:30 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:07.611 16:14:30 -- common/autotest_common.sh@1330 -- # shift 00:28:07.611 16:14:30 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:07.611 16:14:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:07.611 16:14:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:07.611 16:14:30 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:07.611 16:14:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:07.611 16:14:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:07.611 16:14:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:07.611 16:14:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:07.611 16:14:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:07.611 16:14:30 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:07.611 16:14:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:07.611 16:14:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:07.611 16:14:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:07.612 16:14:30 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:07.612 16:14:30 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:07.612 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:07.612 fio-3.35 00:28:07.612 Starting 1 thread 00:28:07.612 EAL: No free 2048 kB hugepages reported on node 1 00:28:10.137 00:28:10.137 test: (groupid=0, jobs=1): err= 0: pid=1688528: Mon Nov 18 16:14:33 2024 00:28:10.137 read: IOPS=5692, BW=22.2MiB/s (23.3MB/s)(44.7MiB/2009msec) 00:28:10.137 slat (nsec): min=1875, max=217583, avg=2782.69, stdev=3202.74 00:28:10.137 clat (usec): min=1131, max=171816, avg=12287.12, stdev=11866.88 00:28:10.137 lat (usec): min=1134, max=171857, avg=12289.90, stdev=11867.32 00:28:10.137 clat percentiles (msec): 00:28:10.137 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 11], 00:28:10.137 | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 12], 60.00th=[ 12], 00:28:10.137 | 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 13], 95.00th=[ 14], 00:28:10.137 | 99.00th=[ 14], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:28:10.137 | 99.99th=[ 171] 00:28:10.137 bw ( KiB/s): min=16096, max=25264, per=99.94%, avg=22756.00, stdev=4444.69, samples=4 00:28:10.137 iops : min= 4024, max= 6316, avg=5689.00, stdev=1111.17, samples=4 00:28:10.137 write: IOPS=5671, BW=22.2MiB/s (23.2MB/s)(44.5MiB/2009msec); 0 zone resets 00:28:10.137 slat (nsec): min=1905, max=175110, avg=2818.92, stdev=2417.11 00:28:10.137 clat (usec): min=300, max=169317, avg=10109.90, stdev=11147.06 00:28:10.137 lat (usec): min=303, max=169326, avg=10112.72, stdev=11147.52 00:28:10.137 clat percentiles (msec): 00:28:10.137 | 1.00th=[ 8], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9], 00:28:10.137 | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 10], 00:28:10.137 | 70.00th=[ 10], 80.00th=[ 11], 90.00th=[ 11], 95.00th=[ 11], 00:28:10.137 | 99.00th=[ 12], 99.50th=[ 153], 99.90th=[ 169], 99.95th=[ 169], 00:28:10.137 | 99.99th=[ 169] 00:28:10.137 bw ( KiB/s): min=17064, max=24760, per=99.83%, avg=22650.00, stdev=3728.37, samples=4 00:28:10.137 iops : min= 4266, max= 6190, avg=5662.50, stdev=932.09, samples=4 00:28:10.137 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:28:10.137 lat (msec) : 2=0.02%, 4=0.08%, 10=43.78%, 20=55.53%, 250=0.56% 00:28:10.137 cpu : usr=56.08%, sys=42.43%, ctx=114, majf=0, minf=41 00:28:10.137 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:10.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:10.137 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:10.137 issued rwts: total=11436,11395,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:10.137 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:10.137 00:28:10.137 Run status group 0 (all jobs): 00:28:10.137 READ: bw=22.2MiB/s (23.3MB/s), 22.2MiB/s-22.2MiB/s (23.3MB/s-23.3MB/s), io=44.7MiB (46.8MB), run=2009-2009msec 00:28:10.137 WRITE: bw=22.2MiB/s (23.2MB/s), 22.2MiB/s-22.2MiB/s (23.2MB/s-23.2MB/s), io=44.5MiB (46.7MB), run=2009-2009msec 00:28:10.137 16:14:33 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:10.395 16:14:33 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:28:11.768 16:14:34 -- host/fio.sh@64 -- # ls_nested_guid=c9b72af5-6724-488f-a698-574655568c61 00:28:11.768 16:14:34 -- host/fio.sh@65 -- # get_lvs_free_mb c9b72af5-6724-488f-a698-574655568c61 00:28:11.768 16:14:34 -- common/autotest_common.sh@1353 -- # local lvs_uuid=c9b72af5-6724-488f-a698-574655568c61 00:28:11.768 16:14:34 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:11.768 16:14:34 -- common/autotest_common.sh@1355 -- # local fc 00:28:11.768 16:14:34 -- common/autotest_common.sh@1356 -- # local cs 00:28:11.768 16:14:34 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:11.768 16:14:35 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:11.768 { 00:28:11.768 "uuid": "e514e2b2-9bcd-494d-86da-f04a1486fd86", 00:28:11.768 "name": "lvs_0", 00:28:11.768 "base_bdev": "Nvme0n1", 00:28:11.768 "total_data_clusters": 930, 00:28:11.768 "free_clusters": 0, 00:28:11.768 "block_size": 512, 00:28:11.768 "cluster_size": 1073741824 00:28:11.768 }, 00:28:11.768 { 00:28:11.768 "uuid": "c9b72af5-6724-488f-a698-574655568c61", 00:28:11.768 "name": "lvs_n_0", 00:28:11.768 "base_bdev": "fde5d390-810d-4d26-b2a2-d76b6f70d520", 00:28:11.768 "total_data_clusters": 237847, 00:28:11.768 "free_clusters": 237847, 00:28:11.768 "block_size": 512, 00:28:11.768 "cluster_size": 4194304 00:28:11.768 } 00:28:11.768 ]' 00:28:11.768 16:14:35 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="c9b72af5-6724-488f-a698-574655568c61") .free_clusters' 00:28:11.768 16:14:35 -- common/autotest_common.sh@1358 -- # fc=237847 00:28:11.768 16:14:35 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="c9b72af5-6724-488f-a698-574655568c61") .cluster_size' 00:28:11.768 16:14:35 -- common/autotest_common.sh@1359 -- # cs=4194304 00:28:11.768 16:14:35 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:28:11.768 16:14:35 -- common/autotest_common.sh@1363 -- # echo 951388 00:28:11.768 951388 00:28:11.768 16:14:35 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:28:12.334 39c2e54a-c9ae-48d9-a9b3-a8ed37488c88 00:28:12.334 16:14:35 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:28:12.591 16:14:36 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:28:12.848 16:14:36 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:28:13.413 16:14:36 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:13.413 16:14:36 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:13.413 16:14:36 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:13.413 16:14:36 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:13.413 16:14:36 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:13.413 16:14:36 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:13.413 16:14:36 -- common/autotest_common.sh@1330 -- # shift 00:28:13.413 16:14:36 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:13.413 16:14:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:13.413 16:14:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:13.413 16:14:36 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:13.413 16:14:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:13.413 16:14:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:13.413 16:14:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:13.413 16:14:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:13.413 16:14:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:13.413 16:14:36 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:13.413 16:14:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:13.413 16:14:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:13.413 16:14:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:13.413 16:14:36 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:13.413 16:14:36 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:13.413 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:13.413 fio-3.35 00:28:13.413 Starting 1 thread 00:28:13.413 EAL: No free 2048 kB hugepages reported on node 1 00:28:15.939 00:28:15.939 test: (groupid=0, jobs=1): err= 0: pid=1689303: Mon Nov 18 16:14:39 2024 00:28:15.939 read: IOPS=6182, BW=24.1MiB/s (25.3MB/s)(48.5MiB/2007msec) 00:28:15.939 slat (nsec): min=1992, max=152870, avg=2531.83, stdev=1928.37 00:28:15.939 clat (usec): min=4453, max=19710, avg=11381.38, stdev=1030.58 00:28:15.939 lat (usec): min=4458, max=19712, avg=11383.91, stdev=1030.48 00:28:15.939 clat percentiles (usec): 00:28:15.939 | 1.00th=[ 8848], 5.00th=[ 9765], 10.00th=[10159], 20.00th=[10552], 00:28:15.939 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11338], 60.00th=[11600], 00:28:15.939 | 70.00th=[11863], 80.00th=[12256], 90.00th=[12518], 95.00th=[12911], 00:28:15.939 | 99.00th=[13566], 99.50th=[13960], 99.90th=[17695], 99.95th=[18744], 00:28:15.939 | 99.99th=[19530] 00:28:15.939 bw ( KiB/s): min=23280, max=25320, per=99.74%, avg=24664.00, stdev=947.63, samples=4 00:28:15.939 iops : min= 5820, max= 6330, avg=6166.00, stdev=236.91, samples=4 00:28:15.939 write: IOPS=6165, BW=24.1MiB/s (25.3MB/s)(48.3MiB/2007msec); 0 zone resets 00:28:15.939 slat (usec): min=2, max=107, avg= 2.61, stdev= 1.43 00:28:15.939 clat (usec): min=2183, max=16506, avg=9180.14, stdev=844.31 00:28:15.939 lat (usec): min=2189, max=16508, avg=9182.75, stdev=844.25 00:28:15.939 clat percentiles (usec): 00:28:15.939 | 1.00th=[ 7242], 5.00th=[ 7898], 10.00th=[ 8225], 20.00th=[ 8586], 00:28:15.939 | 30.00th=[ 8717], 40.00th=[ 8979], 50.00th=[ 9241], 60.00th=[ 9372], 00:28:15.939 | 70.00th=[ 9503], 80.00th=[ 9896], 90.00th=[10159], 95.00th=[10421], 00:28:15.939 | 99.00th=[11076], 99.50th=[11469], 99.90th=[13829], 99.95th=[15270], 00:28:15.939 | 99.99th=[16450] 00:28:15.939 bw ( KiB/s): min=24408, max=24768, per=99.94%, avg=24646.00, stdev=169.75, samples=4 00:28:15.939 iops : min= 6102, max= 6192, avg=6161.50, stdev=42.44, samples=4 00:28:15.939 lat (msec) : 4=0.04%, 10=46.21%, 20=53.75% 00:28:15.939 cpu : usr=65.05%, sys=33.50%, ctx=78, majf=0, minf=41 00:28:15.939 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:15.939 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:15.939 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:15.939 issued rwts: total=12408,12374,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:15.939 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:15.939 00:28:15.939 Run status group 0 (all jobs): 00:28:15.939 READ: bw=24.1MiB/s (25.3MB/s), 24.1MiB/s-24.1MiB/s (25.3MB/s-25.3MB/s), io=48.5MiB (50.8MB), run=2007-2007msec 00:28:15.939 WRITE: bw=24.1MiB/s (25.3MB/s), 24.1MiB/s-24.1MiB/s (25.3MB/s-25.3MB/s), io=48.3MiB (50.7MB), run=2007-2007msec 00:28:15.939 16:14:39 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:15.939 16:14:39 -- host/fio.sh@74 -- # sync 00:28:15.939 16:14:39 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:20.116 16:14:43 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:20.116 16:14:43 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:23.394 16:14:46 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:23.394 16:14:46 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:25.291 16:14:48 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:25.291 16:14:48 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:25.291 16:14:48 -- host/fio.sh@86 -- # nvmftestfini 00:28:25.291 16:14:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:25.291 16:14:48 -- nvmf/common.sh@116 -- # sync 00:28:25.291 16:14:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:25.291 16:14:48 -- nvmf/common.sh@119 -- # set +e 00:28:25.291 16:14:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:25.291 16:14:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:25.291 rmmod nvme_tcp 00:28:25.291 rmmod nvme_fabrics 00:28:25.291 rmmod nvme_keyring 00:28:25.291 16:14:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:25.549 16:14:48 -- nvmf/common.sh@123 -- # set -e 00:28:25.549 16:14:48 -- nvmf/common.sh@124 -- # return 0 00:28:25.549 16:14:48 -- nvmf/common.sh@477 -- # '[' -n 1686245 ']' 00:28:25.549 16:14:48 -- nvmf/common.sh@478 -- # killprocess 1686245 00:28:25.549 16:14:48 -- common/autotest_common.sh@936 -- # '[' -z 1686245 ']' 00:28:25.549 16:14:48 -- common/autotest_common.sh@940 -- # kill -0 1686245 00:28:25.549 16:14:48 -- common/autotest_common.sh@941 -- # uname 00:28:25.549 16:14:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:25.549 16:14:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1686245 00:28:25.549 16:14:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:25.549 16:14:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:25.549 16:14:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1686245' 00:28:25.549 killing process with pid 1686245 00:28:25.549 16:14:48 -- common/autotest_common.sh@955 -- # kill 1686245 00:28:25.549 16:14:48 -- common/autotest_common.sh@960 -- # wait 1686245 00:28:25.806 16:14:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:25.806 16:14:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:25.806 16:14:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:25.806 16:14:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:25.806 16:14:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:25.806 16:14:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:25.806 16:14:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:25.806 16:14:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:27.706 16:14:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:27.706 00:28:27.706 real 0m38.396s 00:28:27.706 user 2m27.726s 00:28:27.706 sys 0m7.158s 00:28:27.706 16:14:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:27.706 16:14:51 -- common/autotest_common.sh@10 -- # set +x 00:28:27.706 ************************************ 00:28:27.706 END TEST nvmf_fio_host 00:28:27.706 ************************************ 00:28:27.706 16:14:51 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:27.706 16:14:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:27.706 16:14:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:27.706 16:14:51 -- common/autotest_common.sh@10 -- # set +x 00:28:27.706 ************************************ 00:28:27.706 START TEST nvmf_failover 00:28:27.706 ************************************ 00:28:27.706 16:14:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:27.706 * Looking for test storage... 00:28:27.706 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:27.706 16:14:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:27.706 16:14:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:27.706 16:14:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:27.964 16:14:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:27.964 16:14:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:27.964 16:14:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:27.964 16:14:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:27.964 16:14:51 -- scripts/common.sh@335 -- # IFS=.-: 00:28:27.964 16:14:51 -- scripts/common.sh@335 -- # read -ra ver1 00:28:27.964 16:14:51 -- scripts/common.sh@336 -- # IFS=.-: 00:28:27.964 16:14:51 -- scripts/common.sh@336 -- # read -ra ver2 00:28:27.964 16:14:51 -- scripts/common.sh@337 -- # local 'op=<' 00:28:27.964 16:14:51 -- scripts/common.sh@339 -- # ver1_l=2 00:28:27.964 16:14:51 -- scripts/common.sh@340 -- # ver2_l=1 00:28:27.964 16:14:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:27.964 16:14:51 -- scripts/common.sh@343 -- # case "$op" in 00:28:27.964 16:14:51 -- scripts/common.sh@344 -- # : 1 00:28:27.964 16:14:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:27.964 16:14:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:27.964 16:14:51 -- scripts/common.sh@364 -- # decimal 1 00:28:27.964 16:14:51 -- scripts/common.sh@352 -- # local d=1 00:28:27.965 16:14:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:27.965 16:14:51 -- scripts/common.sh@354 -- # echo 1 00:28:27.965 16:14:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:27.965 16:14:51 -- scripts/common.sh@365 -- # decimal 2 00:28:27.965 16:14:51 -- scripts/common.sh@352 -- # local d=2 00:28:27.965 16:14:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:27.965 16:14:51 -- scripts/common.sh@354 -- # echo 2 00:28:27.965 16:14:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:27.965 16:14:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:27.965 16:14:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:27.965 16:14:51 -- scripts/common.sh@367 -- # return 0 00:28:27.965 16:14:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:27.965 16:14:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:27.965 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:27.965 --rc genhtml_branch_coverage=1 00:28:27.965 --rc genhtml_function_coverage=1 00:28:27.965 --rc genhtml_legend=1 00:28:27.965 --rc geninfo_all_blocks=1 00:28:27.965 --rc geninfo_unexecuted_blocks=1 00:28:27.965 00:28:27.965 ' 00:28:27.965 16:14:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:27.965 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:27.965 --rc genhtml_branch_coverage=1 00:28:27.965 --rc genhtml_function_coverage=1 00:28:27.965 --rc genhtml_legend=1 00:28:27.965 --rc geninfo_all_blocks=1 00:28:27.965 --rc geninfo_unexecuted_blocks=1 00:28:27.965 00:28:27.965 ' 00:28:27.965 16:14:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:27.965 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:27.965 --rc genhtml_branch_coverage=1 00:28:27.965 --rc genhtml_function_coverage=1 00:28:27.965 --rc genhtml_legend=1 00:28:27.965 --rc geninfo_all_blocks=1 00:28:27.965 --rc geninfo_unexecuted_blocks=1 00:28:27.965 00:28:27.965 ' 00:28:27.965 16:14:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:27.965 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:27.965 --rc genhtml_branch_coverage=1 00:28:27.965 --rc genhtml_function_coverage=1 00:28:27.965 --rc genhtml_legend=1 00:28:27.965 --rc geninfo_all_blocks=1 00:28:27.965 --rc geninfo_unexecuted_blocks=1 00:28:27.965 00:28:27.965 ' 00:28:27.965 16:14:51 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:27.965 16:14:51 -- nvmf/common.sh@7 -- # uname -s 00:28:27.965 16:14:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:27.965 16:14:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:27.965 16:14:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:27.965 16:14:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:27.965 16:14:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:27.965 16:14:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:27.965 16:14:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:27.965 16:14:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:27.965 16:14:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:27.965 16:14:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:27.965 16:14:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:27.965 16:14:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:27.965 16:14:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:27.965 16:14:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:27.965 16:14:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:27.965 16:14:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:27.965 16:14:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:27.965 16:14:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:27.965 16:14:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:27.965 16:14:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.965 16:14:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.965 16:14:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.965 16:14:51 -- paths/export.sh@5 -- # export PATH 00:28:27.965 16:14:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:27.965 16:14:51 -- nvmf/common.sh@46 -- # : 0 00:28:27.965 16:14:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:27.965 16:14:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:27.965 16:14:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:27.965 16:14:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:27.965 16:14:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:27.965 16:14:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:27.965 16:14:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:27.965 16:14:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:27.965 16:14:51 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:27.965 16:14:51 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:27.965 16:14:51 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:27.965 16:14:51 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:27.965 16:14:51 -- host/failover.sh@18 -- # nvmftestinit 00:28:27.965 16:14:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:27.965 16:14:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:27.965 16:14:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:27.965 16:14:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:27.965 16:14:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:27.965 16:14:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:27.965 16:14:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:27.965 16:14:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:27.965 16:14:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:27.965 16:14:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:27.965 16:14:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:27.965 16:14:51 -- common/autotest_common.sh@10 -- # set +x 00:28:29.898 16:14:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:29.898 16:14:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:29.898 16:14:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:29.898 16:14:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:29.898 16:14:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:29.898 16:14:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:29.898 16:14:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:29.898 16:14:53 -- nvmf/common.sh@294 -- # net_devs=() 00:28:29.898 16:14:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:29.898 16:14:53 -- nvmf/common.sh@295 -- # e810=() 00:28:29.898 16:14:53 -- nvmf/common.sh@295 -- # local -ga e810 00:28:29.898 16:14:53 -- nvmf/common.sh@296 -- # x722=() 00:28:29.898 16:14:53 -- nvmf/common.sh@296 -- # local -ga x722 00:28:29.898 16:14:53 -- nvmf/common.sh@297 -- # mlx=() 00:28:29.898 16:14:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:29.898 16:14:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:29.898 16:14:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:29.898 16:14:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:29.898 16:14:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:29.898 16:14:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:29.898 16:14:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:29.898 16:14:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:29.898 16:14:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:29.898 16:14:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:29.898 16:14:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:29.898 16:14:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:29.898 16:14:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:29.898 16:14:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:29.898 16:14:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:29.898 16:14:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:29.898 16:14:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:29.898 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:29.898 16:14:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:29.898 16:14:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:29.898 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:29.898 16:14:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:29.898 16:14:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:29.898 16:14:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:29.898 16:14:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:29.898 16:14:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:29.898 16:14:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:29.898 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:29.898 16:14:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:29.898 16:14:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:29.898 16:14:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:29.898 16:14:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:29.898 16:14:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:29.898 16:14:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:29.898 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:29.898 16:14:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:29.898 16:14:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:29.898 16:14:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:29.898 16:14:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:29.898 16:14:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:29.898 16:14:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:29.898 16:14:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:29.898 16:14:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:29.898 16:14:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:29.898 16:14:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:29.898 16:14:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:29.898 16:14:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:29.898 16:14:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:29.898 16:14:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:29.898 16:14:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:29.898 16:14:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:29.898 16:14:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:29.898 16:14:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:29.898 16:14:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:29.898 16:14:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:29.898 16:14:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:30.180 16:14:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:30.180 16:14:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:30.180 16:14:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:30.180 16:14:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:30.180 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:30.180 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:28:30.180 00:28:30.180 --- 10.0.0.2 ping statistics --- 00:28:30.180 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:30.180 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:28:30.180 16:14:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:30.180 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:30.180 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.051 ms 00:28:30.180 00:28:30.180 --- 10.0.0.1 ping statistics --- 00:28:30.180 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:30.180 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:28:30.180 16:14:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:30.180 16:14:53 -- nvmf/common.sh@410 -- # return 0 00:28:30.180 16:14:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:30.180 16:14:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:30.180 16:14:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:30.180 16:14:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:30.180 16:14:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:30.180 16:14:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:30.180 16:14:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:30.180 16:14:53 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:30.180 16:14:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:30.180 16:14:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:30.180 16:14:53 -- common/autotest_common.sh@10 -- # set +x 00:28:30.180 16:14:53 -- nvmf/common.sh@469 -- # nvmfpid=1692709 00:28:30.180 16:14:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:30.180 16:14:53 -- nvmf/common.sh@470 -- # waitforlisten 1692709 00:28:30.180 16:14:53 -- common/autotest_common.sh@829 -- # '[' -z 1692709 ']' 00:28:30.180 16:14:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:30.180 16:14:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:30.180 16:14:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:30.180 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:30.180 16:14:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:30.180 16:14:53 -- common/autotest_common.sh@10 -- # set +x 00:28:30.180 [2024-11-18 16:14:53.599456] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:30.180 [2024-11-18 16:14:53.599538] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:30.180 EAL: No free 2048 kB hugepages reported on node 1 00:28:30.180 [2024-11-18 16:14:53.673257] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:30.180 [2024-11-18 16:14:53.761231] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:30.180 [2024-11-18 16:14:53.761395] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:30.180 [2024-11-18 16:14:53.761414] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:30.180 [2024-11-18 16:14:53.761438] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:30.181 [2024-11-18 16:14:53.761544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:30.181 [2024-11-18 16:14:53.761645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:30.181 [2024-11-18 16:14:53.761641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:31.114 16:14:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:31.114 16:14:54 -- common/autotest_common.sh@862 -- # return 0 00:28:31.114 16:14:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:31.114 16:14:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:31.114 16:14:54 -- common/autotest_common.sh@10 -- # set +x 00:28:31.114 16:14:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:31.114 16:14:54 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:31.372 [2024-11-18 16:14:54.801702] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:31.372 16:14:54 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:31.630 Malloc0 00:28:31.630 16:14:55 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:31.887 16:14:55 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:32.145 16:14:55 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:32.402 [2024-11-18 16:14:55.858981] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:32.402 16:14:55 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:32.659 [2024-11-18 16:14:56.111780] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:32.659 16:14:56 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:32.917 [2024-11-18 16:14:56.360659] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:32.917 16:14:56 -- host/failover.sh@31 -- # bdevperf_pid=1693041 00:28:32.917 16:14:56 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:32.917 16:14:56 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:32.917 16:14:56 -- host/failover.sh@34 -- # waitforlisten 1693041 /var/tmp/bdevperf.sock 00:28:32.917 16:14:56 -- common/autotest_common.sh@829 -- # '[' -z 1693041 ']' 00:28:32.917 16:14:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:32.917 16:14:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:32.917 16:14:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:32.917 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:32.917 16:14:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:32.917 16:14:56 -- common/autotest_common.sh@10 -- # set +x 00:28:33.850 16:14:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:33.850 16:14:57 -- common/autotest_common.sh@862 -- # return 0 00:28:33.850 16:14:57 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:34.109 NVMe0n1 00:28:34.109 16:14:57 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:34.674 00:28:34.674 16:14:58 -- host/failover.sh@39 -- # run_test_pid=1693315 00:28:34.674 16:14:58 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:34.674 16:14:58 -- host/failover.sh@41 -- # sleep 1 00:28:35.608 16:14:59 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:35.865 [2024-11-18 16:14:59.388393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.865 [2024-11-18 16:14:59.388701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 [2024-11-18 16:14:59.388909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x970930 is same with the state(5) to be set 00:28:35.866 16:14:59 -- host/failover.sh@45 -- # sleep 3 00:28:39.146 16:15:02 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:39.146 00:28:39.404 16:15:02 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:39.404 [2024-11-18 16:15:02.980062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.404 [2024-11-18 16:15:02.980404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9717c0 is same with the state(5) to be set 00:28:39.662 16:15:02 -- host/failover.sh@50 -- # sleep 3 00:28:42.941 16:15:06 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:42.941 [2024-11-18 16:15:06.245624] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:42.941 16:15:06 -- host/failover.sh@55 -- # sleep 1 00:28:43.873 16:15:07 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:44.131 [2024-11-18 16:15:07.536053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 [2024-11-18 16:15:07.536881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x972310 is same with the state(5) to be set 00:28:44.132 16:15:07 -- host/failover.sh@59 -- # wait 1693315 00:28:50.694 0 00:28:50.694 16:15:13 -- host/failover.sh@61 -- # killprocess 1693041 00:28:50.694 16:15:13 -- common/autotest_common.sh@936 -- # '[' -z 1693041 ']' 00:28:50.694 16:15:13 -- common/autotest_common.sh@940 -- # kill -0 1693041 00:28:50.694 16:15:13 -- common/autotest_common.sh@941 -- # uname 00:28:50.694 16:15:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:50.694 16:15:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1693041 00:28:50.694 16:15:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:50.694 16:15:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:50.694 16:15:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1693041' 00:28:50.694 killing process with pid 1693041 00:28:50.694 16:15:13 -- common/autotest_common.sh@955 -- # kill 1693041 00:28:50.694 16:15:13 -- common/autotest_common.sh@960 -- # wait 1693041 00:28:50.694 16:15:13 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:50.694 [2024-11-18 16:14:56.417757] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:50.694 [2024-11-18 16:14:56.417842] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1693041 ] 00:28:50.694 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.694 [2024-11-18 16:14:56.477880] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:50.694 [2024-11-18 16:14:56.562495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:50.694 Running I/O for 15 seconds... 00:28:50.694 [2024-11-18 16:14:59.389187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:115632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:115640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:115648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:115656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:115688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:115696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:115704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:116256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:116264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:116288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:116320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:116376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:115728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:115744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:115784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:115800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:115808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:115832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:115840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:115848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:116392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:116408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:116416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:116424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.694 [2024-11-18 16:14:59.389981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.694 [2024-11-18 16:14:59.389995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:116440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.694 [2024-11-18 16:14:59.390009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:116448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:116456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:116464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:116472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:116480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:116488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:115856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:115872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:115880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:115896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:115920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:115928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:115944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:115968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:116496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:116504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:116512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:116520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:116528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:116536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:116544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:116552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:116560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:116568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:116576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:116584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:116592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:116600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:116608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.390887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:116616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:115976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:115992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.390973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.390988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:116008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.391002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.391017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:116024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.391030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.391045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:116032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.391059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.391077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:116040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.391091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.391106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:116064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.391119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.391134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:116072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.695 [2024-11-18 16:14:59.391148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.695 [2024-11-18 16:14:59.391163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:116624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.695 [2024-11-18 16:14:59.391176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:116632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:116640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:116648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:116656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:116664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:116672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:116088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:116112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:116136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:116152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:116176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:116192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:116200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:116216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:116680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:116688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:116696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:116704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:116712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:116720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:116728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:116736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:116744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:116752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:116760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:116768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:116776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.391955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:116784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.391983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.391998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:116792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.392011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.392026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:116800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.392039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.392054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:116808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.392067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.392082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:116816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.392096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.392111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:116824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.392124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.392139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:116832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.392152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.392170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:116840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.392184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.392199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:116848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.392213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.392227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:116856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.392241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.392256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:116864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.696 [2024-11-18 16:14:59.392269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.392284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:116872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.696 [2024-11-18 16:14:59.392297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.696 [2024-11-18 16:14:59.392312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:116880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:116888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.697 [2024-11-18 16:14:59.392354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:116896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:116904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:116912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:116920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:116240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:116248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:116272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:116280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:116296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:116304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:116312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:116328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:116928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:116936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.697 [2024-11-18 16:14:59.392761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:116336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:116344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:116352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:116360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:116368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:116384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:116400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:14:59.392961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.392975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5b3c60 is same with the state(5) to be set 00:28:50.697 [2024-11-18 16:14:59.392992] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:50.697 [2024-11-18 16:14:59.393004] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:50.697 [2024-11-18 16:14:59.393015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116432 len:8 PRP1 0x0 PRP2 0x0 00:28:50.697 [2024-11-18 16:14:59.393028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.393089] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x5b3c60 was disconnected and freed. reset controller. 00:28:50.697 [2024-11-18 16:14:59.393114] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:50.697 [2024-11-18 16:14:59.393151] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.697 [2024-11-18 16:14:59.393170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.393185] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.697 [2024-11-18 16:14:59.393198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.393212] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.697 [2024-11-18 16:14:59.393224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.393238] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.697 [2024-11-18 16:14:59.393251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:14:59.393264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:50.697 [2024-11-18 16:14:59.395462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:50.697 [2024-11-18 16:14:59.395508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x595000 (9): Bad file descriptor 00:28:50.697 [2024-11-18 16:14:59.421568] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:50.697 [2024-11-18 16:15:02.980517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:100536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:15:02.980560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:15:02.980595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:100544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:15:02.980625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:15:02.980645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:100560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:15:02.980659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:15:02.980675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:100568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:15:02.980689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:15:02.980704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:100584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:15:02.980717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:15:02.980732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:100592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:15:02.980746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:15:02.980761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:100672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:15:02.980775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.697 [2024-11-18 16:15:02.980790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:100688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.697 [2024-11-18 16:15:02.980803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.980818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:100016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.980831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.980846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:100024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.980859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.980873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:100032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.980886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.980917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:100040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.980930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.980945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:100072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.980958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.980972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:100096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.980990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:100104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:100128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:100712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:100720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.698 [2024-11-18 16:15:02.981103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:100728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:100736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.698 [2024-11-18 16:15:02.981159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:100744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.698 [2024-11-18 16:15:02.981186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:100752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.698 [2024-11-18 16:15:02.981214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:100760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:100768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.698 [2024-11-18 16:15:02.981269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:100776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:100136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:100184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:100200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:100216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:100224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:100304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:100320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:100328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:100784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.698 [2024-11-18 16:15:02.981553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:100792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.698 [2024-11-18 16:15:02.981581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:100800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.698 [2024-11-18 16:15:02.981700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:100808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:100816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:100824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:100832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.698 [2024-11-18 16:15:02.981834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:100352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.698 [2024-11-18 16:15:02.981873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.698 [2024-11-18 16:15:02.981888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:100400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.981901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.981916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:100408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.981930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.981964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:100448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.981977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.981992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:100456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:100488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:100504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:100512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:100840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:100848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:100856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:100864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:100872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:100880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:100888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:100896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:100904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:100912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:100920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:100928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:100936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:100944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:100952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:100960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:100968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:100976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:100984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:100992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:101000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:101008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:101016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:101024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:101032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:101040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:101048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:101056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:101064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.982952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:101072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.982981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.982996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:101080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.983009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.983023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:101088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.699 [2024-11-18 16:15:02.983036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.699 [2024-11-18 16:15:02.983051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:101096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.699 [2024-11-18 16:15:02.983064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:101104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:101112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:101120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:101128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:101136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:101144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:101152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:101160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:101168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:101176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:101184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:101192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:101200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:101208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:101216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:101224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:101232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:101240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:101248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:101256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:101264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:101272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:101280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:101288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:101296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:101304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:101312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:101320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:101328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.983925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:101336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:101344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.700 [2024-11-18 16:15:02.983981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.983995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:100520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.984008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.984023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:100528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.984036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.984053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:100552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.984067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.984081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:100576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.984094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.984108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:100600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.984121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.984135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:100608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.984147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.984162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:100616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.984174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.984189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:100624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.700 [2024-11-18 16:15:02.984201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.700 [2024-11-18 16:15:02.984216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:100632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:02.984229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:100640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:02.984255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:100648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:02.984282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:100656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:02.984309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:100664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:02.984336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:100680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:02.984363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:100696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:02.984390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c1710 is same with the state(5) to be set 00:28:50.701 [2024-11-18 16:15:02.984424] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:50.701 [2024-11-18 16:15:02.984435] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:50.701 [2024-11-18 16:15:02.984446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:100704 len:8 PRP1 0x0 PRP2 0x0 00:28:50.701 [2024-11-18 16:15:02.984459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984534] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x5c1710 was disconnected and freed. reset controller. 00:28:50.701 [2024-11-18 16:15:02.984552] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:50.701 [2024-11-18 16:15:02.984586] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.701 [2024-11-18 16:15:02.984605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984630] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.701 [2024-11-18 16:15:02.984644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984658] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.701 [2024-11-18 16:15:02.984670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984684] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.701 [2024-11-18 16:15:02.984697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:02.984710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:50.701 [2024-11-18 16:15:02.986940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:50.701 [2024-11-18 16:15:02.986980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x595000 (9): Bad file descriptor 00:28:50.701 [2024-11-18 16:15:03.016310] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:50.701 [2024-11-18 16:15:07.537052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:56784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:56800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:56816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:56848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:56864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:56872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:56888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.701 [2024-11-18 16:15:07.537318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:56896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:56264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:56272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:56296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:56304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:56312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:56320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:56328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:56336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:56360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:56368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:56376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:56392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:56424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:56440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:56456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:56472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.701 [2024-11-18 16:15:07.537832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.701 [2024-11-18 16:15:07.537848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:56904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.537861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.537876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:56912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.537890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.537905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:56920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.537933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.537948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:56928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.537961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.537976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:56936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.537990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:56944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:56952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:56960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:56968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:56976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.538140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:56984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:56992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:57000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:57008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:57016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:57024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:57032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:57040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.538372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:57048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.538401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:57056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.538429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:56480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:56488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:56504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:56512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:56520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:56528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:56536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:56544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:57064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:57072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.538754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:57080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:57088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:57096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:57104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.538873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:57112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.538909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:57120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.538952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:57128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.702 [2024-11-18 16:15:07.538979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.538994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:57136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.539007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.539021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:57144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.539034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.539053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:57152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.702 [2024-11-18 16:15:07.539067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.702 [2024-11-18 16:15:07.539081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:57160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:57168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:57176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:56552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:56568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:56576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:56584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:56616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:56656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:56736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:56768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:57184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:57192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:57200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:57208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:57216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:57224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:57232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:57240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:57248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:57256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:57264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:57272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:57280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:57288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:57296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:57304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:57312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:57320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.539913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:57328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:57336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.539972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.539986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:57344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.703 [2024-11-18 16:15:07.540000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.540015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:57352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.540029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.540044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:57360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.703 [2024-11-18 16:15:07.540058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.703 [2024-11-18 16:15:07.540072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:57368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:57376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:57384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:57392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:57400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:57408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:57416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:57424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:57432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:57440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:57448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:57456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:57464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:57472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:57480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:57488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:57496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:57504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:57512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:57520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:57528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:57536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:50.704 [2024-11-18 16:15:07.540703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:56776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:56792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:56808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:56824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:56832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:56840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:56856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:50.704 [2024-11-18 16:15:07.540901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.540916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7887d0 is same with the state(5) to be set 00:28:50.704 [2024-11-18 16:15:07.540932] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:50.704 [2024-11-18 16:15:07.540944] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:50.704 [2024-11-18 16:15:07.540955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:56880 len:8 PRP1 0x0 PRP2 0x0 00:28:50.704 [2024-11-18 16:15:07.540967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.541028] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x7887d0 was disconnected and freed. reset controller. 00:28:50.704 [2024-11-18 16:15:07.541046] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:50.704 [2024-11-18 16:15:07.541085] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.704 [2024-11-18 16:15:07.541104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.541119] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.704 [2024-11-18 16:15:07.541131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.541144] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.704 [2024-11-18 16:15:07.541157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.541170] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.704 [2024-11-18 16:15:07.541183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.704 [2024-11-18 16:15:07.541195] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:50.704 [2024-11-18 16:15:07.543484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:50.704 [2024-11-18 16:15:07.543523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x595000 (9): Bad file descriptor 00:28:50.704 [2024-11-18 16:15:07.575602] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:50.704 00:28:50.704 Latency(us) 00:28:50.704 [2024-11-18T15:15:14.295Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:50.704 [2024-11-18T15:15:14.295Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:50.704 Verification LBA range: start 0x0 length 0x4000 00:28:50.704 NVMe0n1 : 15.01 12824.45 50.10 325.01 0.00 9717.21 625.02 16796.63 00:28:50.704 [2024-11-18T15:15:14.295Z] =================================================================================================================== 00:28:50.704 [2024-11-18T15:15:14.296Z] Total : 12824.45 50.10 325.01 0.00 9717.21 625.02 16796.63 00:28:50.705 Received shutdown signal, test time was about 15.000000 seconds 00:28:50.705 00:28:50.705 Latency(us) 00:28:50.705 [2024-11-18T15:15:14.296Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:50.705 [2024-11-18T15:15:14.296Z] =================================================================================================================== 00:28:50.705 [2024-11-18T15:15:14.296Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:50.705 16:15:13 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:50.705 16:15:13 -- host/failover.sh@65 -- # count=3 00:28:50.705 16:15:13 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:50.705 16:15:13 -- host/failover.sh@73 -- # bdevperf_pid=1695704 00:28:50.705 16:15:13 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:50.705 16:15:13 -- host/failover.sh@75 -- # waitforlisten 1695704 /var/tmp/bdevperf.sock 00:28:50.705 16:15:13 -- common/autotest_common.sh@829 -- # '[' -z 1695704 ']' 00:28:50.705 16:15:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:50.705 16:15:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:50.705 16:15:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:50.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:50.705 16:15:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:50.705 16:15:13 -- common/autotest_common.sh@10 -- # set +x 00:28:51.269 16:15:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:51.269 16:15:14 -- common/autotest_common.sh@862 -- # return 0 00:28:51.269 16:15:14 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:51.269 [2024-11-18 16:15:14.848112] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:51.527 16:15:14 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:51.527 [2024-11-18 16:15:15.108807] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:51.785 16:15:15 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:52.042 NVMe0n1 00:28:52.042 16:15:15 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:52.608 00:28:52.608 16:15:15 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:52.865 00:28:52.865 16:15:16 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:52.865 16:15:16 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:53.124 16:15:16 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:53.381 16:15:16 -- host/failover.sh@87 -- # sleep 3 00:28:56.658 16:15:19 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:56.658 16:15:19 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:56.658 16:15:20 -- host/failover.sh@90 -- # run_test_pid=1696524 00:28:56.658 16:15:20 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:56.658 16:15:20 -- host/failover.sh@92 -- # wait 1696524 00:28:57.593 0 00:28:57.593 16:15:21 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:57.593 [2024-11-18 16:15:13.599425] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:57.593 [2024-11-18 16:15:13.599506] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1695704 ] 00:28:57.593 EAL: No free 2048 kB hugepages reported on node 1 00:28:57.593 [2024-11-18 16:15:13.658143] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:57.593 [2024-11-18 16:15:13.740197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:57.593 [2024-11-18 16:15:16.756828] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:57.593 [2024-11-18 16:15:16.756914] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:57.593 [2024-11-18 16:15:16.756938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:57.593 [2024-11-18 16:15:16.756955] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:57.593 [2024-11-18 16:15:16.756968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:57.593 [2024-11-18 16:15:16.756982] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:57.593 [2024-11-18 16:15:16.756995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:57.593 [2024-11-18 16:15:16.757009] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:57.593 [2024-11-18 16:15:16.757022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:57.593 [2024-11-18 16:15:16.757035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:57.593 [2024-11-18 16:15:16.757072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:57.593 [2024-11-18 16:15:16.757102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e11000 (9): Bad file descriptor 00:28:57.593 [2024-11-18 16:15:16.808849] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:57.593 Running I/O for 1 seconds... 00:28:57.593 00:28:57.593 Latency(us) 00:28:57.593 [2024-11-18T15:15:21.184Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:57.593 [2024-11-18T15:15:21.184Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:57.593 Verification LBA range: start 0x0 length 0x4000 00:28:57.593 NVMe0n1 : 1.01 12303.44 48.06 0.00 0.00 10353.84 1165.08 13689.74 00:28:57.593 [2024-11-18T15:15:21.184Z] =================================================================================================================== 00:28:57.593 [2024-11-18T15:15:21.184Z] Total : 12303.44 48.06 0.00 0.00 10353.84 1165.08 13689.74 00:28:57.593 16:15:21 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:57.593 16:15:21 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:58.159 16:15:21 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:58.416 16:15:21 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:58.416 16:15:21 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:58.674 16:15:22 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:58.931 16:15:22 -- host/failover.sh@101 -- # sleep 3 00:29:02.208 16:15:25 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:29:02.208 16:15:25 -- host/failover.sh@103 -- # grep -q NVMe0 00:29:02.208 16:15:25 -- host/failover.sh@108 -- # killprocess 1695704 00:29:02.208 16:15:25 -- common/autotest_common.sh@936 -- # '[' -z 1695704 ']' 00:29:02.208 16:15:25 -- common/autotest_common.sh@940 -- # kill -0 1695704 00:29:02.208 16:15:25 -- common/autotest_common.sh@941 -- # uname 00:29:02.208 16:15:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:02.208 16:15:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1695704 00:29:02.208 16:15:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:02.208 16:15:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:02.208 16:15:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1695704' 00:29:02.208 killing process with pid 1695704 00:29:02.208 16:15:25 -- common/autotest_common.sh@955 -- # kill 1695704 00:29:02.208 16:15:25 -- common/autotest_common.sh@960 -- # wait 1695704 00:29:02.466 16:15:25 -- host/failover.sh@110 -- # sync 00:29:02.466 16:15:25 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:02.724 16:15:26 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:29:02.724 16:15:26 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:29:02.724 16:15:26 -- host/failover.sh@116 -- # nvmftestfini 00:29:02.724 16:15:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:02.724 16:15:26 -- nvmf/common.sh@116 -- # sync 00:29:02.724 16:15:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:02.724 16:15:26 -- nvmf/common.sh@119 -- # set +e 00:29:02.724 16:15:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:02.724 16:15:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:02.724 rmmod nvme_tcp 00:29:02.724 rmmod nvme_fabrics 00:29:02.724 rmmod nvme_keyring 00:29:02.724 16:15:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:02.724 16:15:26 -- nvmf/common.sh@123 -- # set -e 00:29:02.724 16:15:26 -- nvmf/common.sh@124 -- # return 0 00:29:02.724 16:15:26 -- nvmf/common.sh@477 -- # '[' -n 1692709 ']' 00:29:02.724 16:15:26 -- nvmf/common.sh@478 -- # killprocess 1692709 00:29:02.724 16:15:26 -- common/autotest_common.sh@936 -- # '[' -z 1692709 ']' 00:29:02.724 16:15:26 -- common/autotest_common.sh@940 -- # kill -0 1692709 00:29:02.724 16:15:26 -- common/autotest_common.sh@941 -- # uname 00:29:02.724 16:15:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:02.724 16:15:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1692709 00:29:02.724 16:15:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:02.724 16:15:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:02.724 16:15:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1692709' 00:29:02.724 killing process with pid 1692709 00:29:02.724 16:15:26 -- common/autotest_common.sh@955 -- # kill 1692709 00:29:02.724 16:15:26 -- common/autotest_common.sh@960 -- # wait 1692709 00:29:02.981 16:15:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:02.981 16:15:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:02.981 16:15:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:02.981 16:15:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:02.981 16:15:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:02.981 16:15:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:02.981 16:15:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:02.981 16:15:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:04.882 16:15:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:04.882 00:29:04.882 real 0m37.235s 00:29:04.882 user 2m12.183s 00:29:04.882 sys 0m5.866s 00:29:04.882 16:15:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:04.882 16:15:28 -- common/autotest_common.sh@10 -- # set +x 00:29:04.882 ************************************ 00:29:04.882 END TEST nvmf_failover 00:29:04.882 ************************************ 00:29:05.141 16:15:28 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:05.141 16:15:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:05.141 16:15:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:05.141 16:15:28 -- common/autotest_common.sh@10 -- # set +x 00:29:05.141 ************************************ 00:29:05.141 START TEST nvmf_discovery 00:29:05.141 ************************************ 00:29:05.141 16:15:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:29:05.141 * Looking for test storage... 00:29:05.141 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:05.141 16:15:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:05.141 16:15:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:05.141 16:15:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:05.141 16:15:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:05.141 16:15:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:05.141 16:15:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:05.141 16:15:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:05.141 16:15:28 -- scripts/common.sh@335 -- # IFS=.-: 00:29:05.141 16:15:28 -- scripts/common.sh@335 -- # read -ra ver1 00:29:05.141 16:15:28 -- scripts/common.sh@336 -- # IFS=.-: 00:29:05.141 16:15:28 -- scripts/common.sh@336 -- # read -ra ver2 00:29:05.141 16:15:28 -- scripts/common.sh@337 -- # local 'op=<' 00:29:05.141 16:15:28 -- scripts/common.sh@339 -- # ver1_l=2 00:29:05.141 16:15:28 -- scripts/common.sh@340 -- # ver2_l=1 00:29:05.141 16:15:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:05.141 16:15:28 -- scripts/common.sh@343 -- # case "$op" in 00:29:05.141 16:15:28 -- scripts/common.sh@344 -- # : 1 00:29:05.141 16:15:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:05.141 16:15:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:05.141 16:15:28 -- scripts/common.sh@364 -- # decimal 1 00:29:05.141 16:15:28 -- scripts/common.sh@352 -- # local d=1 00:29:05.141 16:15:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:05.141 16:15:28 -- scripts/common.sh@354 -- # echo 1 00:29:05.141 16:15:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:05.141 16:15:28 -- scripts/common.sh@365 -- # decimal 2 00:29:05.141 16:15:28 -- scripts/common.sh@352 -- # local d=2 00:29:05.141 16:15:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:05.141 16:15:28 -- scripts/common.sh@354 -- # echo 2 00:29:05.141 16:15:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:05.141 16:15:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:05.141 16:15:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:05.141 16:15:28 -- scripts/common.sh@367 -- # return 0 00:29:05.141 16:15:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:05.141 16:15:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:05.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.141 --rc genhtml_branch_coverage=1 00:29:05.141 --rc genhtml_function_coverage=1 00:29:05.141 --rc genhtml_legend=1 00:29:05.141 --rc geninfo_all_blocks=1 00:29:05.141 --rc geninfo_unexecuted_blocks=1 00:29:05.141 00:29:05.141 ' 00:29:05.141 16:15:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:05.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.141 --rc genhtml_branch_coverage=1 00:29:05.141 --rc genhtml_function_coverage=1 00:29:05.141 --rc genhtml_legend=1 00:29:05.141 --rc geninfo_all_blocks=1 00:29:05.141 --rc geninfo_unexecuted_blocks=1 00:29:05.141 00:29:05.141 ' 00:29:05.141 16:15:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:05.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.141 --rc genhtml_branch_coverage=1 00:29:05.141 --rc genhtml_function_coverage=1 00:29:05.141 --rc genhtml_legend=1 00:29:05.141 --rc geninfo_all_blocks=1 00:29:05.141 --rc geninfo_unexecuted_blocks=1 00:29:05.141 00:29:05.141 ' 00:29:05.141 16:15:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:05.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:05.141 --rc genhtml_branch_coverage=1 00:29:05.141 --rc genhtml_function_coverage=1 00:29:05.141 --rc genhtml_legend=1 00:29:05.141 --rc geninfo_all_blocks=1 00:29:05.141 --rc geninfo_unexecuted_blocks=1 00:29:05.141 00:29:05.141 ' 00:29:05.141 16:15:28 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:05.141 16:15:28 -- nvmf/common.sh@7 -- # uname -s 00:29:05.141 16:15:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:05.141 16:15:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:05.141 16:15:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:05.141 16:15:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:05.141 16:15:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:05.141 16:15:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:05.141 16:15:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:05.141 16:15:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:05.141 16:15:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:05.141 16:15:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:05.141 16:15:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:05.141 16:15:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:05.141 16:15:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:05.141 16:15:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:05.141 16:15:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:05.141 16:15:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:05.141 16:15:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:05.141 16:15:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:05.141 16:15:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:05.141 16:15:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.141 16:15:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.141 16:15:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.141 16:15:28 -- paths/export.sh@5 -- # export PATH 00:29:05.141 16:15:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:05.141 16:15:28 -- nvmf/common.sh@46 -- # : 0 00:29:05.141 16:15:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:05.141 16:15:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:05.141 16:15:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:05.141 16:15:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:05.141 16:15:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:05.141 16:15:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:05.141 16:15:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:05.141 16:15:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:05.141 16:15:28 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:29:05.141 16:15:28 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:29:05.141 16:15:28 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:29:05.141 16:15:28 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:29:05.141 16:15:28 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:29:05.141 16:15:28 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:29:05.141 16:15:28 -- host/discovery.sh@25 -- # nvmftestinit 00:29:05.141 16:15:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:05.142 16:15:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:05.142 16:15:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:05.142 16:15:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:05.142 16:15:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:05.142 16:15:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:05.142 16:15:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:05.142 16:15:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:05.142 16:15:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:05.142 16:15:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:05.142 16:15:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:05.142 16:15:28 -- common/autotest_common.sh@10 -- # set +x 00:29:07.672 16:15:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:07.672 16:15:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:07.672 16:15:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:07.672 16:15:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:07.672 16:15:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:07.672 16:15:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:07.672 16:15:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:07.672 16:15:30 -- nvmf/common.sh@294 -- # net_devs=() 00:29:07.672 16:15:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:07.672 16:15:30 -- nvmf/common.sh@295 -- # e810=() 00:29:07.672 16:15:30 -- nvmf/common.sh@295 -- # local -ga e810 00:29:07.672 16:15:30 -- nvmf/common.sh@296 -- # x722=() 00:29:07.672 16:15:30 -- nvmf/common.sh@296 -- # local -ga x722 00:29:07.672 16:15:30 -- nvmf/common.sh@297 -- # mlx=() 00:29:07.672 16:15:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:07.672 16:15:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:07.672 16:15:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:07.672 16:15:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:07.672 16:15:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:07.672 16:15:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:07.672 16:15:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:07.672 16:15:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:07.672 16:15:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:07.672 16:15:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:07.672 16:15:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:07.672 16:15:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:07.672 16:15:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:07.672 16:15:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:07.672 16:15:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:07.672 16:15:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:07.672 16:15:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:07.672 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:07.672 16:15:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:07.672 16:15:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:07.672 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:07.672 16:15:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:07.672 16:15:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:07.672 16:15:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:07.672 16:15:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:07.672 16:15:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:07.672 16:15:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:07.672 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:07.672 16:15:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:07.672 16:15:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:07.672 16:15:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:07.672 16:15:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:07.672 16:15:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:07.672 16:15:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:07.672 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:07.672 16:15:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:07.672 16:15:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:07.672 16:15:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:07.672 16:15:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:07.672 16:15:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:07.672 16:15:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:07.672 16:15:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:07.672 16:15:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:07.672 16:15:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:07.672 16:15:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:07.672 16:15:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:07.672 16:15:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:07.672 16:15:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:07.672 16:15:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:07.672 16:15:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:07.672 16:15:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:07.672 16:15:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:07.672 16:15:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:07.672 16:15:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:07.672 16:15:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:07.672 16:15:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:07.672 16:15:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:07.672 16:15:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:07.672 16:15:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:07.672 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:07.672 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.325 ms 00:29:07.672 00:29:07.672 --- 10.0.0.2 ping statistics --- 00:29:07.672 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:07.672 rtt min/avg/max/mdev = 0.325/0.325/0.325/0.000 ms 00:29:07.672 16:15:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:07.672 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:07.672 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:29:07.672 00:29:07.672 --- 10.0.0.1 ping statistics --- 00:29:07.672 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:07.672 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:29:07.672 16:15:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:07.672 16:15:30 -- nvmf/common.sh@410 -- # return 0 00:29:07.672 16:15:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:07.672 16:15:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:07.672 16:15:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:07.672 16:15:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:07.672 16:15:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:07.672 16:15:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:07.672 16:15:30 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:29:07.672 16:15:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:07.672 16:15:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:07.672 16:15:30 -- common/autotest_common.sh@10 -- # set +x 00:29:07.672 16:15:30 -- nvmf/common.sh@469 -- # nvmfpid=1699280 00:29:07.672 16:15:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:07.672 16:15:30 -- nvmf/common.sh@470 -- # waitforlisten 1699280 00:29:07.673 16:15:30 -- common/autotest_common.sh@829 -- # '[' -z 1699280 ']' 00:29:07.673 16:15:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:07.673 16:15:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:07.673 16:15:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:07.673 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:07.673 16:15:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:07.673 16:15:30 -- common/autotest_common.sh@10 -- # set +x 00:29:07.673 [2024-11-18 16:15:30.860024] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:07.673 [2024-11-18 16:15:30.860123] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:07.673 EAL: No free 2048 kB hugepages reported on node 1 00:29:07.673 [2024-11-18 16:15:30.925405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:07.673 [2024-11-18 16:15:31.014216] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:07.673 [2024-11-18 16:15:31.014374] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:07.673 [2024-11-18 16:15:31.014390] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:07.673 [2024-11-18 16:15:31.014402] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:07.673 [2024-11-18 16:15:31.014434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:08.608 16:15:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:08.608 16:15:31 -- common/autotest_common.sh@862 -- # return 0 00:29:08.608 16:15:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:08.608 16:15:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:08.608 16:15:31 -- common/autotest_common.sh@10 -- # set +x 00:29:08.608 16:15:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:08.608 16:15:31 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:08.608 16:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.608 16:15:31 -- common/autotest_common.sh@10 -- # set +x 00:29:08.608 [2024-11-18 16:15:31.900924] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:08.608 16:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.608 16:15:31 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:29:08.608 16:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.608 16:15:31 -- common/autotest_common.sh@10 -- # set +x 00:29:08.608 [2024-11-18 16:15:31.909122] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:08.608 16:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.608 16:15:31 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:29:08.608 16:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.608 16:15:31 -- common/autotest_common.sh@10 -- # set +x 00:29:08.608 null0 00:29:08.608 16:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.608 16:15:31 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:29:08.608 16:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.608 16:15:31 -- common/autotest_common.sh@10 -- # set +x 00:29:08.608 null1 00:29:08.608 16:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.608 16:15:31 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:29:08.608 16:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.608 16:15:31 -- common/autotest_common.sh@10 -- # set +x 00:29:08.608 16:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.608 16:15:31 -- host/discovery.sh@45 -- # hostpid=1699440 00:29:08.608 16:15:31 -- host/discovery.sh@46 -- # waitforlisten 1699440 /tmp/host.sock 00:29:08.608 16:15:31 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:29:08.608 16:15:31 -- common/autotest_common.sh@829 -- # '[' -z 1699440 ']' 00:29:08.608 16:15:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:08.608 16:15:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:08.608 16:15:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:08.608 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:08.608 16:15:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:08.608 16:15:31 -- common/autotest_common.sh@10 -- # set +x 00:29:08.608 [2024-11-18 16:15:31.980993] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:08.608 [2024-11-18 16:15:31.981064] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1699440 ] 00:29:08.608 EAL: No free 2048 kB hugepages reported on node 1 00:29:08.608 [2024-11-18 16:15:32.042859] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:08.608 [2024-11-18 16:15:32.130773] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:08.608 [2024-11-18 16:15:32.130950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:09.542 16:15:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:09.542 16:15:32 -- common/autotest_common.sh@862 -- # return 0 00:29:09.542 16:15:32 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:09.542 16:15:32 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:29:09.542 16:15:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.542 16:15:32 -- common/autotest_common.sh@10 -- # set +x 00:29:09.542 16:15:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.542 16:15:32 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:29:09.542 16:15:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.542 16:15:32 -- common/autotest_common.sh@10 -- # set +x 00:29:09.542 16:15:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.542 16:15:32 -- host/discovery.sh@72 -- # notify_id=0 00:29:09.542 16:15:32 -- host/discovery.sh@78 -- # get_subsystem_names 00:29:09.542 16:15:32 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:09.542 16:15:32 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:09.542 16:15:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.542 16:15:32 -- host/discovery.sh@59 -- # sort 00:29:09.542 16:15:32 -- common/autotest_common.sh@10 -- # set +x 00:29:09.542 16:15:32 -- host/discovery.sh@59 -- # xargs 00:29:09.542 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.542 16:15:33 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:29:09.542 16:15:33 -- host/discovery.sh@79 -- # get_bdev_list 00:29:09.542 16:15:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:09.542 16:15:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:09.542 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.542 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.542 16:15:33 -- host/discovery.sh@55 -- # sort 00:29:09.542 16:15:33 -- host/discovery.sh@55 -- # xargs 00:29:09.542 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.542 16:15:33 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:29:09.542 16:15:33 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:29:09.542 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.542 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.542 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.542 16:15:33 -- host/discovery.sh@82 -- # get_subsystem_names 00:29:09.542 16:15:33 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:09.542 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.542 16:15:33 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:09.542 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.542 16:15:33 -- host/discovery.sh@59 -- # sort 00:29:09.542 16:15:33 -- host/discovery.sh@59 -- # xargs 00:29:09.542 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.542 16:15:33 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:29:09.542 16:15:33 -- host/discovery.sh@83 -- # get_bdev_list 00:29:09.542 16:15:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:09.542 16:15:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:09.542 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.542 16:15:33 -- host/discovery.sh@55 -- # sort 00:29:09.542 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.542 16:15:33 -- host/discovery.sh@55 -- # xargs 00:29:09.828 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.828 16:15:33 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:29:09.828 16:15:33 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:29:09.828 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.828 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.828 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.828 16:15:33 -- host/discovery.sh@86 -- # get_subsystem_names 00:29:09.829 16:15:33 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:09.829 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.829 16:15:33 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:09.829 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.829 16:15:33 -- host/discovery.sh@59 -- # sort 00:29:09.829 16:15:33 -- host/discovery.sh@59 -- # xargs 00:29:09.829 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.829 16:15:33 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:29:09.829 16:15:33 -- host/discovery.sh@87 -- # get_bdev_list 00:29:09.829 16:15:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:09.829 16:15:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:09.829 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.829 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.829 16:15:33 -- host/discovery.sh@55 -- # sort 00:29:09.829 16:15:33 -- host/discovery.sh@55 -- # xargs 00:29:09.829 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.829 16:15:33 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:29:09.829 16:15:33 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:09.829 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.829 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.829 [2024-11-18 16:15:33.256860] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:09.829 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.829 16:15:33 -- host/discovery.sh@92 -- # get_subsystem_names 00:29:09.829 16:15:33 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:09.829 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.829 16:15:33 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:09.829 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.829 16:15:33 -- host/discovery.sh@59 -- # sort 00:29:09.829 16:15:33 -- host/discovery.sh@59 -- # xargs 00:29:09.829 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.829 16:15:33 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:29:09.829 16:15:33 -- host/discovery.sh@93 -- # get_bdev_list 00:29:09.829 16:15:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:09.829 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.829 16:15:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:09.829 16:15:33 -- host/discovery.sh@55 -- # sort 00:29:09.829 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.829 16:15:33 -- host/discovery.sh@55 -- # xargs 00:29:09.829 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.829 16:15:33 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:29:09.829 16:15:33 -- host/discovery.sh@94 -- # get_notification_count 00:29:09.829 16:15:33 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:09.829 16:15:33 -- host/discovery.sh@74 -- # jq '. | length' 00:29:09.829 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.829 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.829 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.829 16:15:33 -- host/discovery.sh@74 -- # notification_count=0 00:29:09.829 16:15:33 -- host/discovery.sh@75 -- # notify_id=0 00:29:09.829 16:15:33 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:29:09.829 16:15:33 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:29:09.829 16:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.829 16:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:09.829 16:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.829 16:15:33 -- host/discovery.sh@100 -- # sleep 1 00:29:10.416 [2024-11-18 16:15:33.999805] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:10.416 [2024-11-18 16:15:33.999851] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:10.416 [2024-11-18 16:15:33.999899] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:10.675 [2024-11-18 16:15:34.088180] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:10.675 [2024-11-18 16:15:34.192156] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:10.675 [2024-11-18 16:15:34.192182] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:10.932 16:15:34 -- host/discovery.sh@101 -- # get_subsystem_names 00:29:10.933 16:15:34 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:10.933 16:15:34 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:10.933 16:15:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.933 16:15:34 -- common/autotest_common.sh@10 -- # set +x 00:29:10.933 16:15:34 -- host/discovery.sh@59 -- # sort 00:29:10.933 16:15:34 -- host/discovery.sh@59 -- # xargs 00:29:10.933 16:15:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.933 16:15:34 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:10.933 16:15:34 -- host/discovery.sh@102 -- # get_bdev_list 00:29:10.933 16:15:34 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:10.933 16:15:34 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:10.933 16:15:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.933 16:15:34 -- common/autotest_common.sh@10 -- # set +x 00:29:10.933 16:15:34 -- host/discovery.sh@55 -- # sort 00:29:10.933 16:15:34 -- host/discovery.sh@55 -- # xargs 00:29:10.933 16:15:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.933 16:15:34 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:29:10.933 16:15:34 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:29:10.933 16:15:34 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:10.933 16:15:34 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:10.933 16:15:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.933 16:15:34 -- common/autotest_common.sh@10 -- # set +x 00:29:10.933 16:15:34 -- host/discovery.sh@63 -- # sort -n 00:29:10.933 16:15:34 -- host/discovery.sh@63 -- # xargs 00:29:10.933 16:15:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.933 16:15:34 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:29:10.933 16:15:34 -- host/discovery.sh@104 -- # get_notification_count 00:29:10.933 16:15:34 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:10.933 16:15:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.933 16:15:34 -- host/discovery.sh@74 -- # jq '. | length' 00:29:10.933 16:15:34 -- common/autotest_common.sh@10 -- # set +x 00:29:11.191 16:15:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.191 16:15:34 -- host/discovery.sh@74 -- # notification_count=1 00:29:11.191 16:15:34 -- host/discovery.sh@75 -- # notify_id=1 00:29:11.191 16:15:34 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:29:11.191 16:15:34 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:29:11.191 16:15:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.191 16:15:34 -- common/autotest_common.sh@10 -- # set +x 00:29:11.191 16:15:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.191 16:15:34 -- host/discovery.sh@109 -- # sleep 1 00:29:12.125 16:15:35 -- host/discovery.sh@110 -- # get_bdev_list 00:29:12.125 16:15:35 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:12.125 16:15:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.125 16:15:35 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:12.125 16:15:35 -- common/autotest_common.sh@10 -- # set +x 00:29:12.125 16:15:35 -- host/discovery.sh@55 -- # sort 00:29:12.125 16:15:35 -- host/discovery.sh@55 -- # xargs 00:29:12.125 16:15:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:12.125 16:15:35 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:12.125 16:15:35 -- host/discovery.sh@111 -- # get_notification_count 00:29:12.125 16:15:35 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:29:12.125 16:15:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.125 16:15:35 -- host/discovery.sh@74 -- # jq '. | length' 00:29:12.125 16:15:35 -- common/autotest_common.sh@10 -- # set +x 00:29:12.125 16:15:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:12.125 16:15:35 -- host/discovery.sh@74 -- # notification_count=1 00:29:12.125 16:15:35 -- host/discovery.sh@75 -- # notify_id=2 00:29:12.125 16:15:35 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:29:12.125 16:15:35 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:29:12.125 16:15:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:12.125 16:15:35 -- common/autotest_common.sh@10 -- # set +x 00:29:12.125 [2024-11-18 16:15:35.647831] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:12.125 [2024-11-18 16:15:35.648272] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:12.125 [2024-11-18 16:15:35.648308] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:12.125 16:15:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:12.125 16:15:35 -- host/discovery.sh@117 -- # sleep 1 00:29:12.383 [2024-11-18 16:15:35.734567] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:29:12.641 [2024-11-18 16:15:36.038103] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:12.641 [2024-11-18 16:15:36.038129] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:12.641 [2024-11-18 16:15:36.038140] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:13.207 16:15:36 -- host/discovery.sh@118 -- # get_subsystem_names 00:29:13.207 16:15:36 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:13.207 16:15:36 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:13.207 16:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.207 16:15:36 -- common/autotest_common.sh@10 -- # set +x 00:29:13.207 16:15:36 -- host/discovery.sh@59 -- # sort 00:29:13.207 16:15:36 -- host/discovery.sh@59 -- # xargs 00:29:13.207 16:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.207 16:15:36 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:13.207 16:15:36 -- host/discovery.sh@119 -- # get_bdev_list 00:29:13.207 16:15:36 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:13.207 16:15:36 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:13.207 16:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.207 16:15:36 -- common/autotest_common.sh@10 -- # set +x 00:29:13.207 16:15:36 -- host/discovery.sh@55 -- # sort 00:29:13.207 16:15:36 -- host/discovery.sh@55 -- # xargs 00:29:13.207 16:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.207 16:15:36 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:13.207 16:15:36 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:29:13.207 16:15:36 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:13.207 16:15:36 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:13.207 16:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.207 16:15:36 -- common/autotest_common.sh@10 -- # set +x 00:29:13.207 16:15:36 -- host/discovery.sh@63 -- # sort -n 00:29:13.207 16:15:36 -- host/discovery.sh@63 -- # xargs 00:29:13.207 16:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.207 16:15:36 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:29:13.207 16:15:36 -- host/discovery.sh@121 -- # get_notification_count 00:29:13.207 16:15:36 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:13.207 16:15:36 -- host/discovery.sh@74 -- # jq '. | length' 00:29:13.207 16:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.207 16:15:36 -- common/autotest_common.sh@10 -- # set +x 00:29:13.207 16:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.465 16:15:36 -- host/discovery.sh@74 -- # notification_count=0 00:29:13.465 16:15:36 -- host/discovery.sh@75 -- # notify_id=2 00:29:13.465 16:15:36 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:29:13.465 16:15:36 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:13.465 16:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.465 16:15:36 -- common/autotest_common.sh@10 -- # set +x 00:29:13.465 [2024-11-18 16:15:36.819626] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:13.465 [2024-11-18 16:15:36.819683] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:13.465 16:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.465 16:15:36 -- host/discovery.sh@127 -- # sleep 1 00:29:13.465 [2024-11-18 16:15:36.825857] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:13.465 [2024-11-18 16:15:36.825900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:13.465 [2024-11-18 16:15:36.825917] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:13.465 [2024-11-18 16:15:36.825931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:13.465 [2024-11-18 16:15:36.825961] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:13.465 [2024-11-18 16:15:36.825976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:13.465 [2024-11-18 16:15:36.825991] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:13.466 [2024-11-18 16:15:36.826005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:13.466 [2024-11-18 16:15:36.826020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c86410 is same with the state(5) to be set 00:29:13.466 [2024-11-18 16:15:36.835850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c86410 (9): Bad file descriptor 00:29:13.466 [2024-11-18 16:15:36.845910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:13.466 [2024-11-18 16:15:36.846105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.846222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.846251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c86410 with addr=10.0.0.2, port=4420 00:29:13.466 [2024-11-18 16:15:36.846270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c86410 is same with the state(5) to be set 00:29:13.466 [2024-11-18 16:15:36.846295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c86410 (9): Bad file descriptor 00:29:13.466 [2024-11-18 16:15:36.846319] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:13.466 [2024-11-18 16:15:36.846335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:13.466 [2024-11-18 16:15:36.846351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:13.466 [2024-11-18 16:15:36.846372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:13.466 [2024-11-18 16:15:36.855991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:13.466 [2024-11-18 16:15:36.856167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.856295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.856324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c86410 with addr=10.0.0.2, port=4420 00:29:13.466 [2024-11-18 16:15:36.856341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c86410 is same with the state(5) to be set 00:29:13.466 [2024-11-18 16:15:36.856366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c86410 (9): Bad file descriptor 00:29:13.466 [2024-11-18 16:15:36.856389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:13.466 [2024-11-18 16:15:36.856404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:13.466 [2024-11-18 16:15:36.856418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:13.466 [2024-11-18 16:15:36.856439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:13.466 [2024-11-18 16:15:36.866068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:13.466 [2024-11-18 16:15:36.866258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.866393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.866421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c86410 with addr=10.0.0.2, port=4420 00:29:13.466 [2024-11-18 16:15:36.866438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c86410 is same with the state(5) to be set 00:29:13.466 [2024-11-18 16:15:36.866463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c86410 (9): Bad file descriptor 00:29:13.466 [2024-11-18 16:15:36.866485] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:13.466 [2024-11-18 16:15:36.866500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:13.466 [2024-11-18 16:15:36.866514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:13.466 [2024-11-18 16:15:36.866535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:13.466 [2024-11-18 16:15:36.876151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:13.466 [2024-11-18 16:15:36.876318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.876472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.876500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c86410 with addr=10.0.0.2, port=4420 00:29:13.466 [2024-11-18 16:15:36.876518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c86410 is same with the state(5) to be set 00:29:13.466 [2024-11-18 16:15:36.876543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c86410 (9): Bad file descriptor 00:29:13.466 [2024-11-18 16:15:36.876565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:13.466 [2024-11-18 16:15:36.876579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:13.466 [2024-11-18 16:15:36.876594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:13.466 [2024-11-18 16:15:36.876623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:13.466 [2024-11-18 16:15:36.886234] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:13.466 [2024-11-18 16:15:36.886423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.886558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.886586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c86410 with addr=10.0.0.2, port=4420 00:29:13.466 [2024-11-18 16:15:36.886604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c86410 is same with the state(5) to be set 00:29:13.466 [2024-11-18 16:15:36.886640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c86410 (9): Bad file descriptor 00:29:13.466 [2024-11-18 16:15:36.886677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:13.466 [2024-11-18 16:15:36.886690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:13.466 [2024-11-18 16:15:36.886703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:13.466 [2024-11-18 16:15:36.886722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:13.466 [2024-11-18 16:15:36.896314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:13.466 [2024-11-18 16:15:36.896471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.896623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:13.466 [2024-11-18 16:15:36.896670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c86410 with addr=10.0.0.2, port=4420 00:29:13.466 [2024-11-18 16:15:36.896691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c86410 is same with the state(5) to be set 00:29:13.466 [2024-11-18 16:15:36.896714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c86410 (9): Bad file descriptor 00:29:13.466 [2024-11-18 16:15:36.896734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:13.466 [2024-11-18 16:15:36.896747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:13.466 [2024-11-18 16:15:36.896761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:13.466 [2024-11-18 16:15:36.896780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:13.466 [2024-11-18 16:15:36.905932] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:29:13.466 [2024-11-18 16:15:36.905963] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:14.400 16:15:37 -- host/discovery.sh@128 -- # get_subsystem_names 00:29:14.400 16:15:37 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:14.400 16:15:37 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:14.400 16:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.400 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:29:14.400 16:15:37 -- host/discovery.sh@59 -- # sort 00:29:14.400 16:15:37 -- host/discovery.sh@59 -- # xargs 00:29:14.400 16:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.400 16:15:37 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:14.400 16:15:37 -- host/discovery.sh@129 -- # get_bdev_list 00:29:14.400 16:15:37 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:14.400 16:15:37 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:14.400 16:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.400 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:29:14.400 16:15:37 -- host/discovery.sh@55 -- # sort 00:29:14.400 16:15:37 -- host/discovery.sh@55 -- # xargs 00:29:14.400 16:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.400 16:15:37 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:14.400 16:15:37 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:29:14.400 16:15:37 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:14.400 16:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.400 16:15:37 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:14.400 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:29:14.400 16:15:37 -- host/discovery.sh@63 -- # sort -n 00:29:14.400 16:15:37 -- host/discovery.sh@63 -- # xargs 00:29:14.400 16:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.400 16:15:37 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:29:14.400 16:15:37 -- host/discovery.sh@131 -- # get_notification_count 00:29:14.400 16:15:37 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:14.400 16:15:37 -- host/discovery.sh@74 -- # jq '. | length' 00:29:14.400 16:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.400 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:29:14.400 16:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.658 16:15:37 -- host/discovery.sh@74 -- # notification_count=0 00:29:14.658 16:15:37 -- host/discovery.sh@75 -- # notify_id=2 00:29:14.658 16:15:37 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:29:14.658 16:15:37 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:29:14.658 16:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.658 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:29:14.658 16:15:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.658 16:15:38 -- host/discovery.sh@135 -- # sleep 1 00:29:15.592 16:15:39 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:15.592 16:15:39 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:15.592 16:15:39 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:15.592 16:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.592 16:15:39 -- host/discovery.sh@59 -- # sort 00:29:15.592 16:15:39 -- common/autotest_common.sh@10 -- # set +x 00:29:15.592 16:15:39 -- host/discovery.sh@59 -- # xargs 00:29:15.592 16:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.592 16:15:39 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:15.592 16:15:39 -- host/discovery.sh@137 -- # get_bdev_list 00:29:15.592 16:15:39 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:15.592 16:15:39 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:15.592 16:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.592 16:15:39 -- common/autotest_common.sh@10 -- # set +x 00:29:15.592 16:15:39 -- host/discovery.sh@55 -- # sort 00:29:15.592 16:15:39 -- host/discovery.sh@55 -- # xargs 00:29:15.592 16:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.592 16:15:39 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:15.592 16:15:39 -- host/discovery.sh@138 -- # get_notification_count 00:29:15.592 16:15:39 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:15.592 16:15:39 -- host/discovery.sh@74 -- # jq '. | length' 00:29:15.592 16:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.592 16:15:39 -- common/autotest_common.sh@10 -- # set +x 00:29:15.592 16:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.592 16:15:39 -- host/discovery.sh@74 -- # notification_count=2 00:29:15.592 16:15:39 -- host/discovery.sh@75 -- # notify_id=4 00:29:15.592 16:15:39 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:15.592 16:15:39 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:15.592 16:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.592 16:15:39 -- common/autotest_common.sh@10 -- # set +x 00:29:16.965 [2024-11-18 16:15:40.206269] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:16.965 [2024-11-18 16:15:40.206314] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:16.965 [2024-11-18 16:15:40.206340] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:16.965 [2024-11-18 16:15:40.334808] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:16.965 [2024-11-18 16:15:40.401043] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:16.965 [2024-11-18 16:15:40.401096] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:16.965 16:15:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.965 16:15:40 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:16.965 16:15:40 -- common/autotest_common.sh@650 -- # local es=0 00:29:16.965 16:15:40 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:16.965 16:15:40 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:16.965 16:15:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:16.965 16:15:40 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:16.965 16:15:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:16.966 16:15:40 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:16.966 16:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.966 16:15:40 -- common/autotest_common.sh@10 -- # set +x 00:29:16.966 request: 00:29:16.966 { 00:29:16.966 "name": "nvme", 00:29:16.966 "trtype": "tcp", 00:29:16.966 "traddr": "10.0.0.2", 00:29:16.966 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:16.966 "adrfam": "ipv4", 00:29:16.966 "trsvcid": "8009", 00:29:16.966 "wait_for_attach": true, 00:29:16.966 "method": "bdev_nvme_start_discovery", 00:29:16.966 "req_id": 1 00:29:16.966 } 00:29:16.966 Got JSON-RPC error response 00:29:16.966 response: 00:29:16.966 { 00:29:16.966 "code": -17, 00:29:16.966 "message": "File exists" 00:29:16.966 } 00:29:16.966 16:15:40 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:16.966 16:15:40 -- common/autotest_common.sh@653 -- # es=1 00:29:16.966 16:15:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:16.966 16:15:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:16.966 16:15:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:16.966 16:15:40 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:16.966 16:15:40 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:16.966 16:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.966 16:15:40 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:16.966 16:15:40 -- common/autotest_common.sh@10 -- # set +x 00:29:16.966 16:15:40 -- host/discovery.sh@67 -- # sort 00:29:16.966 16:15:40 -- host/discovery.sh@67 -- # xargs 00:29:16.966 16:15:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.966 16:15:40 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:16.966 16:15:40 -- host/discovery.sh@147 -- # get_bdev_list 00:29:16.966 16:15:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:16.966 16:15:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:16.966 16:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.966 16:15:40 -- common/autotest_common.sh@10 -- # set +x 00:29:16.966 16:15:40 -- host/discovery.sh@55 -- # sort 00:29:16.966 16:15:40 -- host/discovery.sh@55 -- # xargs 00:29:16.966 16:15:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.966 16:15:40 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:16.966 16:15:40 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:16.966 16:15:40 -- common/autotest_common.sh@650 -- # local es=0 00:29:16.966 16:15:40 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:16.966 16:15:40 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:16.966 16:15:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:16.966 16:15:40 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:16.966 16:15:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:16.966 16:15:40 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:16.966 16:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.966 16:15:40 -- common/autotest_common.sh@10 -- # set +x 00:29:16.966 request: 00:29:16.966 { 00:29:16.966 "name": "nvme_second", 00:29:16.966 "trtype": "tcp", 00:29:16.966 "traddr": "10.0.0.2", 00:29:16.966 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:16.966 "adrfam": "ipv4", 00:29:16.966 "trsvcid": "8009", 00:29:16.966 "wait_for_attach": true, 00:29:16.966 "method": "bdev_nvme_start_discovery", 00:29:16.966 "req_id": 1 00:29:16.966 } 00:29:16.966 Got JSON-RPC error response 00:29:16.966 response: 00:29:16.966 { 00:29:16.966 "code": -17, 00:29:16.966 "message": "File exists" 00:29:16.966 } 00:29:16.966 16:15:40 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:16.966 16:15:40 -- common/autotest_common.sh@653 -- # es=1 00:29:16.966 16:15:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:16.966 16:15:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:16.966 16:15:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:16.966 16:15:40 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:16.966 16:15:40 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:16.966 16:15:40 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:16.966 16:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.966 16:15:40 -- common/autotest_common.sh@10 -- # set +x 00:29:16.966 16:15:40 -- host/discovery.sh@67 -- # sort 00:29:16.966 16:15:40 -- host/discovery.sh@67 -- # xargs 00:29:16.966 16:15:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.224 16:15:40 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:17.224 16:15:40 -- host/discovery.sh@153 -- # get_bdev_list 00:29:17.224 16:15:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:17.224 16:15:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:17.224 16:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.224 16:15:40 -- host/discovery.sh@55 -- # sort 00:29:17.224 16:15:40 -- common/autotest_common.sh@10 -- # set +x 00:29:17.224 16:15:40 -- host/discovery.sh@55 -- # xargs 00:29:17.224 16:15:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.224 16:15:40 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:17.224 16:15:40 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:17.224 16:15:40 -- common/autotest_common.sh@650 -- # local es=0 00:29:17.224 16:15:40 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:17.224 16:15:40 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:17.224 16:15:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:17.224 16:15:40 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:17.224 16:15:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:17.224 16:15:40 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:17.224 16:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.224 16:15:40 -- common/autotest_common.sh@10 -- # set +x 00:29:18.159 [2024-11-18 16:15:41.605337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:18.159 [2024-11-18 16:15:41.605520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:18.159 [2024-11-18 16:15:41.605550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bfd2e0 with addr=10.0.0.2, port=8010 00:29:18.159 [2024-11-18 16:15:41.605593] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:18.159 [2024-11-18 16:15:41.605620] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:18.159 [2024-11-18 16:15:41.605638] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:19.092 [2024-11-18 16:15:42.607643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:19.092 [2024-11-18 16:15:42.607777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:19.092 [2024-11-18 16:15:42.607802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bfd2e0 with addr=10.0.0.2, port=8010 00:29:19.092 [2024-11-18 16:15:42.607821] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:19.093 [2024-11-18 16:15:42.607833] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:19.093 [2024-11-18 16:15:42.607845] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:20.026 [2024-11-18 16:15:43.609919] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:20.026 request: 00:29:20.026 { 00:29:20.026 "name": "nvme_second", 00:29:20.026 "trtype": "tcp", 00:29:20.026 "traddr": "10.0.0.2", 00:29:20.026 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:20.026 "adrfam": "ipv4", 00:29:20.026 "trsvcid": "8010", 00:29:20.026 "attach_timeout_ms": 3000, 00:29:20.026 "method": "bdev_nvme_start_discovery", 00:29:20.026 "req_id": 1 00:29:20.026 } 00:29:20.026 Got JSON-RPC error response 00:29:20.026 response: 00:29:20.026 { 00:29:20.026 "code": -110, 00:29:20.026 "message": "Connection timed out" 00:29:20.026 } 00:29:20.026 16:15:43 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:20.026 16:15:43 -- common/autotest_common.sh@653 -- # es=1 00:29:20.026 16:15:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:20.026 16:15:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:20.026 16:15:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:20.026 16:15:43 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:20.285 16:15:43 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:20.285 16:15:43 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:20.285 16:15:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.285 16:15:43 -- host/discovery.sh@67 -- # sort 00:29:20.285 16:15:43 -- common/autotest_common.sh@10 -- # set +x 00:29:20.285 16:15:43 -- host/discovery.sh@67 -- # xargs 00:29:20.285 16:15:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.285 16:15:43 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:20.285 16:15:43 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:20.285 16:15:43 -- host/discovery.sh@162 -- # kill 1699440 00:29:20.285 16:15:43 -- host/discovery.sh@163 -- # nvmftestfini 00:29:20.285 16:15:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:20.285 16:15:43 -- nvmf/common.sh@116 -- # sync 00:29:20.285 16:15:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:20.285 16:15:43 -- nvmf/common.sh@119 -- # set +e 00:29:20.285 16:15:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:20.285 16:15:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:20.285 rmmod nvme_tcp 00:29:20.285 rmmod nvme_fabrics 00:29:20.285 rmmod nvme_keyring 00:29:20.285 16:15:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:20.285 16:15:43 -- nvmf/common.sh@123 -- # set -e 00:29:20.285 16:15:43 -- nvmf/common.sh@124 -- # return 0 00:29:20.285 16:15:43 -- nvmf/common.sh@477 -- # '[' -n 1699280 ']' 00:29:20.285 16:15:43 -- nvmf/common.sh@478 -- # killprocess 1699280 00:29:20.285 16:15:43 -- common/autotest_common.sh@936 -- # '[' -z 1699280 ']' 00:29:20.285 16:15:43 -- common/autotest_common.sh@940 -- # kill -0 1699280 00:29:20.285 16:15:43 -- common/autotest_common.sh@941 -- # uname 00:29:20.285 16:15:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:20.285 16:15:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1699280 00:29:20.285 16:15:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:20.285 16:15:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:20.285 16:15:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1699280' 00:29:20.285 killing process with pid 1699280 00:29:20.285 16:15:43 -- common/autotest_common.sh@955 -- # kill 1699280 00:29:20.285 16:15:43 -- common/autotest_common.sh@960 -- # wait 1699280 00:29:20.544 16:15:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:20.544 16:15:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:20.544 16:15:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:20.544 16:15:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:20.544 16:15:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:20.544 16:15:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:20.544 16:15:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:20.544 16:15:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:23.074 16:15:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:23.074 00:29:23.074 real 0m17.574s 00:29:23.074 user 0m27.337s 00:29:23.074 sys 0m2.828s 00:29:23.074 16:15:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:23.074 16:15:46 -- common/autotest_common.sh@10 -- # set +x 00:29:23.074 ************************************ 00:29:23.074 END TEST nvmf_discovery 00:29:23.074 ************************************ 00:29:23.074 16:15:46 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:23.074 16:15:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:23.074 16:15:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:23.074 16:15:46 -- common/autotest_common.sh@10 -- # set +x 00:29:23.074 ************************************ 00:29:23.074 START TEST nvmf_discovery_remove_ifc 00:29:23.074 ************************************ 00:29:23.074 16:15:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:23.074 * Looking for test storage... 00:29:23.074 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:23.074 16:15:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:23.074 16:15:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:23.074 16:15:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:23.074 16:15:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:23.074 16:15:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:23.074 16:15:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:23.075 16:15:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:23.075 16:15:46 -- scripts/common.sh@335 -- # IFS=.-: 00:29:23.075 16:15:46 -- scripts/common.sh@335 -- # read -ra ver1 00:29:23.075 16:15:46 -- scripts/common.sh@336 -- # IFS=.-: 00:29:23.075 16:15:46 -- scripts/common.sh@336 -- # read -ra ver2 00:29:23.075 16:15:46 -- scripts/common.sh@337 -- # local 'op=<' 00:29:23.075 16:15:46 -- scripts/common.sh@339 -- # ver1_l=2 00:29:23.075 16:15:46 -- scripts/common.sh@340 -- # ver2_l=1 00:29:23.075 16:15:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:23.075 16:15:46 -- scripts/common.sh@343 -- # case "$op" in 00:29:23.075 16:15:46 -- scripts/common.sh@344 -- # : 1 00:29:23.075 16:15:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:23.075 16:15:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:23.075 16:15:46 -- scripts/common.sh@364 -- # decimal 1 00:29:23.075 16:15:46 -- scripts/common.sh@352 -- # local d=1 00:29:23.075 16:15:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:23.075 16:15:46 -- scripts/common.sh@354 -- # echo 1 00:29:23.075 16:15:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:23.075 16:15:46 -- scripts/common.sh@365 -- # decimal 2 00:29:23.075 16:15:46 -- scripts/common.sh@352 -- # local d=2 00:29:23.075 16:15:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:23.075 16:15:46 -- scripts/common.sh@354 -- # echo 2 00:29:23.075 16:15:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:23.075 16:15:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:23.075 16:15:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:23.075 16:15:46 -- scripts/common.sh@367 -- # return 0 00:29:23.075 16:15:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:23.075 16:15:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:23.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:23.075 --rc genhtml_branch_coverage=1 00:29:23.075 --rc genhtml_function_coverage=1 00:29:23.075 --rc genhtml_legend=1 00:29:23.075 --rc geninfo_all_blocks=1 00:29:23.075 --rc geninfo_unexecuted_blocks=1 00:29:23.075 00:29:23.075 ' 00:29:23.075 16:15:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:23.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:23.075 --rc genhtml_branch_coverage=1 00:29:23.075 --rc genhtml_function_coverage=1 00:29:23.075 --rc genhtml_legend=1 00:29:23.075 --rc geninfo_all_blocks=1 00:29:23.075 --rc geninfo_unexecuted_blocks=1 00:29:23.075 00:29:23.075 ' 00:29:23.075 16:15:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:23.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:23.075 --rc genhtml_branch_coverage=1 00:29:23.075 --rc genhtml_function_coverage=1 00:29:23.075 --rc genhtml_legend=1 00:29:23.075 --rc geninfo_all_blocks=1 00:29:23.075 --rc geninfo_unexecuted_blocks=1 00:29:23.075 00:29:23.075 ' 00:29:23.075 16:15:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:23.075 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:23.075 --rc genhtml_branch_coverage=1 00:29:23.075 --rc genhtml_function_coverage=1 00:29:23.075 --rc genhtml_legend=1 00:29:23.075 --rc geninfo_all_blocks=1 00:29:23.075 --rc geninfo_unexecuted_blocks=1 00:29:23.075 00:29:23.075 ' 00:29:23.075 16:15:46 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:23.075 16:15:46 -- nvmf/common.sh@7 -- # uname -s 00:29:23.075 16:15:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:23.075 16:15:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:23.075 16:15:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:23.075 16:15:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:23.075 16:15:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:23.075 16:15:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:23.075 16:15:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:23.075 16:15:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:23.075 16:15:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:23.075 16:15:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:23.075 16:15:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:23.075 16:15:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:23.075 16:15:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:23.075 16:15:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:23.075 16:15:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:23.075 16:15:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:23.075 16:15:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:23.075 16:15:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:23.075 16:15:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:23.075 16:15:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:23.075 16:15:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:23.075 16:15:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:23.075 16:15:46 -- paths/export.sh@5 -- # export PATH 00:29:23.075 16:15:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:23.075 16:15:46 -- nvmf/common.sh@46 -- # : 0 00:29:23.075 16:15:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:23.075 16:15:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:23.075 16:15:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:23.075 16:15:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:23.075 16:15:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:23.075 16:15:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:23.075 16:15:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:23.075 16:15:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:23.075 16:15:46 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:23.075 16:15:46 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:23.075 16:15:46 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:23.075 16:15:46 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:23.075 16:15:46 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:23.075 16:15:46 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:23.075 16:15:46 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:23.075 16:15:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:23.075 16:15:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:23.075 16:15:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:23.075 16:15:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:23.075 16:15:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:23.075 16:15:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:23.075 16:15:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:23.075 16:15:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:23.075 16:15:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:23.075 16:15:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:23.075 16:15:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:23.076 16:15:46 -- common/autotest_common.sh@10 -- # set +x 00:29:24.978 16:15:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:24.978 16:15:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:24.978 16:15:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:24.978 16:15:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:24.978 16:15:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:24.978 16:15:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:24.978 16:15:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:24.979 16:15:48 -- nvmf/common.sh@294 -- # net_devs=() 00:29:24.979 16:15:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:24.979 16:15:48 -- nvmf/common.sh@295 -- # e810=() 00:29:24.979 16:15:48 -- nvmf/common.sh@295 -- # local -ga e810 00:29:24.979 16:15:48 -- nvmf/common.sh@296 -- # x722=() 00:29:24.979 16:15:48 -- nvmf/common.sh@296 -- # local -ga x722 00:29:24.979 16:15:48 -- nvmf/common.sh@297 -- # mlx=() 00:29:24.979 16:15:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:24.979 16:15:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:24.979 16:15:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:24.979 16:15:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:24.979 16:15:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:24.979 16:15:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:24.979 16:15:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:24.979 16:15:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:24.979 16:15:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:24.979 16:15:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:24.979 16:15:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:24.979 16:15:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:24.979 16:15:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:24.979 16:15:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:24.979 16:15:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:24.979 16:15:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:24.979 16:15:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:24.979 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:24.979 16:15:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:24.979 16:15:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:24.979 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:24.979 16:15:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:24.979 16:15:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:24.979 16:15:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:24.979 16:15:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:24.979 16:15:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:24.979 16:15:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:24.979 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:24.979 16:15:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:24.979 16:15:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:24.979 16:15:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:24.979 16:15:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:24.979 16:15:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:24.979 16:15:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:24.979 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:24.979 16:15:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:24.979 16:15:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:24.979 16:15:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:24.979 16:15:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:24.979 16:15:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:24.979 16:15:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:24.979 16:15:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:24.979 16:15:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:24.979 16:15:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:24.979 16:15:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:24.979 16:15:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:24.979 16:15:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:24.979 16:15:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:24.979 16:15:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:24.979 16:15:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:24.979 16:15:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:24.979 16:15:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:24.979 16:15:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:24.979 16:15:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:24.979 16:15:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:24.979 16:15:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:24.979 16:15:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:24.979 16:15:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:24.979 16:15:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:24.979 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:24.979 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.353 ms 00:29:24.979 00:29:24.979 --- 10.0.0.2 ping statistics --- 00:29:24.979 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:24.979 rtt min/avg/max/mdev = 0.353/0.353/0.353/0.000 ms 00:29:24.979 16:15:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:24.979 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:24.979 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.137 ms 00:29:24.979 00:29:24.979 --- 10.0.0.1 ping statistics --- 00:29:24.979 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:24.979 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:29:24.979 16:15:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:24.979 16:15:48 -- nvmf/common.sh@410 -- # return 0 00:29:24.979 16:15:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:24.979 16:15:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:24.979 16:15:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:24.979 16:15:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:24.979 16:15:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:24.979 16:15:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:24.979 16:15:48 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:24.979 16:15:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:24.979 16:15:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:24.979 16:15:48 -- common/autotest_common.sh@10 -- # set +x 00:29:24.979 16:15:48 -- nvmf/common.sh@469 -- # nvmfpid=1702921 00:29:24.979 16:15:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:24.979 16:15:48 -- nvmf/common.sh@470 -- # waitforlisten 1702921 00:29:24.979 16:15:48 -- common/autotest_common.sh@829 -- # '[' -z 1702921 ']' 00:29:24.979 16:15:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:24.979 16:15:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:24.979 16:15:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:24.979 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:24.979 16:15:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:24.979 16:15:48 -- common/autotest_common.sh@10 -- # set +x 00:29:24.979 [2024-11-18 16:15:48.489645] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:24.979 [2024-11-18 16:15:48.489729] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:24.979 EAL: No free 2048 kB hugepages reported on node 1 00:29:24.979 [2024-11-18 16:15:48.553267] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:25.238 [2024-11-18 16:15:48.638904] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:25.238 [2024-11-18 16:15:48.639065] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:25.238 [2024-11-18 16:15:48.639082] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:25.238 [2024-11-18 16:15:48.639110] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:25.238 [2024-11-18 16:15:48.639136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:26.171 16:15:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:26.171 16:15:49 -- common/autotest_common.sh@862 -- # return 0 00:29:26.171 16:15:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:26.171 16:15:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:26.171 16:15:49 -- common/autotest_common.sh@10 -- # set +x 00:29:26.171 16:15:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:26.171 16:15:49 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:26.171 16:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.171 16:15:49 -- common/autotest_common.sh@10 -- # set +x 00:29:26.171 [2024-11-18 16:15:49.478565] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:26.171 [2024-11-18 16:15:49.486771] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:26.171 null0 00:29:26.171 [2024-11-18 16:15:49.518718] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:26.171 16:15:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.171 16:15:49 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1703073 00:29:26.171 16:15:49 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:26.171 16:15:49 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1703073 /tmp/host.sock 00:29:26.171 16:15:49 -- common/autotest_common.sh@829 -- # '[' -z 1703073 ']' 00:29:26.171 16:15:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:26.171 16:15:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:26.171 16:15:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:26.171 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:26.171 16:15:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:26.171 16:15:49 -- common/autotest_common.sh@10 -- # set +x 00:29:26.171 [2024-11-18 16:15:49.582095] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:26.171 [2024-11-18 16:15:49.582174] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1703073 ] 00:29:26.171 EAL: No free 2048 kB hugepages reported on node 1 00:29:26.171 [2024-11-18 16:15:49.645294] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:26.171 [2024-11-18 16:15:49.733342] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:26.171 [2024-11-18 16:15:49.733522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:26.430 16:15:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:26.430 16:15:49 -- common/autotest_common.sh@862 -- # return 0 00:29:26.430 16:15:49 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:26.430 16:15:49 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:26.430 16:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.430 16:15:49 -- common/autotest_common.sh@10 -- # set +x 00:29:26.430 16:15:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.430 16:15:49 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:26.430 16:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.430 16:15:49 -- common/autotest_common.sh@10 -- # set +x 00:29:26.430 16:15:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.430 16:15:49 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:26.430 16:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.430 16:15:49 -- common/autotest_common.sh@10 -- # set +x 00:29:27.803 [2024-11-18 16:15:50.966264] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:27.803 [2024-11-18 16:15:50.966302] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:27.803 [2024-11-18 16:15:50.966329] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:27.803 [2024-11-18 16:15:51.092789] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:27.803 [2024-11-18 16:15:51.238688] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:27.803 [2024-11-18 16:15:51.238751] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:27.803 [2024-11-18 16:15:51.238798] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:27.803 [2024-11-18 16:15:51.238818] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:27.803 [2024-11-18 16:15:51.238852] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:27.803 16:15:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:27.803 16:15:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:27.803 16:15:51 -- common/autotest_common.sh@10 -- # set +x 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:27.803 [2024-11-18 16:15:51.244810] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xf8dc50 was disconnected and freed. delete nvme_qpair. 00:29:27.803 16:15:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:27.803 16:15:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.803 16:15:51 -- common/autotest_common.sh@10 -- # set +x 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:27.803 16:15:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:27.803 16:15:51 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:29.178 16:15:52 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:29.178 16:15:52 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:29.178 16:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.178 16:15:52 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:29.178 16:15:52 -- common/autotest_common.sh@10 -- # set +x 00:29:29.178 16:15:52 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:29.178 16:15:52 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:29.178 16:15:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.178 16:15:52 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:29.178 16:15:52 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:30.111 16:15:53 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:30.111 16:15:53 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:30.111 16:15:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.111 16:15:53 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:30.111 16:15:53 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:30.111 16:15:53 -- common/autotest_common.sh@10 -- # set +x 00:29:30.111 16:15:53 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:30.111 16:15:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.111 16:15:53 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:30.111 16:15:53 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:31.046 16:15:54 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:31.046 16:15:54 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:31.046 16:15:54 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:31.046 16:15:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.046 16:15:54 -- common/autotest_common.sh@10 -- # set +x 00:29:31.046 16:15:54 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:31.046 16:15:54 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:31.046 16:15:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.046 16:15:54 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:31.046 16:15:54 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:31.980 16:15:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:31.980 16:15:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:31.980 16:15:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:31.980 16:15:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:31.980 16:15:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.980 16:15:55 -- common/autotest_common.sh@10 -- # set +x 00:29:31.980 16:15:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:31.980 16:15:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.980 16:15:55 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:31.980 16:15:55 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:33.354 16:15:56 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:33.354 16:15:56 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:33.354 16:15:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.354 16:15:56 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:33.354 16:15:56 -- common/autotest_common.sh@10 -- # set +x 00:29:33.354 16:15:56 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:33.354 16:15:56 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:33.354 16:15:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.354 16:15:56 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:33.354 16:15:56 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:33.354 [2024-11-18 16:15:56.679868] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:33.354 [2024-11-18 16:15:56.679946] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:33.354 [2024-11-18 16:15:56.679971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:33.354 [2024-11-18 16:15:56.679990] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:33.354 [2024-11-18 16:15:56.680005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:33.354 [2024-11-18 16:15:56.680020] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:33.354 [2024-11-18 16:15:56.680035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:33.354 [2024-11-18 16:15:56.680050] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:33.354 [2024-11-18 16:15:56.680065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:33.354 [2024-11-18 16:15:56.680081] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:33.354 [2024-11-18 16:15:56.680095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:33.354 [2024-11-18 16:15:56.680110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf540b0 is same with the state(5) to be set 00:29:33.354 [2024-11-18 16:15:56.689888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf540b0 (9): Bad file descriptor 00:29:33.354 [2024-11-18 16:15:56.699951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:34.287 16:15:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:34.287 16:15:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:34.287 16:15:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:34.287 16:15:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.287 16:15:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:34.287 16:15:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:34.287 16:15:57 -- common/autotest_common.sh@10 -- # set +x 00:29:34.287 [2024-11-18 16:15:57.759672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:35.222 [2024-11-18 16:15:58.783673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:35.222 [2024-11-18 16:15:58.783744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf540b0 with addr=10.0.0.2, port=4420 00:29:35.222 [2024-11-18 16:15:58.783775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf540b0 is same with the state(5) to be set 00:29:35.222 [2024-11-18 16:15:58.783816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:35.222 [2024-11-18 16:15:58.783836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:35.222 [2024-11-18 16:15:58.783863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:35.222 [2024-11-18 16:15:58.783882] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:35.222 [2024-11-18 16:15:58.784316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf540b0 (9): Bad file descriptor 00:29:35.222 [2024-11-18 16:15:58.784360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:35.222 [2024-11-18 16:15:58.784399] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:35.222 [2024-11-18 16:15:58.784442] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:35.222 [2024-11-18 16:15:58.784466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:35.222 [2024-11-18 16:15:58.784487] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:35.222 [2024-11-18 16:15:58.784503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:35.222 [2024-11-18 16:15:58.784519] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:35.222 [2024-11-18 16:15:58.784534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:35.222 [2024-11-18 16:15:58.784550] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:35.222 [2024-11-18 16:15:58.784565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:35.222 [2024-11-18 16:15:58.784581] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:35.222 [2024-11-18 16:15:58.784596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:35.222 [2024-11-18 16:15:58.784628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:35.222 [2024-11-18 16:15:58.784815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf544c0 (9): Bad file descriptor 00:29:35.222 [2024-11-18 16:15:58.785837] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:35.222 [2024-11-18 16:15:58.785863] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:35.222 16:15:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.222 16:15:58 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:35.222 16:15:58 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:36.660 16:15:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:36.660 16:15:59 -- common/autotest_common.sh@10 -- # set +x 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:36.660 16:15:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:36.660 16:15:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:36.660 16:15:59 -- common/autotest_common.sh@10 -- # set +x 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:36.660 16:15:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:36.660 16:15:59 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:37.226 [2024-11-18 16:16:00.802053] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:37.226 [2024-11-18 16:16:00.802081] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:37.226 [2024-11-18 16:16:00.802103] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:37.484 16:16:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:37.484 16:16:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:37.484 16:16:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:37.484 16:16:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.484 16:16:00 -- common/autotest_common.sh@10 -- # set +x 00:29:37.484 16:16:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:37.484 16:16:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:37.484 16:16:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.484 [2024-11-18 16:16:00.929514] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:37.484 16:16:00 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:37.484 16:16:00 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:37.742 [2024-11-18 16:16:01.154992] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:37.742 [2024-11-18 16:16:01.155047] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:37.742 [2024-11-18 16:16:01.155085] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:37.742 [2024-11-18 16:16:01.155109] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:37.742 [2024-11-18 16:16:01.155124] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:37.742 [2024-11-18 16:16:01.161151] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xf62ac0 was disconnected and freed. delete nvme_qpair. 00:29:38.675 16:16:01 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:38.675 16:16:01 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:38.675 16:16:01 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:38.675 16:16:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.675 16:16:01 -- common/autotest_common.sh@10 -- # set +x 00:29:38.675 16:16:01 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:38.675 16:16:01 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:38.675 16:16:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.675 16:16:02 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:38.675 16:16:02 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:38.675 16:16:02 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1703073 00:29:38.675 16:16:02 -- common/autotest_common.sh@936 -- # '[' -z 1703073 ']' 00:29:38.675 16:16:02 -- common/autotest_common.sh@940 -- # kill -0 1703073 00:29:38.675 16:16:02 -- common/autotest_common.sh@941 -- # uname 00:29:38.675 16:16:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:38.675 16:16:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1703073 00:29:38.675 16:16:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:38.675 16:16:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:38.675 16:16:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1703073' 00:29:38.675 killing process with pid 1703073 00:29:38.675 16:16:02 -- common/autotest_common.sh@955 -- # kill 1703073 00:29:38.675 16:16:02 -- common/autotest_common.sh@960 -- # wait 1703073 00:29:38.675 16:16:02 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:38.675 16:16:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:38.675 16:16:02 -- nvmf/common.sh@116 -- # sync 00:29:38.675 16:16:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:38.675 16:16:02 -- nvmf/common.sh@119 -- # set +e 00:29:38.675 16:16:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:38.675 16:16:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:38.676 rmmod nvme_tcp 00:29:38.676 rmmod nvme_fabrics 00:29:38.934 rmmod nvme_keyring 00:29:38.934 16:16:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:38.934 16:16:02 -- nvmf/common.sh@123 -- # set -e 00:29:38.934 16:16:02 -- nvmf/common.sh@124 -- # return 0 00:29:38.934 16:16:02 -- nvmf/common.sh@477 -- # '[' -n 1702921 ']' 00:29:38.934 16:16:02 -- nvmf/common.sh@478 -- # killprocess 1702921 00:29:38.934 16:16:02 -- common/autotest_common.sh@936 -- # '[' -z 1702921 ']' 00:29:38.934 16:16:02 -- common/autotest_common.sh@940 -- # kill -0 1702921 00:29:38.934 16:16:02 -- common/autotest_common.sh@941 -- # uname 00:29:38.934 16:16:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:38.934 16:16:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1702921 00:29:38.934 16:16:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:38.934 16:16:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:38.934 16:16:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1702921' 00:29:38.934 killing process with pid 1702921 00:29:38.934 16:16:02 -- common/autotest_common.sh@955 -- # kill 1702921 00:29:38.934 16:16:02 -- common/autotest_common.sh@960 -- # wait 1702921 00:29:39.192 16:16:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:39.192 16:16:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:39.192 16:16:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:39.192 16:16:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:39.192 16:16:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:39.192 16:16:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:39.192 16:16:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:39.192 16:16:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:41.093 16:16:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:41.093 00:29:41.093 real 0m18.494s 00:29:41.093 user 0m25.691s 00:29:41.093 sys 0m2.911s 00:29:41.093 16:16:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:41.093 16:16:04 -- common/autotest_common.sh@10 -- # set +x 00:29:41.093 ************************************ 00:29:41.093 END TEST nvmf_discovery_remove_ifc 00:29:41.093 ************************************ 00:29:41.093 16:16:04 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:41.093 16:16:04 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:41.093 16:16:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:41.093 16:16:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:41.093 16:16:04 -- common/autotest_common.sh@10 -- # set +x 00:29:41.093 ************************************ 00:29:41.093 START TEST nvmf_digest 00:29:41.093 ************************************ 00:29:41.093 16:16:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:41.093 * Looking for test storage... 00:29:41.093 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:41.093 16:16:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:41.093 16:16:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:41.093 16:16:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:41.353 16:16:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:41.353 16:16:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:41.353 16:16:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:41.353 16:16:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:41.353 16:16:04 -- scripts/common.sh@335 -- # IFS=.-: 00:29:41.353 16:16:04 -- scripts/common.sh@335 -- # read -ra ver1 00:29:41.353 16:16:04 -- scripts/common.sh@336 -- # IFS=.-: 00:29:41.353 16:16:04 -- scripts/common.sh@336 -- # read -ra ver2 00:29:41.353 16:16:04 -- scripts/common.sh@337 -- # local 'op=<' 00:29:41.353 16:16:04 -- scripts/common.sh@339 -- # ver1_l=2 00:29:41.353 16:16:04 -- scripts/common.sh@340 -- # ver2_l=1 00:29:41.353 16:16:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:41.353 16:16:04 -- scripts/common.sh@343 -- # case "$op" in 00:29:41.353 16:16:04 -- scripts/common.sh@344 -- # : 1 00:29:41.353 16:16:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:41.353 16:16:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:41.353 16:16:04 -- scripts/common.sh@364 -- # decimal 1 00:29:41.353 16:16:04 -- scripts/common.sh@352 -- # local d=1 00:29:41.353 16:16:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:41.353 16:16:04 -- scripts/common.sh@354 -- # echo 1 00:29:41.353 16:16:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:41.353 16:16:04 -- scripts/common.sh@365 -- # decimal 2 00:29:41.353 16:16:04 -- scripts/common.sh@352 -- # local d=2 00:29:41.353 16:16:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:41.353 16:16:04 -- scripts/common.sh@354 -- # echo 2 00:29:41.353 16:16:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:41.353 16:16:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:41.353 16:16:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:41.353 16:16:04 -- scripts/common.sh@367 -- # return 0 00:29:41.353 16:16:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:41.353 16:16:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:41.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:41.353 --rc genhtml_branch_coverage=1 00:29:41.353 --rc genhtml_function_coverage=1 00:29:41.353 --rc genhtml_legend=1 00:29:41.353 --rc geninfo_all_blocks=1 00:29:41.353 --rc geninfo_unexecuted_blocks=1 00:29:41.353 00:29:41.353 ' 00:29:41.353 16:16:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:41.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:41.353 --rc genhtml_branch_coverage=1 00:29:41.353 --rc genhtml_function_coverage=1 00:29:41.353 --rc genhtml_legend=1 00:29:41.353 --rc geninfo_all_blocks=1 00:29:41.353 --rc geninfo_unexecuted_blocks=1 00:29:41.353 00:29:41.353 ' 00:29:41.353 16:16:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:41.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:41.353 --rc genhtml_branch_coverage=1 00:29:41.353 --rc genhtml_function_coverage=1 00:29:41.353 --rc genhtml_legend=1 00:29:41.353 --rc geninfo_all_blocks=1 00:29:41.353 --rc geninfo_unexecuted_blocks=1 00:29:41.353 00:29:41.353 ' 00:29:41.353 16:16:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:41.353 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:41.353 --rc genhtml_branch_coverage=1 00:29:41.353 --rc genhtml_function_coverage=1 00:29:41.353 --rc genhtml_legend=1 00:29:41.353 --rc geninfo_all_blocks=1 00:29:41.353 --rc geninfo_unexecuted_blocks=1 00:29:41.353 00:29:41.353 ' 00:29:41.353 16:16:04 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:41.353 16:16:04 -- nvmf/common.sh@7 -- # uname -s 00:29:41.353 16:16:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:41.353 16:16:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:41.353 16:16:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:41.353 16:16:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:41.353 16:16:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:41.353 16:16:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:41.353 16:16:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:41.353 16:16:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:41.353 16:16:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:41.353 16:16:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:41.353 16:16:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:41.353 16:16:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:41.353 16:16:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:41.353 16:16:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:41.353 16:16:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:41.353 16:16:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:41.353 16:16:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:41.353 16:16:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:41.353 16:16:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:41.353 16:16:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:41.353 16:16:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:41.353 16:16:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:41.353 16:16:04 -- paths/export.sh@5 -- # export PATH 00:29:41.353 16:16:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:41.353 16:16:04 -- nvmf/common.sh@46 -- # : 0 00:29:41.353 16:16:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:41.353 16:16:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:41.353 16:16:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:41.353 16:16:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:41.353 16:16:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:41.353 16:16:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:41.353 16:16:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:41.353 16:16:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:41.353 16:16:04 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:41.353 16:16:04 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:41.353 16:16:04 -- host/digest.sh@16 -- # runtime=2 00:29:41.353 16:16:04 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:41.353 16:16:04 -- host/digest.sh@132 -- # nvmftestinit 00:29:41.353 16:16:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:41.353 16:16:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:41.353 16:16:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:41.353 16:16:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:41.353 16:16:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:41.353 16:16:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:41.353 16:16:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:41.353 16:16:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:41.353 16:16:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:41.353 16:16:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:41.353 16:16:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:41.353 16:16:04 -- common/autotest_common.sh@10 -- # set +x 00:29:43.254 16:16:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:43.254 16:16:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:43.254 16:16:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:43.254 16:16:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:43.255 16:16:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:43.255 16:16:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:43.255 16:16:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:43.255 16:16:06 -- nvmf/common.sh@294 -- # net_devs=() 00:29:43.255 16:16:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:43.255 16:16:06 -- nvmf/common.sh@295 -- # e810=() 00:29:43.255 16:16:06 -- nvmf/common.sh@295 -- # local -ga e810 00:29:43.255 16:16:06 -- nvmf/common.sh@296 -- # x722=() 00:29:43.255 16:16:06 -- nvmf/common.sh@296 -- # local -ga x722 00:29:43.255 16:16:06 -- nvmf/common.sh@297 -- # mlx=() 00:29:43.255 16:16:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:43.255 16:16:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:43.255 16:16:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:43.255 16:16:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:43.255 16:16:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:43.255 16:16:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:43.255 16:16:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:43.255 16:16:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:43.255 16:16:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:43.255 16:16:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:43.255 16:16:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:43.255 16:16:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:43.255 16:16:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:43.255 16:16:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:43.255 16:16:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:43.255 16:16:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:43.255 16:16:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:43.255 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:43.255 16:16:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:43.255 16:16:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:43.255 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:43.255 16:16:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:43.255 16:16:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:43.255 16:16:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:43.255 16:16:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:43.255 16:16:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:43.255 16:16:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:43.255 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:43.255 16:16:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:43.255 16:16:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:43.255 16:16:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:43.255 16:16:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:43.255 16:16:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:43.255 16:16:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:43.255 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:43.255 16:16:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:43.255 16:16:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:43.255 16:16:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:43.255 16:16:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:43.255 16:16:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:43.255 16:16:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:43.255 16:16:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:43.255 16:16:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:43.255 16:16:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:43.255 16:16:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:43.255 16:16:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:43.255 16:16:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:43.255 16:16:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:43.255 16:16:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:43.255 16:16:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:43.255 16:16:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:43.255 16:16:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:43.255 16:16:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:43.255 16:16:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:43.255 16:16:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:43.255 16:16:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:43.255 16:16:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:43.255 16:16:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:43.255 16:16:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:43.255 16:16:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:43.255 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:43.255 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.264 ms 00:29:43.255 00:29:43.255 --- 10.0.0.2 ping statistics --- 00:29:43.255 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:43.255 rtt min/avg/max/mdev = 0.264/0.264/0.264/0.000 ms 00:29:43.255 16:16:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:43.255 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:43.255 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:29:43.255 00:29:43.255 --- 10.0.0.1 ping statistics --- 00:29:43.255 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:43.255 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:29:43.255 16:16:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:43.255 16:16:06 -- nvmf/common.sh@410 -- # return 0 00:29:43.255 16:16:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:43.255 16:16:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:43.255 16:16:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:43.256 16:16:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:43.256 16:16:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:43.256 16:16:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:43.256 16:16:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:43.256 16:16:06 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:43.256 16:16:06 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:43.256 16:16:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:43.256 16:16:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:43.256 16:16:06 -- common/autotest_common.sh@10 -- # set +x 00:29:43.256 ************************************ 00:29:43.256 START TEST nvmf_digest_clean 00:29:43.256 ************************************ 00:29:43.256 16:16:06 -- common/autotest_common.sh@1114 -- # run_digest 00:29:43.256 16:16:06 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:43.256 16:16:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:43.256 16:16:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:43.256 16:16:06 -- common/autotest_common.sh@10 -- # set +x 00:29:43.256 16:16:06 -- nvmf/common.sh@469 -- # nvmfpid=1706606 00:29:43.256 16:16:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:43.256 16:16:06 -- nvmf/common.sh@470 -- # waitforlisten 1706606 00:29:43.256 16:16:06 -- common/autotest_common.sh@829 -- # '[' -z 1706606 ']' 00:29:43.256 16:16:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:43.256 16:16:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:43.256 16:16:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:43.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:43.256 16:16:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:43.256 16:16:06 -- common/autotest_common.sh@10 -- # set +x 00:29:43.514 [2024-11-18 16:16:06.888219] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:43.514 [2024-11-18 16:16:06.888299] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:43.514 EAL: No free 2048 kB hugepages reported on node 1 00:29:43.514 [2024-11-18 16:16:06.957644] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:43.514 [2024-11-18 16:16:07.050213] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:43.514 [2024-11-18 16:16:07.050376] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:43.514 [2024-11-18 16:16:07.050398] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:43.514 [2024-11-18 16:16:07.050412] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:43.514 [2024-11-18 16:16:07.050442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:43.771 16:16:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:43.771 16:16:07 -- common/autotest_common.sh@862 -- # return 0 00:29:43.771 16:16:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:43.771 16:16:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:43.771 16:16:07 -- common/autotest_common.sh@10 -- # set +x 00:29:43.771 16:16:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:43.771 16:16:07 -- host/digest.sh@120 -- # common_target_config 00:29:43.771 16:16:07 -- host/digest.sh@43 -- # rpc_cmd 00:29:43.771 16:16:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:43.771 16:16:07 -- common/autotest_common.sh@10 -- # set +x 00:29:43.771 null0 00:29:43.771 [2024-11-18 16:16:07.238737] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:43.771 [2024-11-18 16:16:07.262980] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:43.771 16:16:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:43.771 16:16:07 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:43.771 16:16:07 -- host/digest.sh@77 -- # local rw bs qd 00:29:43.771 16:16:07 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:43.771 16:16:07 -- host/digest.sh@80 -- # rw=randread 00:29:43.771 16:16:07 -- host/digest.sh@80 -- # bs=4096 00:29:43.771 16:16:07 -- host/digest.sh@80 -- # qd=128 00:29:43.771 16:16:07 -- host/digest.sh@82 -- # bperfpid=1706751 00:29:43.771 16:16:07 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:43.771 16:16:07 -- host/digest.sh@83 -- # waitforlisten 1706751 /var/tmp/bperf.sock 00:29:43.771 16:16:07 -- common/autotest_common.sh@829 -- # '[' -z 1706751 ']' 00:29:43.771 16:16:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:43.771 16:16:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:43.771 16:16:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:43.771 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:43.771 16:16:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:43.771 16:16:07 -- common/autotest_common.sh@10 -- # set +x 00:29:43.771 [2024-11-18 16:16:07.303577] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:43.771 [2024-11-18 16:16:07.303673] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1706751 ] 00:29:43.771 EAL: No free 2048 kB hugepages reported on node 1 00:29:44.043 [2024-11-18 16:16:07.362062] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:44.043 [2024-11-18 16:16:07.446321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:44.043 16:16:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:44.043 16:16:07 -- common/autotest_common.sh@862 -- # return 0 00:29:44.043 16:16:07 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:44.043 16:16:07 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:44.043 16:16:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:44.301 16:16:07 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:44.301 16:16:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:44.866 nvme0n1 00:29:44.866 16:16:08 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:44.866 16:16:08 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:44.866 Running I/O for 2 seconds... 00:29:47.395 00:29:47.395 Latency(us) 00:29:47.395 [2024-11-18T15:16:10.986Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:47.395 [2024-11-18T15:16:10.986Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:47.395 nvme0n1 : 2.00 16382.15 63.99 0.00 0.00 7804.37 2924.85 24078.41 00:29:47.395 [2024-11-18T15:16:10.986Z] =================================================================================================================== 00:29:47.395 [2024-11-18T15:16:10.986Z] Total : 16382.15 63.99 0.00 0.00 7804.37 2924.85 24078.41 00:29:47.395 0 00:29:47.395 16:16:10 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:47.395 16:16:10 -- host/digest.sh@92 -- # get_accel_stats 00:29:47.395 16:16:10 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:47.395 16:16:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:47.395 16:16:10 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:47.395 | select(.opcode=="crc32c") 00:29:47.395 | "\(.module_name) \(.executed)"' 00:29:47.395 16:16:10 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:47.395 16:16:10 -- host/digest.sh@93 -- # exp_module=software 00:29:47.395 16:16:10 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:47.395 16:16:10 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:47.395 16:16:10 -- host/digest.sh@97 -- # killprocess 1706751 00:29:47.395 16:16:10 -- common/autotest_common.sh@936 -- # '[' -z 1706751 ']' 00:29:47.395 16:16:10 -- common/autotest_common.sh@940 -- # kill -0 1706751 00:29:47.395 16:16:10 -- common/autotest_common.sh@941 -- # uname 00:29:47.395 16:16:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:47.395 16:16:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1706751 00:29:47.395 16:16:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:47.395 16:16:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:47.395 16:16:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1706751' 00:29:47.395 killing process with pid 1706751 00:29:47.395 16:16:10 -- common/autotest_common.sh@955 -- # kill 1706751 00:29:47.395 Received shutdown signal, test time was about 2.000000 seconds 00:29:47.395 00:29:47.395 Latency(us) 00:29:47.395 [2024-11-18T15:16:10.986Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:47.395 [2024-11-18T15:16:10.986Z] =================================================================================================================== 00:29:47.395 [2024-11-18T15:16:10.986Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:47.395 16:16:10 -- common/autotest_common.sh@960 -- # wait 1706751 00:29:47.653 16:16:11 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:47.653 16:16:11 -- host/digest.sh@77 -- # local rw bs qd 00:29:47.653 16:16:11 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:47.653 16:16:11 -- host/digest.sh@80 -- # rw=randread 00:29:47.653 16:16:11 -- host/digest.sh@80 -- # bs=131072 00:29:47.653 16:16:11 -- host/digest.sh@80 -- # qd=16 00:29:47.653 16:16:11 -- host/digest.sh@82 -- # bperfpid=1707173 00:29:47.653 16:16:11 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:47.653 16:16:11 -- host/digest.sh@83 -- # waitforlisten 1707173 /var/tmp/bperf.sock 00:29:47.653 16:16:11 -- common/autotest_common.sh@829 -- # '[' -z 1707173 ']' 00:29:47.653 16:16:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:47.653 16:16:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:47.653 16:16:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:47.653 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:47.653 16:16:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:47.653 16:16:11 -- common/autotest_common.sh@10 -- # set +x 00:29:47.653 [2024-11-18 16:16:11.048372] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:47.653 [2024-11-18 16:16:11.048452] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1707173 ] 00:29:47.653 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:47.653 Zero copy mechanism will not be used. 00:29:47.653 EAL: No free 2048 kB hugepages reported on node 1 00:29:47.653 [2024-11-18 16:16:11.105875] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:47.653 [2024-11-18 16:16:11.188719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:47.911 16:16:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:47.911 16:16:11 -- common/autotest_common.sh@862 -- # return 0 00:29:47.912 16:16:11 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:47.912 16:16:11 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:47.912 16:16:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:48.170 16:16:11 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:48.170 16:16:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:48.428 nvme0n1 00:29:48.428 16:16:11 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:48.428 16:16:11 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:48.686 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:48.686 Zero copy mechanism will not be used. 00:29:48.686 Running I/O for 2 seconds... 00:29:50.585 00:29:50.585 Latency(us) 00:29:50.585 [2024-11-18T15:16:14.176Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:50.585 [2024-11-18T15:16:14.176Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:50.585 nvme0n1 : 2.04 5593.09 699.14 0.00 0.00 2803.00 861.68 43496.49 00:29:50.585 [2024-11-18T15:16:14.176Z] =================================================================================================================== 00:29:50.585 [2024-11-18T15:16:14.176Z] Total : 5593.09 699.14 0.00 0.00 2803.00 861.68 43496.49 00:29:50.585 0 00:29:50.585 16:16:14 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:50.585 16:16:14 -- host/digest.sh@92 -- # get_accel_stats 00:29:50.585 16:16:14 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:50.585 16:16:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:50.585 16:16:14 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:50.585 | select(.opcode=="crc32c") 00:29:50.585 | "\(.module_name) \(.executed)"' 00:29:50.843 16:16:14 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:50.843 16:16:14 -- host/digest.sh@93 -- # exp_module=software 00:29:50.843 16:16:14 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:50.843 16:16:14 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:50.843 16:16:14 -- host/digest.sh@97 -- # killprocess 1707173 00:29:50.843 16:16:14 -- common/autotest_common.sh@936 -- # '[' -z 1707173 ']' 00:29:50.843 16:16:14 -- common/autotest_common.sh@940 -- # kill -0 1707173 00:29:50.843 16:16:14 -- common/autotest_common.sh@941 -- # uname 00:29:50.843 16:16:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:50.843 16:16:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1707173 00:29:50.843 16:16:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:50.843 16:16:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:50.843 16:16:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1707173' 00:29:50.843 killing process with pid 1707173 00:29:50.843 16:16:14 -- common/autotest_common.sh@955 -- # kill 1707173 00:29:50.843 Received shutdown signal, test time was about 2.000000 seconds 00:29:50.843 00:29:50.843 Latency(us) 00:29:50.843 [2024-11-18T15:16:14.434Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:50.843 [2024-11-18T15:16:14.435Z] =================================================================================================================== 00:29:50.844 [2024-11-18T15:16:14.435Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:50.844 16:16:14 -- common/autotest_common.sh@960 -- # wait 1707173 00:29:51.102 16:16:14 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:51.102 16:16:14 -- host/digest.sh@77 -- # local rw bs qd 00:29:51.102 16:16:14 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:51.102 16:16:14 -- host/digest.sh@80 -- # rw=randwrite 00:29:51.102 16:16:14 -- host/digest.sh@80 -- # bs=4096 00:29:51.102 16:16:14 -- host/digest.sh@80 -- # qd=128 00:29:51.102 16:16:14 -- host/digest.sh@82 -- # bperfpid=1707585 00:29:51.102 16:16:14 -- host/digest.sh@83 -- # waitforlisten 1707585 /var/tmp/bperf.sock 00:29:51.102 16:16:14 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:51.102 16:16:14 -- common/autotest_common.sh@829 -- # '[' -z 1707585 ']' 00:29:51.102 16:16:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:51.102 16:16:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:51.102 16:16:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:51.102 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:51.102 16:16:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:51.102 16:16:14 -- common/autotest_common.sh@10 -- # set +x 00:29:51.360 [2024-11-18 16:16:14.692969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:51.360 [2024-11-18 16:16:14.693047] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1707585 ] 00:29:51.360 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.360 [2024-11-18 16:16:14.755095] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:51.360 [2024-11-18 16:16:14.843032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:51.360 16:16:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:51.360 16:16:14 -- common/autotest_common.sh@862 -- # return 0 00:29:51.360 16:16:14 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:51.360 16:16:14 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:51.360 16:16:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:51.926 16:16:15 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:51.926 16:16:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:52.187 nvme0n1 00:29:52.187 16:16:15 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:52.187 16:16:15 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:52.187 Running I/O for 2 seconds... 00:29:54.718 00:29:54.718 Latency(us) 00:29:54.718 [2024-11-18T15:16:18.309Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:54.718 [2024-11-18T15:16:18.309Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:54.718 nvme0n1 : 2.01 21065.49 82.29 0.00 0.00 6068.94 2609.30 13398.47 00:29:54.718 [2024-11-18T15:16:18.309Z] =================================================================================================================== 00:29:54.718 [2024-11-18T15:16:18.309Z] Total : 21065.49 82.29 0.00 0.00 6068.94 2609.30 13398.47 00:29:54.718 0 00:29:54.718 16:16:17 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:54.718 16:16:17 -- host/digest.sh@92 -- # get_accel_stats 00:29:54.718 16:16:17 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:54.718 16:16:17 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:54.718 | select(.opcode=="crc32c") 00:29:54.718 | "\(.module_name) \(.executed)"' 00:29:54.718 16:16:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:54.718 16:16:18 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:54.718 16:16:18 -- host/digest.sh@93 -- # exp_module=software 00:29:54.718 16:16:18 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:54.718 16:16:18 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:54.718 16:16:18 -- host/digest.sh@97 -- # killprocess 1707585 00:29:54.718 16:16:18 -- common/autotest_common.sh@936 -- # '[' -z 1707585 ']' 00:29:54.718 16:16:18 -- common/autotest_common.sh@940 -- # kill -0 1707585 00:29:54.718 16:16:18 -- common/autotest_common.sh@941 -- # uname 00:29:54.718 16:16:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:54.718 16:16:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1707585 00:29:54.718 16:16:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:54.718 16:16:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:54.718 16:16:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1707585' 00:29:54.718 killing process with pid 1707585 00:29:54.718 16:16:18 -- common/autotest_common.sh@955 -- # kill 1707585 00:29:54.718 Received shutdown signal, test time was about 2.000000 seconds 00:29:54.718 00:29:54.718 Latency(us) 00:29:54.718 [2024-11-18T15:16:18.309Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:54.718 [2024-11-18T15:16:18.309Z] =================================================================================================================== 00:29:54.718 [2024-11-18T15:16:18.309Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:54.718 16:16:18 -- common/autotest_common.sh@960 -- # wait 1707585 00:29:54.718 16:16:18 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:54.718 16:16:18 -- host/digest.sh@77 -- # local rw bs qd 00:29:54.718 16:16:18 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:54.718 16:16:18 -- host/digest.sh@80 -- # rw=randwrite 00:29:54.718 16:16:18 -- host/digest.sh@80 -- # bs=131072 00:29:54.718 16:16:18 -- host/digest.sh@80 -- # qd=16 00:29:54.718 16:16:18 -- host/digest.sh@82 -- # bperfpid=1708032 00:29:54.718 16:16:18 -- host/digest.sh@83 -- # waitforlisten 1708032 /var/tmp/bperf.sock 00:29:54.718 16:16:18 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:54.718 16:16:18 -- common/autotest_common.sh@829 -- # '[' -z 1708032 ']' 00:29:54.718 16:16:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:54.718 16:16:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:54.718 16:16:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:54.718 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:54.718 16:16:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:54.718 16:16:18 -- common/autotest_common.sh@10 -- # set +x 00:29:54.977 [2024-11-18 16:16:18.345531] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:54.977 [2024-11-18 16:16:18.345630] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1708032 ] 00:29:54.977 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:54.977 Zero copy mechanism will not be used. 00:29:54.977 EAL: No free 2048 kB hugepages reported on node 1 00:29:54.977 [2024-11-18 16:16:18.406713] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:54.977 [2024-11-18 16:16:18.495306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:55.235 16:16:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:55.235 16:16:18 -- common/autotest_common.sh@862 -- # return 0 00:29:55.235 16:16:18 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:55.235 16:16:18 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:55.235 16:16:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:55.493 16:16:18 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:55.493 16:16:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:56.060 nvme0n1 00:29:56.060 16:16:19 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:56.060 16:16:19 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:56.060 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:56.060 Zero copy mechanism will not be used. 00:29:56.060 Running I/O for 2 seconds... 00:29:58.588 00:29:58.588 Latency(us) 00:29:58.588 [2024-11-18T15:16:22.179Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:58.588 [2024-11-18T15:16:22.179Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:58.588 nvme0n1 : 2.00 6472.12 809.01 0.00 0.00 2465.21 1881.13 7670.14 00:29:58.588 [2024-11-18T15:16:22.179Z] =================================================================================================================== 00:29:58.588 [2024-11-18T15:16:22.179Z] Total : 6472.12 809.01 0.00 0.00 2465.21 1881.13 7670.14 00:29:58.588 0 00:29:58.588 16:16:21 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:58.588 16:16:21 -- host/digest.sh@92 -- # get_accel_stats 00:29:58.588 16:16:21 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:58.588 16:16:21 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:58.588 | select(.opcode=="crc32c") 00:29:58.588 | "\(.module_name) \(.executed)"' 00:29:58.588 16:16:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:58.588 16:16:21 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:58.588 16:16:21 -- host/digest.sh@93 -- # exp_module=software 00:29:58.588 16:16:21 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:58.588 16:16:21 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:58.588 16:16:21 -- host/digest.sh@97 -- # killprocess 1708032 00:29:58.588 16:16:21 -- common/autotest_common.sh@936 -- # '[' -z 1708032 ']' 00:29:58.588 16:16:21 -- common/autotest_common.sh@940 -- # kill -0 1708032 00:29:58.588 16:16:21 -- common/autotest_common.sh@941 -- # uname 00:29:58.588 16:16:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:58.588 16:16:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1708032 00:29:58.588 16:16:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:58.588 16:16:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:58.588 16:16:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1708032' 00:29:58.588 killing process with pid 1708032 00:29:58.588 16:16:21 -- common/autotest_common.sh@955 -- # kill 1708032 00:29:58.588 Received shutdown signal, test time was about 2.000000 seconds 00:29:58.588 00:29:58.588 Latency(us) 00:29:58.588 [2024-11-18T15:16:22.179Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:58.588 [2024-11-18T15:16:22.179Z] =================================================================================================================== 00:29:58.588 [2024-11-18T15:16:22.179Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:58.588 16:16:21 -- common/autotest_common.sh@960 -- # wait 1708032 00:29:58.846 16:16:22 -- host/digest.sh@126 -- # killprocess 1706606 00:29:58.846 16:16:22 -- common/autotest_common.sh@936 -- # '[' -z 1706606 ']' 00:29:58.846 16:16:22 -- common/autotest_common.sh@940 -- # kill -0 1706606 00:29:58.846 16:16:22 -- common/autotest_common.sh@941 -- # uname 00:29:58.846 16:16:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:58.846 16:16:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1706606 00:29:58.846 16:16:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:58.846 16:16:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:58.846 16:16:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1706606' 00:29:58.846 killing process with pid 1706606 00:29:58.846 16:16:22 -- common/autotest_common.sh@955 -- # kill 1706606 00:29:58.846 16:16:22 -- common/autotest_common.sh@960 -- # wait 1706606 00:29:59.104 00:29:59.104 real 0m15.640s 00:29:59.104 user 0m31.240s 00:29:59.104 sys 0m4.361s 00:29:59.104 16:16:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:59.104 16:16:22 -- common/autotest_common.sh@10 -- # set +x 00:29:59.104 ************************************ 00:29:59.104 END TEST nvmf_digest_clean 00:29:59.104 ************************************ 00:29:59.104 16:16:22 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:59.104 16:16:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:59.104 16:16:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:59.104 16:16:22 -- common/autotest_common.sh@10 -- # set +x 00:29:59.104 ************************************ 00:29:59.104 START TEST nvmf_digest_error 00:29:59.104 ************************************ 00:29:59.104 16:16:22 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:59.104 16:16:22 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:59.104 16:16:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:59.104 16:16:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:59.104 16:16:22 -- common/autotest_common.sh@10 -- # set +x 00:29:59.104 16:16:22 -- nvmf/common.sh@469 -- # nvmfpid=1708582 00:29:59.104 16:16:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:59.104 16:16:22 -- nvmf/common.sh@470 -- # waitforlisten 1708582 00:29:59.104 16:16:22 -- common/autotest_common.sh@829 -- # '[' -z 1708582 ']' 00:29:59.104 16:16:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:59.104 16:16:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:59.104 16:16:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:59.104 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:59.104 16:16:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:59.104 16:16:22 -- common/autotest_common.sh@10 -- # set +x 00:29:59.104 [2024-11-18 16:16:22.556730] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:59.104 [2024-11-18 16:16:22.556828] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:59.104 EAL: No free 2048 kB hugepages reported on node 1 00:29:59.104 [2024-11-18 16:16:22.620443] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:59.363 [2024-11-18 16:16:22.705096] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:59.363 [2024-11-18 16:16:22.705238] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:59.363 [2024-11-18 16:16:22.705256] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:59.363 [2024-11-18 16:16:22.705267] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:59.363 [2024-11-18 16:16:22.705292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:59.363 16:16:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:59.363 16:16:22 -- common/autotest_common.sh@862 -- # return 0 00:29:59.363 16:16:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:59.363 16:16:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:59.363 16:16:22 -- common/autotest_common.sh@10 -- # set +x 00:29:59.363 16:16:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:59.363 16:16:22 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:59.363 16:16:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:59.363 16:16:22 -- common/autotest_common.sh@10 -- # set +x 00:29:59.363 [2024-11-18 16:16:22.797925] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:59.363 16:16:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:59.363 16:16:22 -- host/digest.sh@104 -- # common_target_config 00:29:59.363 16:16:22 -- host/digest.sh@43 -- # rpc_cmd 00:29:59.363 16:16:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:59.363 16:16:22 -- common/autotest_common.sh@10 -- # set +x 00:29:59.363 null0 00:29:59.363 [2024-11-18 16:16:22.912768] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:59.363 [2024-11-18 16:16:22.936994] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:59.363 16:16:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:59.363 16:16:22 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:59.363 16:16:22 -- host/digest.sh@54 -- # local rw bs qd 00:29:59.363 16:16:22 -- host/digest.sh@56 -- # rw=randread 00:29:59.363 16:16:22 -- host/digest.sh@56 -- # bs=4096 00:29:59.363 16:16:22 -- host/digest.sh@56 -- # qd=128 00:29:59.363 16:16:22 -- host/digest.sh@58 -- # bperfpid=1708726 00:29:59.363 16:16:22 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:59.363 16:16:22 -- host/digest.sh@60 -- # waitforlisten 1708726 /var/tmp/bperf.sock 00:29:59.363 16:16:22 -- common/autotest_common.sh@829 -- # '[' -z 1708726 ']' 00:29:59.363 16:16:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:59.363 16:16:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:59.363 16:16:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:59.363 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:59.363 16:16:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:59.363 16:16:22 -- common/autotest_common.sh@10 -- # set +x 00:29:59.621 [2024-11-18 16:16:22.982385] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:59.621 [2024-11-18 16:16:22.982462] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1708726 ] 00:29:59.621 EAL: No free 2048 kB hugepages reported on node 1 00:29:59.621 [2024-11-18 16:16:23.043189] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:59.621 [2024-11-18 16:16:23.132419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:00.554 16:16:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:00.554 16:16:23 -- common/autotest_common.sh@862 -- # return 0 00:30:00.555 16:16:23 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:00.555 16:16:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:00.812 16:16:24 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:00.812 16:16:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.812 16:16:24 -- common/autotest_common.sh@10 -- # set +x 00:30:00.813 16:16:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.813 16:16:24 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:00.813 16:16:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:01.379 nvme0n1 00:30:01.379 16:16:24 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:01.379 16:16:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.379 16:16:24 -- common/autotest_common.sh@10 -- # set +x 00:30:01.379 16:16:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.379 16:16:24 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:01.379 16:16:24 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:01.379 Running I/O for 2 seconds... 00:30:01.379 [2024-11-18 16:16:24.840948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.379 [2024-11-18 16:16:24.841003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2941 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.379 [2024-11-18 16:16:24.841025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.379 [2024-11-18 16:16:24.852158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.379 [2024-11-18 16:16:24.852188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:3292 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.379 [2024-11-18 16:16:24.852234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.379 [2024-11-18 16:16:24.867053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.379 [2024-11-18 16:16:24.867086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:12312 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.379 [2024-11-18 16:16:24.867104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.379 [2024-11-18 16:16:24.877605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.379 [2024-11-18 16:16:24.877655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:14805 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.379 [2024-11-18 16:16:24.877672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.379 [2024-11-18 16:16:24.893945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.379 [2024-11-18 16:16:24.893978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:11610 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.379 [2024-11-18 16:16:24.893996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.379 [2024-11-18 16:16:24.909881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.379 [2024-11-18 16:16:24.909925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:9756 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.379 [2024-11-18 16:16:24.909941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.379 [2024-11-18 16:16:24.925091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.379 [2024-11-18 16:16:24.925120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:11876 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.379 [2024-11-18 16:16:24.925153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.379 [2024-11-18 16:16:24.935343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.379 [2024-11-18 16:16:24.935387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:16992 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.379 [2024-11-18 16:16:24.935403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.379 [2024-11-18 16:16:24.949568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.379 [2024-11-18 16:16:24.949596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:6647 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.379 [2024-11-18 16:16:24.949634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.379 [2024-11-18 16:16:24.965296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.379 [2024-11-18 16:16:24.965331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:6866 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.379 [2024-11-18 16:16:24.965350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:24.981453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:24.981490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:3817 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:24.981522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:24.996831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:24.996860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:6919 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:24.996893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.012063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.012091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:15249 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.012121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.027475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.027505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:5366 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.027542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.043035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.043065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:4153 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.043097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.057643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.057675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10971 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.057693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.067698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.067730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11409 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.067747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.083170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.083200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8240 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.083232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.098999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.099028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:7193 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.099060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.115548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.115577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:4506 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.115629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.131155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.131184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:3477 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.131215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.146775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.146804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:3032 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.146836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.162327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.162357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:2427 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.162388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.638 [2024-11-18 16:16:25.178726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.638 [2024-11-18 16:16:25.178755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:5556 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.638 [2024-11-18 16:16:25.178787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.639 [2024-11-18 16:16:25.194292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.639 [2024-11-18 16:16:25.194335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:3943 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.639 [2024-11-18 16:16:25.194352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.639 [2024-11-18 16:16:25.209857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.639 [2024-11-18 16:16:25.209885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:13556 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.639 [2024-11-18 16:16:25.209917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.639 [2024-11-18 16:16:25.223987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.639 [2024-11-18 16:16:25.224018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:20100 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.639 [2024-11-18 16:16:25.224036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.241008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.241036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:14921 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.241075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.254999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.255029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:24835 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.255046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.270289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.270320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:7228 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.270337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.282174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.282208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:25222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.282227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.298428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.298461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16678 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.298481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.315772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.315801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:19860 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.315833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.332604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.332645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:18456 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.332664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.349429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.349462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21510 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.349481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.366437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.366471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:15566 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.366491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.383317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.383351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:17015 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.383370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.400287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.400321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:23201 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.400340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.417201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.417234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22198 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.417253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.434040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.434074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23152 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.434092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.450877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.450904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:11573 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.450918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.467640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.467686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:12187 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.467701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.897 [2024-11-18 16:16:25.484650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:01.897 [2024-11-18 16:16:25.484681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:8570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.897 [2024-11-18 16:16:25.484715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.501712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.501740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:22506 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.501756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.518367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.518402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:23948 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.518427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.535449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.535483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:13951 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.535502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.552150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.552184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:20582 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.552203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.568952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.568986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:12747 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.569005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.585786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.585813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:25446 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.585844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.602857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.602886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:24694 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.602919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.619878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.619920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:8893 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.619936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.636885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.636931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:341 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.636950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.653810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.653837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:9439 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.653868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.670791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.670831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:3670 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.670850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.687595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.687637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:16626 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.687657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.704354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.704390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21110 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.704409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.721749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.721777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:15426 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.721809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.156 [2024-11-18 16:16:25.738777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.156 [2024-11-18 16:16:25.738805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:11943 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.156 [2024-11-18 16:16:25.738834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.756007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.756043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25259 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.756062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.773083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.773117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:2508 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.773136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.789950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.789999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21003 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.790018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.806872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.806900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:1952 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.806916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.823693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.823720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:9400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.823750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.838876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.838909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17065 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.838929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.850054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.850088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:742 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.850106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.867074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.867108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:5416 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.867128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.885093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.885138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:6943 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.885154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.901349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.901383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:3339 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.901402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.917329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.917364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:17838 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.917383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.934367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.934401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3801 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.934420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.951234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.951269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:24338 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.951294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.968438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.968473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:2979 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.968492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.415 [2024-11-18 16:16:25.985367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.415 [2024-11-18 16:16:25.985401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:13678 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.415 [2024-11-18 16:16:25.985419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.416 [2024-11-18 16:16:26.002432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.416 [2024-11-18 16:16:26.002466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:7671 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.416 [2024-11-18 16:16:26.002486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.674 [2024-11-18 16:16:26.019357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.674 [2024-11-18 16:16:26.019391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:10486 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.674 [2024-11-18 16:16:26.019409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.674 [2024-11-18 16:16:26.036150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.674 [2024-11-18 16:16:26.036184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:11727 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.674 [2024-11-18 16:16:26.036203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.674 [2024-11-18 16:16:26.053119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.674 [2024-11-18 16:16:26.053153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:2914 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.674 [2024-11-18 16:16:26.053172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.674 [2024-11-18 16:16:26.069910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.674 [2024-11-18 16:16:26.069954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:7037 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.674 [2024-11-18 16:16:26.069973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.674 [2024-11-18 16:16:26.086750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.674 [2024-11-18 16:16:26.086780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:20061 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.674 [2024-11-18 16:16:26.086812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.674 [2024-11-18 16:16:26.103571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.674 [2024-11-18 16:16:26.103605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:12703 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.674 [2024-11-18 16:16:26.103635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.674 [2024-11-18 16:16:26.120383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.674 [2024-11-18 16:16:26.120418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:24822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.675 [2024-11-18 16:16:26.120437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.675 [2024-11-18 16:16:26.137073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.675 [2024-11-18 16:16:26.137108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25103 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.675 [2024-11-18 16:16:26.137127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.675 [2024-11-18 16:16:26.153709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.675 [2024-11-18 16:16:26.153737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:23563 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.675 [2024-11-18 16:16:26.153767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.675 [2024-11-18 16:16:26.170601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.675 [2024-11-18 16:16:26.170645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12755 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.675 [2024-11-18 16:16:26.170664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.675 [2024-11-18 16:16:26.187545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.675 [2024-11-18 16:16:26.187580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18884 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.675 [2024-11-18 16:16:26.187599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.675 [2024-11-18 16:16:26.204327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.675 [2024-11-18 16:16:26.204361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:3080 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.675 [2024-11-18 16:16:26.204380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.675 [2024-11-18 16:16:26.221460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.675 [2024-11-18 16:16:26.221495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:22516 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.675 [2024-11-18 16:16:26.221514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.675 [2024-11-18 16:16:26.238462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.675 [2024-11-18 16:16:26.238497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:23513 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.675 [2024-11-18 16:16:26.238523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.675 [2024-11-18 16:16:26.255474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.675 [2024-11-18 16:16:26.255509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:23960 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.675 [2024-11-18 16:16:26.255528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.934 [2024-11-18 16:16:26.272287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.934 [2024-11-18 16:16:26.272322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:6509 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.934 [2024-11-18 16:16:26.272342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.934 [2024-11-18 16:16:26.288943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.934 [2024-11-18 16:16:26.288992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:5948 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.934 [2024-11-18 16:16:26.289011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.934 [2024-11-18 16:16:26.299861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.934 [2024-11-18 16:16:26.299893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:17874 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.934 [2024-11-18 16:16:26.299910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.934 [2024-11-18 16:16:26.315096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.934 [2024-11-18 16:16:26.315125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:5743 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.934 [2024-11-18 16:16:26.315155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.934 [2024-11-18 16:16:26.331183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.934 [2024-11-18 16:16:26.331213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16886 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.934 [2024-11-18 16:16:26.331244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.934 [2024-11-18 16:16:26.345960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.934 [2024-11-18 16:16:26.345989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10293 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.934 [2024-11-18 16:16:26.346020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.934 [2024-11-18 16:16:26.361280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.934 [2024-11-18 16:16:26.361309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:13453 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.934 [2024-11-18 16:16:26.361340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.934 [2024-11-18 16:16:26.376861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.934 [2024-11-18 16:16:26.376899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:25203 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.934 [2024-11-18 16:16:26.376931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.934 [2024-11-18 16:16:26.393215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.934 [2024-11-18 16:16:26.393244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20235 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.934 [2024-11-18 16:16:26.393275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.935 [2024-11-18 16:16:26.409140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.935 [2024-11-18 16:16:26.409168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:9315 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.935 [2024-11-18 16:16:26.409198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.935 [2024-11-18 16:16:26.424605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.935 [2024-11-18 16:16:26.424656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:8586 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.935 [2024-11-18 16:16:26.424673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.935 [2024-11-18 16:16:26.439847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.935 [2024-11-18 16:16:26.439878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:18944 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.935 [2024-11-18 16:16:26.439909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.935 [2024-11-18 16:16:26.455251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.935 [2024-11-18 16:16:26.455283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19907 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.935 [2024-11-18 16:16:26.455300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.935 [2024-11-18 16:16:26.470423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.935 [2024-11-18 16:16:26.470451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3706 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.935 [2024-11-18 16:16:26.470480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.935 [2024-11-18 16:16:26.485683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.935 [2024-11-18 16:16:26.485711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:5368 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.935 [2024-11-18 16:16:26.485743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.935 [2024-11-18 16:16:26.500883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.935 [2024-11-18 16:16:26.500925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4514 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.935 [2024-11-18 16:16:26.500941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.935 [2024-11-18 16:16:26.514848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:02.935 [2024-11-18 16:16:26.514879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:17639 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.935 [2024-11-18 16:16:26.514896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.193 [2024-11-18 16:16:26.526385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.526414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6237 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.526432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.542133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.542164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:16311 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.542181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.556961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.556989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:5139 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.557020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.572396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.572424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:10988 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.572455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.587510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.587538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23839 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.587568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.602977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.603005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:20821 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.603036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.618724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.618752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:16448 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.618784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.633955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.633983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:13307 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.634028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.650278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.650309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:9989 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.650326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.664725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.664754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:7699 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.664786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.680113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.680141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:14147 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.680172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.696227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.696256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:5101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.696288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.711736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.711780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:2434 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.711797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.726780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.726809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:9441 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.726840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.742048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.742075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:18026 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.742107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.757682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.757711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:5189 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.757743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.194 [2024-11-18 16:16:26.772993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.194 [2024-11-18 16:16:26.773020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:6968 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.194 [2024-11-18 16:16:26.773051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.452 [2024-11-18 16:16:26.788510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.452 [2024-11-18 16:16:26.788541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:19804 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.452 [2024-11-18 16:16:26.788572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.452 [2024-11-18 16:16:26.803895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.452 [2024-11-18 16:16:26.803937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:11566 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.452 [2024-11-18 16:16:26.803953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.452 [2024-11-18 16:16:26.819261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a57300) 00:30:03.452 [2024-11-18 16:16:26.819289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:17984 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.452 [2024-11-18 16:16:26.819321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.452 00:30:03.452 Latency(us) 00:30:03.452 [2024-11-18T15:16:27.043Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:03.452 [2024-11-18T15:16:27.043Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:30:03.452 nvme0n1 : 2.04 15808.47 61.75 0.00 0.00 7931.50 3495.25 56312.41 00:30:03.452 [2024-11-18T15:16:27.043Z] =================================================================================================================== 00:30:03.452 [2024-11-18T15:16:27.043Z] Total : 15808.47 61.75 0.00 0.00 7931.50 3495.25 56312.41 00:30:03.452 0 00:30:03.452 16:16:26 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:03.452 16:16:26 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:03.452 16:16:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:03.452 16:16:26 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:03.452 | .driver_specific 00:30:03.452 | .nvme_error 00:30:03.452 | .status_code 00:30:03.452 | .command_transient_transport_error' 00:30:03.710 16:16:27 -- host/digest.sh@71 -- # (( 126 > 0 )) 00:30:03.710 16:16:27 -- host/digest.sh@73 -- # killprocess 1708726 00:30:03.710 16:16:27 -- common/autotest_common.sh@936 -- # '[' -z 1708726 ']' 00:30:03.710 16:16:27 -- common/autotest_common.sh@940 -- # kill -0 1708726 00:30:03.710 16:16:27 -- common/autotest_common.sh@941 -- # uname 00:30:03.710 16:16:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:03.711 16:16:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1708726 00:30:03.711 16:16:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:03.711 16:16:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:03.711 16:16:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1708726' 00:30:03.711 killing process with pid 1708726 00:30:03.711 16:16:27 -- common/autotest_common.sh@955 -- # kill 1708726 00:30:03.711 Received shutdown signal, test time was about 2.000000 seconds 00:30:03.711 00:30:03.711 Latency(us) 00:30:03.711 [2024-11-18T15:16:27.302Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:03.711 [2024-11-18T15:16:27.302Z] =================================================================================================================== 00:30:03.711 [2024-11-18T15:16:27.302Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:03.711 16:16:27 -- common/autotest_common.sh@960 -- # wait 1708726 00:30:03.969 16:16:27 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:30:03.969 16:16:27 -- host/digest.sh@54 -- # local rw bs qd 00:30:03.969 16:16:27 -- host/digest.sh@56 -- # rw=randread 00:30:03.969 16:16:27 -- host/digest.sh@56 -- # bs=131072 00:30:03.969 16:16:27 -- host/digest.sh@56 -- # qd=16 00:30:03.969 16:16:27 -- host/digest.sh@58 -- # bperfpid=1709242 00:30:03.969 16:16:27 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:30:03.969 16:16:27 -- host/digest.sh@60 -- # waitforlisten 1709242 /var/tmp/bperf.sock 00:30:03.969 16:16:27 -- common/autotest_common.sh@829 -- # '[' -z 1709242 ']' 00:30:03.969 16:16:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:03.969 16:16:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:03.969 16:16:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:03.969 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:03.969 16:16:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:03.969 16:16:27 -- common/autotest_common.sh@10 -- # set +x 00:30:03.969 [2024-11-18 16:16:27.446133] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:03.969 [2024-11-18 16:16:27.446221] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1709242 ] 00:30:03.969 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:03.969 Zero copy mechanism will not be used. 00:30:03.969 EAL: No free 2048 kB hugepages reported on node 1 00:30:03.969 [2024-11-18 16:16:27.506776] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:04.227 [2024-11-18 16:16:27.597161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:05.174 16:16:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:05.174 16:16:28 -- common/autotest_common.sh@862 -- # return 0 00:30:05.174 16:16:28 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:05.174 16:16:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:05.174 16:16:28 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:05.174 16:16:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:05.174 16:16:28 -- common/autotest_common.sh@10 -- # set +x 00:30:05.175 16:16:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.175 16:16:28 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:05.175 16:16:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:05.755 nvme0n1 00:30:05.755 16:16:29 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:05.755 16:16:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:05.755 16:16:29 -- common/autotest_common.sh@10 -- # set +x 00:30:05.755 16:16:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.755 16:16:29 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:05.755 16:16:29 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:05.755 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:05.755 Zero copy mechanism will not be used. 00:30:05.755 Running I/O for 2 seconds... 00:30:05.755 [2024-11-18 16:16:29.288187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.288256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.288294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.755 [2024-11-18 16:16:29.293333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.293370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.293390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.755 [2024-11-18 16:16:29.298269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.298305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.298325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.755 [2024-11-18 16:16:29.304170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.304208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.304231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.755 [2024-11-18 16:16:29.308501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.308535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.308555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.755 [2024-11-18 16:16:29.313598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.313659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.313677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.755 [2024-11-18 16:16:29.318685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.318715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.318748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.755 [2024-11-18 16:16:29.323550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.323584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.323603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.755 [2024-11-18 16:16:29.328462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.328497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.328516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.755 [2024-11-18 16:16:29.333618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.333688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.333709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.755 [2024-11-18 16:16:29.338531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.338566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.338586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.755 [2024-11-18 16:16:29.343337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:05.755 [2024-11-18 16:16:29.343370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.755 [2024-11-18 16:16:29.343389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.348263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.348296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.348315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.353165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.353200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.353219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.357963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.357998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.358018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.362737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.362768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.362785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.367507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.367540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.367559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.372342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.372376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.372395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.377025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.377060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.377080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.381887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.381933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.381953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.386731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.386761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.386794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.391576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.391619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.391644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.396468] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.396501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.396520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.401474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.401508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.401528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.406593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.406649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.406668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.411456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.411491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.411510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.415543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.415577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.415604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.420033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.420066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.420090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.423928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.423978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.423998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.428265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.428308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.428325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.433553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.433584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.433602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.441007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.441043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.441062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.447847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.447896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.447914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.455686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.455718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.455736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.463079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.463114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.463134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.470756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.470788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.470821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.477681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.477715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.015 [2024-11-18 16:16:29.477733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.015 [2024-11-18 16:16:29.484499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.015 [2024-11-18 16:16:29.484534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.484554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.491301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.491337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.491356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.498033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.498068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.498089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.504841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.504872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.504889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.512074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.512110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.512129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.518095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.518131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.518150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.524303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.524338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.524364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.531026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.531066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.531088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.536980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.537016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.537035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.543133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.543169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.543189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.549681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.549713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.549731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.556541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.556577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.556597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.561851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.561882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.561900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.568848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.568895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.568912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.574643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.574692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.574710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.580366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.580409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.580430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.586048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.586084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.586104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.591621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.591656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.591693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.596676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.596708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.596742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.016 [2024-11-18 16:16:29.601722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.016 [2024-11-18 16:16:29.601755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.016 [2024-11-18 16:16:29.601772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.275 [2024-11-18 16:16:29.606427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.606463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.606483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.611078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.611113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.611133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.616012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.616047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.616067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.621075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.621110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.621129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.626567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.626603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.626651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.633345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.633381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.633401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.640537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.640573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.640594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.646590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.646651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.646671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.652512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.652548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.652568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.658348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.658384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.658404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.664328] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.664363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.664382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.670069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.670105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.670125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.674901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.674952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.674978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.679699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.679732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.679749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.684595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.684639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.684674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.689489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.689524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.689544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.694480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.694514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.694534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.699395] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.699431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.699450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.704331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.704365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.704385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.709357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.709392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.709410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.714334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.714368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.714388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.719357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.719398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.719419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.724272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.724306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.724326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.729047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.729082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.729102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.733931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.733965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.733984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.738771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.738803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.738821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.743696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.743727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.743744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.748677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.748709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.748727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.753743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.753774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.753791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.758719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.758769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.758787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.763682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.763712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.763729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.768635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.768683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.768701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.773674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.276 [2024-11-18 16:16:29.773720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.276 [2024-11-18 16:16:29.773737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.276 [2024-11-18 16:16:29.778483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.778517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.778537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.783557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.783591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.783621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.788614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.788663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.788681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.793294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.793329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.793348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.798057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.798091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.798111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.802963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.803013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.803034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.807734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.807765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.807783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.812692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.812722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.812739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.817547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.817581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.817600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.822452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.822488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.822508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.827396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.827430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.827449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.832306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.832340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.832359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.837136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.837170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.837190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.841883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.841913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.841931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.846775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.846805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.846822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.851635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.851681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.851699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.856565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.856599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.856629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.277 [2024-11-18 16:16:29.861425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.277 [2024-11-18 16:16:29.861471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.277 [2024-11-18 16:16:29.861490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.536 [2024-11-18 16:16:29.866205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.536 [2024-11-18 16:16:29.866239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.536 [2024-11-18 16:16:29.866258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.536 [2024-11-18 16:16:29.871142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.536 [2024-11-18 16:16:29.871177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.536 [2024-11-18 16:16:29.871197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.536 [2024-11-18 16:16:29.875895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.536 [2024-11-18 16:16:29.875944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.536 [2024-11-18 16:16:29.875964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.536 [2024-11-18 16:16:29.880784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.536 [2024-11-18 16:16:29.880817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.536 [2024-11-18 16:16:29.880834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.536 [2024-11-18 16:16:29.885553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.536 [2024-11-18 16:16:29.885586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.536 [2024-11-18 16:16:29.885628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.536 [2024-11-18 16:16:29.890353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.536 [2024-11-18 16:16:29.890387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.536 [2024-11-18 16:16:29.890406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.536 [2024-11-18 16:16:29.895118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.536 [2024-11-18 16:16:29.895152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.536 [2024-11-18 16:16:29.895172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.536 [2024-11-18 16:16:29.899848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.536 [2024-11-18 16:16:29.899879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.536 [2024-11-18 16:16:29.899896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.536 [2024-11-18 16:16:29.904715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.904746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.904778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.909718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.909750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.909772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.914711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.914742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.914759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.919672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.919704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.919721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.924569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.924604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.924633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.929479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.929520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.929540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.934350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.934384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.934404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.939090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.939124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.939144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.944034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.944068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.944088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.948894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.948939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.948956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.953881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.953911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.953944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.958850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.958879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.958895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.963849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.963880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.963898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.968900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.968947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.968967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.973765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.973796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.973815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.978528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.978562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.978581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.983432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.983467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.983486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.988406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.988439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.988459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.993230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.993263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.993282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:29.998809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:29.998840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:29.998858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.004398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.004435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.004455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.009361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.009419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.009443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.014359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.014396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.014422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.018933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.018968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.018987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.023871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.023903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.023921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.028879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.028931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.028950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.034708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.034742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.034760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.039688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.039727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.039745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.044684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.044715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.044733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.049622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.049672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.049690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.054578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.054630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.054667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.059433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.059478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.059498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.064283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.064317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.064336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.069079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.069113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.069132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.073772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.073802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.073820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.078632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.078687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.078704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.083367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.083400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.083419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.088277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.088311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.088330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.093246] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.093280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.093299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.098114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.098147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.098167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.102927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.102956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.102988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.107876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.107922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.107942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.112818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.537 [2024-11-18 16:16:30.112849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.537 [2024-11-18 16:16:30.112866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.537 [2024-11-18 16:16:30.117045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.538 [2024-11-18 16:16:30.117079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.538 [2024-11-18 16:16:30.117098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.538 [2024-11-18 16:16:30.121917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.538 [2024-11-18 16:16:30.121971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.538 [2024-11-18 16:16:30.121990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.127348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.127383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.127402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.132670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.132717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.132736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.138445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.138481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.138501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.144944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.144986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.145014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.151551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.151585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.151605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.158182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.158221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.158243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.165728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.165777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.165795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.173142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.173178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.173198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.180971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.181007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.181026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.188026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.188061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.188080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.192847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.192878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.192896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.197599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.197659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.197678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.202279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.202314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.202333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.207046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.207083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.207102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.211742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.211774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.211792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.216164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.216200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.216220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.220502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.220536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.220556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.224769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.224801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.224818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.229386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.229420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.229443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.233587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.233631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.233670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.237708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.237738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.237762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.241761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.241792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.241809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.245744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.245774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.245792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.249795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.249825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.249842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.797 [2024-11-18 16:16:30.254032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.797 [2024-11-18 16:16:30.254067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.797 [2024-11-18 16:16:30.254086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.258271] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.258304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.258323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.263135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.263169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.263188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.267713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.267752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.267769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.272544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.272579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.272598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.277557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.277598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.277633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.282382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.282414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.282433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.286943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.286973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.286990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.291481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.291511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.291529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.296269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.296303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.296322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.301193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.301224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.301241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.306051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.306085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.306104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.310961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.310995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.311014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.316287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.316321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.316340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.320866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.320897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.320914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.325692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.325738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.325755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.330304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.330338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.330359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.334839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.334870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.334888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.339645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.339694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.339712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.344155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.344190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.344209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.348477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.348511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.348530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.352872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.352904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.352921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.357331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.357364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.357391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.362267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.362302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.362320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.367452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.367487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.367505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.372669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.372701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.372718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.377933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.377968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.377987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.798 [2024-11-18 16:16:30.383514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:06.798 [2024-11-18 16:16:30.383547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.798 [2024-11-18 16:16:30.383564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.057 [2024-11-18 16:16:30.388491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.057 [2024-11-18 16:16:30.388530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.057 [2024-11-18 16:16:30.388553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.057 [2024-11-18 16:16:30.393787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.057 [2024-11-18 16:16:30.393818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.057 [2024-11-18 16:16:30.393836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.057 [2024-11-18 16:16:30.397500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.057 [2024-11-18 16:16:30.397534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.057 [2024-11-18 16:16:30.397554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.057 [2024-11-18 16:16:30.402966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.057 [2024-11-18 16:16:30.403021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.057 [2024-11-18 16:16:30.403041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.409579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.409622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.409643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.414999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.415034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.415055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.420706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.420737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.420755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.426631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.426679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.426697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.430858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.430903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.430922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.435737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.435765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.435796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.440477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.440509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.440528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.445883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.445913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.445930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.450110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.450142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.450161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.455026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.455059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.455077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.459754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.459784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.459801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.464663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.464693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.464711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.469387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.469419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.469438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.474248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.474282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.474301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.480121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.480156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.480175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.484159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.484192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.484211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.489891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.489921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.489961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.494769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.494800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.494817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.500458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.500491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.500511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.505733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.505762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.505795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.510483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.510516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.510536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.515335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.515368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.515386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.520800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.520831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.520848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.526044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.526077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.526096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.531968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.531998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.532032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.537582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.537625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.537662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.543641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.543688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.543706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.549632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.549681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.549699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.555020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.555055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.555074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.559223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.559257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.559276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.564335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.564369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.564388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.571421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.571456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.571475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.578129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.578164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.578184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.584847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.584878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.584916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.592446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.592481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.058 [2024-11-18 16:16:30.592500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.058 [2024-11-18 16:16:30.599997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.058 [2024-11-18 16:16:30.600031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.059 [2024-11-18 16:16:30.600051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.059 [2024-11-18 16:16:30.606466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.059 [2024-11-18 16:16:30.606500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.059 [2024-11-18 16:16:30.606520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.059 [2024-11-18 16:16:30.611952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.059 [2024-11-18 16:16:30.611986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.059 [2024-11-18 16:16:30.612007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.059 [2024-11-18 16:16:30.617830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.059 [2024-11-18 16:16:30.617860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.059 [2024-11-18 16:16:30.617894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.059 [2024-11-18 16:16:30.622764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.059 [2024-11-18 16:16:30.622810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.059 [2024-11-18 16:16:30.622827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.059 [2024-11-18 16:16:30.627944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.059 [2024-11-18 16:16:30.627993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.059 [2024-11-18 16:16:30.628012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.059 [2024-11-18 16:16:30.633467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.059 [2024-11-18 16:16:30.633502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.059 [2024-11-18 16:16:30.633522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.059 [2024-11-18 16:16:30.640064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.059 [2024-11-18 16:16:30.640106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.059 [2024-11-18 16:16:30.640126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.318 [2024-11-18 16:16:30.647552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.318 [2024-11-18 16:16:30.647587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.318 [2024-11-18 16:16:30.647618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.318 [2024-11-18 16:16:30.655113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.318 [2024-11-18 16:16:30.655148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.318 [2024-11-18 16:16:30.655168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.318 [2024-11-18 16:16:30.662535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.318 [2024-11-18 16:16:30.662570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.318 [2024-11-18 16:16:30.662589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.318 [2024-11-18 16:16:30.670050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.318 [2024-11-18 16:16:30.670085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.318 [2024-11-18 16:16:30.670104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.318 [2024-11-18 16:16:30.677725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.318 [2024-11-18 16:16:30.677757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.318 [2024-11-18 16:16:30.677774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.318 [2024-11-18 16:16:30.685085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.318 [2024-11-18 16:16:30.685119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.318 [2024-11-18 16:16:30.685139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.318 [2024-11-18 16:16:30.692443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.318 [2024-11-18 16:16:30.692478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.318 [2024-11-18 16:16:30.692498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.318 [2024-11-18 16:16:30.699840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.318 [2024-11-18 16:16:30.699872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.318 [2024-11-18 16:16:30.699890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.318 [2024-11-18 16:16:30.707334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.318 [2024-11-18 16:16:30.707382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.318 [2024-11-18 16:16:30.707398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.318 [2024-11-18 16:16:30.714922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.318 [2024-11-18 16:16:30.714968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.318 [2024-11-18 16:16:30.714988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.318 [2024-11-18 16:16:30.722223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.318 [2024-11-18 16:16:30.722256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.722274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.729485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.729518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.729536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.737032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.737067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.737087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.744633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.744680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.744697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.751999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.752046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.752065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.758075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.758110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.758129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.762993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.763035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.763061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.767877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.767932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.767948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.773010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.773044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.773064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.778558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.778594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.778623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.785349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.785394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.785414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.792686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.792718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.792736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.799901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.799935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.799952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.807382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.807417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.807435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.814728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.814761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.814780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.822254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.822305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.822324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.829413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.829445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.829481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.837750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.837782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.837800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.846181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.846217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.846236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.853255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.853292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.853311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.860847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.860878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.860904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.867526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.867561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.867581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.874599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.874657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.874676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.882824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.882856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.882874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.890446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.890481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.890502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.897239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.897275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.897295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.319 [2024-11-18 16:16:30.902980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.319 [2024-11-18 16:16:30.903016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.319 [2024-11-18 16:16:30.903036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.908284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.908319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.908339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.913149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.913183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.913203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.917937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.917971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.917997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.922770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.922801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.922819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.927780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.927810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.927827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.932599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.932649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.932685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.937374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.937408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.937427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.942090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.942123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.942142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.946970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.947004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.947023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.951777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.951806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.951823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.956538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.956572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.956591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.961512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.961545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.961564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.966653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.966700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.966717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.971471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.971512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.971531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.976480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.976514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.976533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.981240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.981273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.981291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.986033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.986066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.986086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.991030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.991063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.991082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:30.997013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:30.997049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:30.997068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:31.001994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:31.002028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:31.002047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:31.006796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:31.006827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:31.006844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:31.011570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.579 [2024-11-18 16:16:31.011603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.579 [2024-11-18 16:16:31.011632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.579 [2024-11-18 16:16:31.016561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.016597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.016635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.021558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.021592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.021622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.026360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.026394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.026413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.031325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.031359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.031379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.036320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.036353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.036372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.041428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.041464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.041483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.046881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.046912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.046930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.052260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.052296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.052316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.058624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.058672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.058690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.064102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.064144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.064165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.069697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.069728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.069746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.075253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.075289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.075308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.079785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.079816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.079834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.083729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.083760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.083777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.087811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.087841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.087863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.091880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.091909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.091927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.095941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.095974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.095993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.099954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.099990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.100013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.104079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.104113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.104133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.108098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.108132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.108151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.112167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.112199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.112219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.116201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.116234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.116253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.120175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.120208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.120227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.124049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.580 [2024-11-18 16:16:31.124082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.580 [2024-11-18 16:16:31.124101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.580 [2024-11-18 16:16:31.128153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.581 [2024-11-18 16:16:31.128187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.581 [2024-11-18 16:16:31.128206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.581 [2024-11-18 16:16:31.132145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.581 [2024-11-18 16:16:31.132178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.581 [2024-11-18 16:16:31.132197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.581 [2024-11-18 16:16:31.136271] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.581 [2024-11-18 16:16:31.136305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.581 [2024-11-18 16:16:31.136330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.581 [2024-11-18 16:16:31.140280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.581 [2024-11-18 16:16:31.140314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.581 [2024-11-18 16:16:31.140333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.581 [2024-11-18 16:16:31.144352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.581 [2024-11-18 16:16:31.144386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.581 [2024-11-18 16:16:31.144404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.581 [2024-11-18 16:16:31.148368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.581 [2024-11-18 16:16:31.148403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.581 [2024-11-18 16:16:31.148430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.581 [2024-11-18 16:16:31.152347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.581 [2024-11-18 16:16:31.152381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.581 [2024-11-18 16:16:31.152400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.581 [2024-11-18 16:16:31.156404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.581 [2024-11-18 16:16:31.156438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.581 [2024-11-18 16:16:31.156457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.581 [2024-11-18 16:16:31.160400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.581 [2024-11-18 16:16:31.160438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.581 [2024-11-18 16:16:31.160459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.581 [2024-11-18 16:16:31.164402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.581 [2024-11-18 16:16:31.164431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.581 [2024-11-18 16:16:31.164448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.168400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.168429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.168447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.172392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.172423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.172440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.176362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.176395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.176414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.180387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.180424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.180447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.184403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.184435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.184453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.188350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.188383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.188402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.192434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.192469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.192489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.196539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.196572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.196591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.200862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.200892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.200909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.205775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.205805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.205828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.210476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.210509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.210528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.215248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.215281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.215300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.220088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.220122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.220141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.224912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.224959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.840 [2024-11-18 16:16:31.224979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.840 [2024-11-18 16:16:31.229791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.840 [2024-11-18 16:16:31.229821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.841 [2024-11-18 16:16:31.229838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.841 [2024-11-18 16:16:31.234679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.841 [2024-11-18 16:16:31.234724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.841 [2024-11-18 16:16:31.234741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.841 [2024-11-18 16:16:31.239637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.841 [2024-11-18 16:16:31.239682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.841 [2024-11-18 16:16:31.239698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.841 [2024-11-18 16:16:31.244730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.841 [2024-11-18 16:16:31.244760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.841 [2024-11-18 16:16:31.244777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.841 [2024-11-18 16:16:31.249597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.841 [2024-11-18 16:16:31.249664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.841 [2024-11-18 16:16:31.249684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.841 [2024-11-18 16:16:31.254441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.841 [2024-11-18 16:16:31.254475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.841 [2024-11-18 16:16:31.254493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.841 [2024-11-18 16:16:31.259408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.841 [2024-11-18 16:16:31.259439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.841 [2024-11-18 16:16:31.259457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.841 [2024-11-18 16:16:31.264405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.841 [2024-11-18 16:16:31.264438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.841 [2024-11-18 16:16:31.264458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.841 [2024-11-18 16:16:31.269738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.841 [2024-11-18 16:16:31.269769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.841 [2024-11-18 16:16:31.269787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.841 [2024-11-18 16:16:31.275229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.841 [2024-11-18 16:16:31.275263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.841 [2024-11-18 16:16:31.275283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.841 [2024-11-18 16:16:31.280772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x209f190) 00:30:07.841 [2024-11-18 16:16:31.280803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.841 [2024-11-18 16:16:31.280821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.841 00:30:07.841 Latency(us) 00:30:07.841 [2024-11-18T15:16:31.432Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:07.841 [2024-11-18T15:16:31.432Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:30:07.841 nvme0n1 : 2.00 5869.99 733.75 0.00 0.00 2721.60 904.15 8738.13 00:30:07.841 [2024-11-18T15:16:31.432Z] =================================================================================================================== 00:30:07.841 [2024-11-18T15:16:31.432Z] Total : 5869.99 733.75 0.00 0.00 2721.60 904.15 8738.13 00:30:07.841 0 00:30:07.841 16:16:31 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:07.841 16:16:31 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:07.841 16:16:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:07.841 16:16:31 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:07.841 | .driver_specific 00:30:07.841 | .nvme_error 00:30:07.841 | .status_code 00:30:07.841 | .command_transient_transport_error' 00:30:08.099 16:16:31 -- host/digest.sh@71 -- # (( 378 > 0 )) 00:30:08.099 16:16:31 -- host/digest.sh@73 -- # killprocess 1709242 00:30:08.099 16:16:31 -- common/autotest_common.sh@936 -- # '[' -z 1709242 ']' 00:30:08.099 16:16:31 -- common/autotest_common.sh@940 -- # kill -0 1709242 00:30:08.099 16:16:31 -- common/autotest_common.sh@941 -- # uname 00:30:08.099 16:16:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:08.099 16:16:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1709242 00:30:08.099 16:16:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:08.099 16:16:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:08.099 16:16:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1709242' 00:30:08.099 killing process with pid 1709242 00:30:08.099 16:16:31 -- common/autotest_common.sh@955 -- # kill 1709242 00:30:08.099 Received shutdown signal, test time was about 2.000000 seconds 00:30:08.099 00:30:08.099 Latency(us) 00:30:08.099 [2024-11-18T15:16:31.690Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:08.099 [2024-11-18T15:16:31.690Z] =================================================================================================================== 00:30:08.099 [2024-11-18T15:16:31.690Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:08.099 16:16:31 -- common/autotest_common.sh@960 -- # wait 1709242 00:30:08.358 16:16:31 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:30:08.358 16:16:31 -- host/digest.sh@54 -- # local rw bs qd 00:30:08.358 16:16:31 -- host/digest.sh@56 -- # rw=randwrite 00:30:08.358 16:16:31 -- host/digest.sh@56 -- # bs=4096 00:30:08.358 16:16:31 -- host/digest.sh@56 -- # qd=128 00:30:08.358 16:16:31 -- host/digest.sh@58 -- # bperfpid=1709711 00:30:08.358 16:16:31 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:30:08.358 16:16:31 -- host/digest.sh@60 -- # waitforlisten 1709711 /var/tmp/bperf.sock 00:30:08.358 16:16:31 -- common/autotest_common.sh@829 -- # '[' -z 1709711 ']' 00:30:08.358 16:16:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:08.358 16:16:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:08.358 16:16:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:08.358 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:08.358 16:16:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:08.358 16:16:31 -- common/autotest_common.sh@10 -- # set +x 00:30:08.358 [2024-11-18 16:16:31.863745] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:08.358 [2024-11-18 16:16:31.863818] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1709711 ] 00:30:08.358 EAL: No free 2048 kB hugepages reported on node 1 00:30:08.358 [2024-11-18 16:16:31.929680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:08.616 [2024-11-18 16:16:32.021234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:09.550 16:16:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:09.550 16:16:32 -- common/autotest_common.sh@862 -- # return 0 00:30:09.550 16:16:32 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:09.550 16:16:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:09.550 16:16:33 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:09.550 16:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:09.550 16:16:33 -- common/autotest_common.sh@10 -- # set +x 00:30:09.550 16:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:09.550 16:16:33 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:09.550 16:16:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:10.116 nvme0n1 00:30:10.116 16:16:33 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:10.116 16:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:10.116 16:16:33 -- common/autotest_common.sh@10 -- # set +x 00:30:10.116 16:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:10.116 16:16:33 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:10.116 16:16:33 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:10.116 Running I/O for 2 seconds... 00:30:10.116 [2024-11-18 16:16:33.673629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ee5c8 00:30:10.116 [2024-11-18 16:16:33.674696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:22349 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.116 [2024-11-18 16:16:33.674737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:30:10.116 [2024-11-18 16:16:33.686818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eee38 00:30:10.116 [2024-11-18 16:16:33.687206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:10562 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.116 [2024-11-18 16:16:33.687239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:30:10.116 [2024-11-18 16:16:33.699411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ec408 00:30:10.116 [2024-11-18 16:16:33.700103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:16254 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.116 [2024-11-18 16:16:33.700136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.711834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ee190 00:30:10.375 [2024-11-18 16:16:33.712400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:11274 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.712432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.724192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e9168 00:30:10.375 [2024-11-18 16:16:33.724722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:24784 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.724750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.736503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ea248 00:30:10.375 [2024-11-18 16:16:33.737031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:23492 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.737065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.748765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f31b8 00:30:10.375 [2024-11-18 16:16:33.749211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:14913 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.749242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.761223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f3e60 00:30:10.375 [2024-11-18 16:16:33.761595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:4392 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.761636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.773634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f31b8 00:30:10.375 [2024-11-18 16:16:33.773942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:25085 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.773971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.785727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ea248 00:30:10.375 [2024-11-18 16:16:33.786027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:10360 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.786059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.798021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e9168 00:30:10.375 [2024-11-18 16:16:33.798291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:18137 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.798323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.810255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eb328 00:30:10.375 [2024-11-18 16:16:33.810517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:6770 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.810549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.823241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190feb58 00:30:10.375 [2024-11-18 16:16:33.824685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:6327 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.824714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.835750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190efae0 00:30:10.375 [2024-11-18 16:16:33.836234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:2109 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.836266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.848183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ecc78 00:30:10.375 [2024-11-18 16:16:33.848866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:24576 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.848913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.860401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ef6a8 00:30:10.375 [2024-11-18 16:16:33.861056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:22109 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.861094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.872720] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e4140 00:30:10.375 [2024-11-18 16:16:33.873333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:3087 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.873365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.885049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e3060 00:30:10.375 [2024-11-18 16:16:33.885636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:24224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.885682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.897227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e84c0 00:30:10.375 [2024-11-18 16:16:33.897762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:10402 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.897790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.909478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ebfd0 00:30:10.375 [2024-11-18 16:16:33.909958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:10514 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.909990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.922156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eb328 00:30:10.375 [2024-11-18 16:16:33.923073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:22091 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.923105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.934145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f4f40 00:30:10.375 [2024-11-18 16:16:33.934603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:997 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.375 [2024-11-18 16:16:33.934641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:30:10.375 [2024-11-18 16:16:33.946408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190dece0 00:30:10.376 [2024-11-18 16:16:33.947834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:6621 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.376 [2024-11-18 16:16:33.947862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:30:10.376 [2024-11-18 16:16:33.958812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fda78 00:30:10.376 [2024-11-18 16:16:33.960391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:13929 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.376 [2024-11-18 16:16:33.960420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:30:10.634 [2024-11-18 16:16:33.970899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ea248 00:30:10.634 [2024-11-18 16:16:33.972257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:10973 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.634 [2024-11-18 16:16:33.972289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:30:10.634 [2024-11-18 16:16:33.983193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ec840 00:30:10.634 [2024-11-18 16:16:33.984536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:11000 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.634 [2024-11-18 16:16:33.984567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:30:10.634 [2024-11-18 16:16:33.995810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f7970 00:30:10.634 [2024-11-18 16:16:33.997099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:9465 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.634 [2024-11-18 16:16:33.997131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:30:10.634 [2024-11-18 16:16:34.008047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f46d0 00:30:10.634 [2024-11-18 16:16:34.009327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:1000 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.634 [2024-11-18 16:16:34.009358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:30:10.634 [2024-11-18 16:16:34.020350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ea680 00:30:10.634 [2024-11-18 16:16:34.021621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:13418 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.634 [2024-11-18 16:16:34.021652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:30:10.634 [2024-11-18 16:16:34.032085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e0a68 00:30:10.634 [2024-11-18 16:16:34.032561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:20346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.634 [2024-11-18 16:16:34.032594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:30:10.634 [2024-11-18 16:16:34.046093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f1868 00:30:10.634 [2024-11-18 16:16:34.047747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:9587 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.634 [2024-11-18 16:16:34.047775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:10.634 [2024-11-18 16:16:34.058581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f6020 00:30:10.634 [2024-11-18 16:16:34.059779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:23240 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.634 [2024-11-18 16:16:34.059820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.070995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ef6a8 00:30:10.635 [2024-11-18 16:16:34.071878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:20165 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.071920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.083218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eaef0 00:30:10.635 [2024-11-18 16:16:34.084149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:6073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.084181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.095521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e38d0 00:30:10.635 [2024-11-18 16:16:34.096361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:14070 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.096394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.107770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ff3c8 00:30:10.635 [2024-11-18 16:16:34.108529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:21999 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.108560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.120131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ebfd0 00:30:10.635 [2024-11-18 16:16:34.120861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:15600 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.120906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.132338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e4578 00:30:10.635 [2024-11-18 16:16:34.133037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:20150 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.133069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.144683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eaef0 00:30:10.635 [2024-11-18 16:16:34.145356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:13151 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.145387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.156858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ea680 00:30:10.635 [2024-11-18 16:16:34.157471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:15350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.157503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.167744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f0350 00:30:10.635 [2024-11-18 16:16:34.168032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:23328 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.168063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.181109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f92c0 00:30:10.635 [2024-11-18 16:16:34.181566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:10785 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.181604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.193486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fdeb0 00:30:10.635 [2024-11-18 16:16:34.194735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:6328 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.194764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.204119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f1ca0 00:30:10.635 [2024-11-18 16:16:34.204453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24868 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.204482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0018 p:0 m:0 dnr:0 00:30:10.635 [2024-11-18 16:16:34.217666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e4140 00:30:10.635 [2024-11-18 16:16:34.219470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:24760 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.635 [2024-11-18 16:16:34.219498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:30:10.893 [2024-11-18 16:16:34.229434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f46d0 00:30:10.893 [2024-11-18 16:16:34.231073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:21591 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.893 [2024-11-18 16:16:34.231099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:10.893 [2024-11-18 16:16:34.241295] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f9b30 00:30:10.893 [2024-11-18 16:16:34.243218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:5948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.893 [2024-11-18 16:16:34.243247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:30:10.893 [2024-11-18 16:16:34.253536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f57b0 00:30:10.893 [2024-11-18 16:16:34.255185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:14704 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.893 [2024-11-18 16:16:34.255217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:10.893 [2024-11-18 16:16:34.265895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f7538 00:30:10.893 [2024-11-18 16:16:34.267564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:12876 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.893 [2024-11-18 16:16:34.267605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:10.893 [2024-11-18 16:16:34.278118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eb760 00:30:10.893 [2024-11-18 16:16:34.280044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:21098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.893 [2024-11-18 16:16:34.280077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:30:10.893 [2024-11-18 16:16:34.290745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f3a28 00:30:10.893 [2024-11-18 16:16:34.291777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:12121 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.291814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.301799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e01f8 00:30:10.894 [2024-11-18 16:16:34.302863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:10881 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.302892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.314246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190dece0 00:30:10.894 [2024-11-18 16:16:34.315036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:5024 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.315068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.326350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fa3a0 00:30:10.894 [2024-11-18 16:16:34.327326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:23065 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.327358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.338643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f5378 00:30:10.894 [2024-11-18 16:16:34.340029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:935 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.340060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.350956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190de470 00:30:10.894 [2024-11-18 16:16:34.352337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:13745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.352368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.363060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f8a50 00:30:10.894 [2024-11-18 16:16:34.364082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:15782 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.364114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.374855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ef6a8 00:30:10.894 [2024-11-18 16:16:34.375277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5074 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.375308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.388539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ef6a8 00:30:10.894 [2024-11-18 16:16:34.390015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:16117 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.390043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.401226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e1f80 00:30:10.894 [2024-11-18 16:16:34.402262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:25092 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.402293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.413550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f8a50 00:30:10.894 [2024-11-18 16:16:34.414328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:5249 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.414359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.425783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e23b8 00:30:10.894 [2024-11-18 16:16:34.426486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:16566 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.426518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.438096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f4298 00:30:10.894 [2024-11-18 16:16:34.438777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:24124 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.438804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.450267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e3060 00:30:10.894 [2024-11-18 16:16:34.450951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:12853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.450984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.462581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f0bc0 00:30:10.894 [2024-11-18 16:16:34.463206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:23944 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.463237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:10.894 [2024-11-18 16:16:34.475079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f4b08 00:30:10.894 [2024-11-18 16:16:34.475654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:6293 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:10.894 [2024-11-18 16:16:34.475699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.487276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f0bc0 00:30:11.153 [2024-11-18 16:16:34.487819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11945 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.487847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.499545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e3060 00:30:11.153 [2024-11-18 16:16:34.500027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:13992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.500059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.511121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190efae0 00:30:11.153 [2024-11-18 16:16:34.511884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:12602 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.511927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.523269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e3060 00:30:11.153 [2024-11-18 16:16:34.524726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:1004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.524754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.538456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fe720 00:30:11.153 [2024-11-18 16:16:34.540030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:12183 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.540062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.550687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fda78 00:30:11.153 [2024-11-18 16:16:34.552524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:24439 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.552555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.562880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fd208 00:30:11.153 [2024-11-18 16:16:34.564396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:13645 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.564427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.574875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f2948 00:30:11.153 [2024-11-18 16:16:34.576694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:8685 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.576722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.585968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eea00 00:30:11.153 [2024-11-18 16:16:34.587545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:19602 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.587575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.598955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f81e0 00:30:11.153 [2024-11-18 16:16:34.599784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:12906 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.599811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.611365] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190edd58 00:30:11.153 [2024-11-18 16:16:34.612668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:3750 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.612728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.623766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fb8b8 00:30:11.153 [2024-11-18 16:16:34.625277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:17014 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.625323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.634657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ee5c8 00:30:11.153 [2024-11-18 16:16:34.635647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:4947 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.635691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.646976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eaab8 00:30:11.153 [2024-11-18 16:16:34.647556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:13557 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.647587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.661692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eea00 00:30:11.153 [2024-11-18 16:16:34.663581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:14165 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.663620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.672136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fbcf0 00:30:11.153 [2024-11-18 16:16:34.673510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20503 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.673541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.684713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ef6a8 00:30:11.153 [2024-11-18 16:16:34.685771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:8648 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.685799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.697155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f4f40 00:30:11.153 [2024-11-18 16:16:34.698075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:17988 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.698106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.709254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f4298 00:30:11.153 [2024-11-18 16:16:34.710162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:19616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.710194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.720287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f1868 00:30:11.153 [2024-11-18 16:16:34.720669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:11791 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.720696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:30:11.153 [2024-11-18 16:16:34.734786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ed0b0 00:30:11.153 [2024-11-18 16:16:34.736424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:17421 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.153 [2024-11-18 16:16:34.736456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.747229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f9f68 00:30:11.412 [2024-11-18 16:16:34.748881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:9515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.748913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.759676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f5be8 00:30:11.412 [2024-11-18 16:16:34.761337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:3321 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.761369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.771904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fd640 00:30:11.412 [2024-11-18 16:16:34.773557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24143 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.773583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.783993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e23b8 00:30:11.412 [2024-11-18 16:16:34.785460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:13932 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.785492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.796288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e0a68 00:30:11.412 [2024-11-18 16:16:34.798005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:10803 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.798033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.808490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f6020 00:30:11.412 [2024-11-18 16:16:34.810172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:11780 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.810200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.820852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f3e60 00:30:11.412 [2024-11-18 16:16:34.822319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:6006 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.822351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.833045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f2d80 00:30:11.412 [2024-11-18 16:16:34.834750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:15200 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.834777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.845210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fdeb0 00:30:11.412 [2024-11-18 16:16:34.846872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:6548 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.846900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.857393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f5be8 00:30:11.412 [2024-11-18 16:16:34.859046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:25237 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.859074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.870843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e0a68 00:30:11.412 [2024-11-18 16:16:34.872588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:17106 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.872632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.883009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ea248 00:30:11.412 [2024-11-18 16:16:34.884960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:5527 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.885006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.893821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eb328 00:30:11.412 [2024-11-18 16:16:34.895046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:9524 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.412 [2024-11-18 16:16:34.895076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:11.412 [2024-11-18 16:16:34.906062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e23b8 00:30:11.413 [2024-11-18 16:16:34.906855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:4271 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.413 [2024-11-18 16:16:34.906898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:11.413 [2024-11-18 16:16:34.918247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ef270 00:30:11.413 [2024-11-18 16:16:34.919013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:3685 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.413 [2024-11-18 16:16:34.919045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:30:11.413 [2024-11-18 16:16:34.930401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e5658 00:30:11.413 [2024-11-18 16:16:34.931151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:11754 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.413 [2024-11-18 16:16:34.931189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:30:11.413 [2024-11-18 16:16:34.942547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190dfdc0 00:30:11.413 [2024-11-18 16:16:34.943306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:23212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.413 [2024-11-18 16:16:34.943337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:30:11.413 [2024-11-18 16:16:34.954773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e1710 00:30:11.413 [2024-11-18 16:16:34.955557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:11142 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.413 [2024-11-18 16:16:34.955588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:30:11.413 [2024-11-18 16:16:34.965564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f5378 00:30:11.413 [2024-11-18 16:16:34.965842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:6875 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.413 [2024-11-18 16:16:34.965869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:30:11.413 [2024-11-18 16:16:34.978931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eb328 00:30:11.413 [2024-11-18 16:16:34.980268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:15718 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.413 [2024-11-18 16:16:34.980297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:30:11.413 [2024-11-18 16:16:34.991244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190dece0 00:30:11.413 [2024-11-18 16:16:34.991631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:21825 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.413 [2024-11-18 16:16:34.991662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.003777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f4f40 00:30:11.672 [2024-11-18 16:16:35.004379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:21886 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.004423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.016003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e01f8 00:30:11.672 [2024-11-18 16:16:35.016560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:8599 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.016590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.028274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e6fa8 00:30:11.672 [2024-11-18 16:16:35.028787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:9029 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.028815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.040470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e3d08 00:30:11.672 [2024-11-18 16:16:35.040988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:1007 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.041020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.052838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f0ff8 00:30:11.672 [2024-11-18 16:16:35.053296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:21032 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.053327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.065155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e7c50 00:30:11.672 [2024-11-18 16:16:35.065574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:1702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.065605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.077345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e0a68 00:30:11.672 [2024-11-18 16:16:35.077712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25332 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.077741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.089506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eb328 00:30:11.672 [2024-11-18 16:16:35.089829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:20313 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.089858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.102073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e99d8 00:30:11.672 [2024-11-18 16:16:35.103111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3146 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.103145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.114103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f0788 00:30:11.672 [2024-11-18 16:16:35.115201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:11978 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.115232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.126453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f4298 00:30:11.672 [2024-11-18 16:16:35.127506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:23054 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.127538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.139871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ef270 00:30:11.672 [2024-11-18 16:16:35.140897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:17368 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.140944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.152535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fd208 00:30:11.672 [2024-11-18 16:16:35.153287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:23511 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.153320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.164450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fd640 00:30:11.672 [2024-11-18 16:16:35.165529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:16752 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.165561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.176053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190eee38 00:30:11.672 [2024-11-18 16:16:35.177626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:10846 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.177657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.188380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e6300 00:30:11.672 [2024-11-18 16:16:35.190064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:18293 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.190093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.200809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f57b0 00:30:11.672 [2024-11-18 16:16:35.202213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:1010 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.202246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.213269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f6cc8 00:30:11.672 [2024-11-18 16:16:35.214639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:25273 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.214689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.225710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e5a90 00:30:11.672 [2024-11-18 16:16:35.227345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:25568 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.227378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.238009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e3060 00:30:11.672 [2024-11-18 16:16:35.239135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:16358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.239167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:30:11.672 [2024-11-18 16:16:35.250441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f6458 00:30:11.672 [2024-11-18 16:16:35.251740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:15598 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.672 [2024-11-18 16:16:35.251775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.263095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ebfd0 00:30:11.931 [2024-11-18 16:16:35.264030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:8564 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.264058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.276574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ebfd0 00:30:11.931 [2024-11-18 16:16:35.278379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:2752 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.278407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.289173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ebfd0 00:30:11.931 [2024-11-18 16:16:35.290487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:19602 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.290519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.299898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f0ff8 00:30:11.931 [2024-11-18 16:16:35.300565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:12880 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.300596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.312076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e5ec8 00:30:11.931 [2024-11-18 16:16:35.312713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:3359 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.312740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.324249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f3a28 00:30:11.931 [2024-11-18 16:16:35.324910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:11608 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.324936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.336510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e3498 00:30:11.931 [2024-11-18 16:16:35.337129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:15506 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.337161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.351261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e38d0 00:30:11.931 [2024-11-18 16:16:35.352831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:18634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.352858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.363530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190ef6a8 00:30:11.931 [2024-11-18 16:16:35.365348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:2029 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.365380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.375706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f3a28 00:30:11.931 [2024-11-18 16:16:35.377541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:13877 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.377573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.387875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e3498 00:30:11.931 [2024-11-18 16:16:35.389666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:13486 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.389694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.399976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f6890 00:30:11.931 [2024-11-18 16:16:35.401987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:15425 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.402017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.412136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fdeb0 00:30:11.931 [2024-11-18 16:16:35.414144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:5307 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.414175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.424303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f5378 00:30:11.931 [2024-11-18 16:16:35.426075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:10770 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.426121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.435082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f92c0 00:30:11.931 [2024-11-18 16:16:35.436103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:12634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.436135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.447158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f6890 00:30:11.931 [2024-11-18 16:16:35.448138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:14791 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.448169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.459444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f9f68 00:30:11.931 [2024-11-18 16:16:35.460536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:6425 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.460569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.472148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e01f8 00:30:11.931 [2024-11-18 16:16:35.473461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:10715 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.473492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.484590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fc560 00:30:11.931 [2024-11-18 16:16:35.485296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:3265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.485327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0036 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.497138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fe720 00:30:11.931 [2024-11-18 16:16:35.497879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:3488 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.497923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:11.931 [2024-11-18 16:16:35.509231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e4de8 00:30:11.931 [2024-11-18 16:16:35.510424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:6983 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:11.931 [2024-11-18 16:16:35.510455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.520925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e23b8 00:30:12.190 [2024-11-18 16:16:35.522183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:2218 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.522210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0036 p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.533448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f4f40 00:30:12.190 [2024-11-18 16:16:35.534264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:10425 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.534295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.546773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e0a68 00:30:12.190 [2024-11-18 16:16:35.548213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4416 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.548241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.558817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190f31b8 00:30:12.190 [2024-11-18 16:16:35.559566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:6195 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.559596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.570892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fbcf0 00:30:12.190 [2024-11-18 16:16:35.572417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:10700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.572468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.583347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e27f0 00:30:12.190 [2024-11-18 16:16:35.584291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19658 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.584323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.594891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190fef90 00:30:12.190 [2024-11-18 16:16:35.595887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:12618 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.595916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0032 p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.608831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e4de8 00:30:12.190 [2024-11-18 16:16:35.609096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:382 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.609127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.622307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e4de8 00:30:12.190 [2024-11-18 16:16:35.622567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9915 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.622597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.635985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e4de8 00:30:12.190 [2024-11-18 16:16:35.636257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:24619 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.636287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.649661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e4de8 00:30:12.190 [2024-11-18 16:16:35.650014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:23442 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.650046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.190 [2024-11-18 16:16:35.663262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x20913f0) with pdu=0x2000190e4de8 00:30:12.190 [2024-11-18 16:16:35.663487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:8055 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:12.190 [2024-11-18 16:16:35.663518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:12.190 00:30:12.190 Latency(us) 00:30:12.190 [2024-11-18T15:16:35.781Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:12.190 [2024-11-18T15:16:35.781Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:12.190 nvme0n1 : 2.01 20626.26 80.57 0.00 0.00 6192.41 2548.62 14951.92 00:30:12.190 [2024-11-18T15:16:35.781Z] =================================================================================================================== 00:30:12.190 [2024-11-18T15:16:35.781Z] Total : 20626.26 80.57 0.00 0.00 6192.41 2548.62 14951.92 00:30:12.190 0 00:30:12.190 16:16:35 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:12.190 16:16:35 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:12.190 16:16:35 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:12.190 | .driver_specific 00:30:12.190 | .nvme_error 00:30:12.190 | .status_code 00:30:12.190 | .command_transient_transport_error' 00:30:12.190 16:16:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:12.448 16:16:35 -- host/digest.sh@71 -- # (( 162 > 0 )) 00:30:12.448 16:16:35 -- host/digest.sh@73 -- # killprocess 1709711 00:30:12.448 16:16:35 -- common/autotest_common.sh@936 -- # '[' -z 1709711 ']' 00:30:12.448 16:16:35 -- common/autotest_common.sh@940 -- # kill -0 1709711 00:30:12.448 16:16:35 -- common/autotest_common.sh@941 -- # uname 00:30:12.448 16:16:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:12.448 16:16:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1709711 00:30:12.448 16:16:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:12.448 16:16:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:12.448 16:16:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1709711' 00:30:12.448 killing process with pid 1709711 00:30:12.448 16:16:35 -- common/autotest_common.sh@955 -- # kill 1709711 00:30:12.448 Received shutdown signal, test time was about 2.000000 seconds 00:30:12.448 00:30:12.448 Latency(us) 00:30:12.448 [2024-11-18T15:16:36.039Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:12.448 [2024-11-18T15:16:36.039Z] =================================================================================================================== 00:30:12.448 [2024-11-18T15:16:36.039Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:12.448 16:16:35 -- common/autotest_common.sh@960 -- # wait 1709711 00:30:12.706 16:16:36 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:30:12.706 16:16:36 -- host/digest.sh@54 -- # local rw bs qd 00:30:12.706 16:16:36 -- host/digest.sh@56 -- # rw=randwrite 00:30:12.706 16:16:36 -- host/digest.sh@56 -- # bs=131072 00:30:12.706 16:16:36 -- host/digest.sh@56 -- # qd=16 00:30:12.706 16:16:36 -- host/digest.sh@58 -- # bperfpid=1710264 00:30:12.706 16:16:36 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:30:12.706 16:16:36 -- host/digest.sh@60 -- # waitforlisten 1710264 /var/tmp/bperf.sock 00:30:12.706 16:16:36 -- common/autotest_common.sh@829 -- # '[' -z 1710264 ']' 00:30:12.706 16:16:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:12.706 16:16:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:12.706 16:16:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:12.706 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:12.706 16:16:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:12.706 16:16:36 -- common/autotest_common.sh@10 -- # set +x 00:30:12.706 [2024-11-18 16:16:36.257941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:12.706 [2024-11-18 16:16:36.258027] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1710264 ] 00:30:12.706 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:12.706 Zero copy mechanism will not be used. 00:30:12.706 EAL: No free 2048 kB hugepages reported on node 1 00:30:12.964 [2024-11-18 16:16:36.324338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:12.964 [2024-11-18 16:16:36.415782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:13.898 16:16:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:13.898 16:16:37 -- common/autotest_common.sh@862 -- # return 0 00:30:13.898 16:16:37 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:13.898 16:16:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:14.155 16:16:37 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:14.155 16:16:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.155 16:16:37 -- common/autotest_common.sh@10 -- # set +x 00:30:14.155 16:16:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.155 16:16:37 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:14.155 16:16:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:14.413 nvme0n1 00:30:14.671 16:16:38 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:14.671 16:16:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.671 16:16:38 -- common/autotest_common.sh@10 -- # set +x 00:30:14.671 16:16:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.671 16:16:38 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:14.671 16:16:38 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:14.671 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:14.671 Zero copy mechanism will not be used. 00:30:14.671 Running I/O for 2 seconds... 00:30:14.671 [2024-11-18 16:16:38.132428] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.671 [2024-11-18 16:16:38.132758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.671 [2024-11-18 16:16:38.132799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.671 [2024-11-18 16:16:38.138603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.671 [2024-11-18 16:16:38.138738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.138769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.145005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.145143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.145175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.150358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.150466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.150498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.155141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.155262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.155294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.159739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.159858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.159887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.165631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.165831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.165861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.170273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.170409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.170440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.175343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.175605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.175646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.180563] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.180748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.180777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.186152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.186300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.186331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.192036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.192201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.192233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.198103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.198343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.198376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.204453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.204553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.204584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.210806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.211059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.211097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.217160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.217308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.217340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.223424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.223563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.223595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.229596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.229782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.229810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.235970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.236106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.236138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.242294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.242522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.242554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.248997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.249157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.249185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.254283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.254625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.254654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.672 [2024-11-18 16:16:38.259398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.672 [2024-11-18 16:16:38.259669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.672 [2024-11-18 16:16:38.259698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.931 [2024-11-18 16:16:38.264227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.931 [2024-11-18 16:16:38.264323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.931 [2024-11-18 16:16:38.264366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.931 [2024-11-18 16:16:38.269617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.931 [2024-11-18 16:16:38.269858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.931 [2024-11-18 16:16:38.269887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.931 [2024-11-18 16:16:38.274665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.931 [2024-11-18 16:16:38.274758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.931 [2024-11-18 16:16:38.274786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.931 [2024-11-18 16:16:38.279815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.931 [2024-11-18 16:16:38.279983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.931 [2024-11-18 16:16:38.280015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.931 [2024-11-18 16:16:38.285202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.931 [2024-11-18 16:16:38.285367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.285399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.290518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.290700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.290729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.295957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.296231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.296263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.301449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.301731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.301760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.306887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.307084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.307116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.312188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.312363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.312394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.317426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.317556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.317587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.322747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.322923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.322954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.328263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.328361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.328392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.333779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.334006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.334047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.339303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.339549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.339580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.344770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.345027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.345059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.350209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.350331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.350363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.355633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.355840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.355874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.361089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.361325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.361357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.366364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.366514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.366545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.371678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.371808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.371836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.377045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.377344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.377375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.382211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.382434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.382466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.387588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.387790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.387818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.392939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.393226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.393258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.398457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.398687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.398717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.403580] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.403788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.403817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.408871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.409045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.409074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.414167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.414405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.414438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.419346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.419586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.419628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.932 [2024-11-18 16:16:38.424588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.932 [2024-11-18 16:16:38.424732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.932 [2024-11-18 16:16:38.424760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.429594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.429767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.429795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.434989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.435178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.435210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.440484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.440696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.440724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.446172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.446389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.446427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.451284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.451549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.451580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.456534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.456702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.456731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.461935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.462216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.462248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.467263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.467421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.467453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.472506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.472696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.472725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.477972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.478145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.478176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.483389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.483558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.483590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.488861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.489067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.489099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.494326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.494592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.494633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.499525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.499723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.499752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.504752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.505005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.505037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.510176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.510437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.510468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:14.933 [2024-11-18 16:16:38.515417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:14.933 [2024-11-18 16:16:38.515672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:14.933 [2024-11-18 16:16:38.515700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.520719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.520846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.520875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.525937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.526105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.526136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.531477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.531652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.531697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.536727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.536871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.536918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.542110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.542284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.542315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.547618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.547745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.547773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.552931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.553163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.553194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.558578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.558811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.558840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.564107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.564328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.564360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.569449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.569641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.569688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.574814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.574962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.574993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.580290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.580437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.580469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.585630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.585761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.585794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.591252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.591441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.591472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.596687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.596841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.596869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.193 [2024-11-18 16:16:38.601899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.193 [2024-11-18 16:16:38.602158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.193 [2024-11-18 16:16:38.602190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.607195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.607453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.607485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.612539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.612817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.612847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.617847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.618105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.618137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.623359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.623499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.623530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.628787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.628951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.628981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.633938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.634126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.634157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.639351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.639468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.639497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.644548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.644722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.644751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.650112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.650366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.650398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.655821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.656067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.656100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.661559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.661804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.661833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.666640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.666811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.666839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.671738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.671893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.671922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.676370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.676510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.676541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.681735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.681966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.682000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.686823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.687058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.687090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.692119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.692410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.692441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.697255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.697501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.697533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.702239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.702397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.702428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.707515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.707691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.707719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.712843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.713033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.713067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.718225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.718493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.718525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.723598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.723864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.723925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.729045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.729280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.729313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.733960] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.734147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.734179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.738574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.738734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.194 [2024-11-18 16:16:38.738762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.194 [2024-11-18 16:16:38.743634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.194 [2024-11-18 16:16:38.743815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.195 [2024-11-18 16:16:38.743843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.195 [2024-11-18 16:16:38.748736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.195 [2024-11-18 16:16:38.748873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.195 [2024-11-18 16:16:38.748901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.195 [2024-11-18 16:16:38.753770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.195 [2024-11-18 16:16:38.754005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.195 [2024-11-18 16:16:38.754037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.195 [2024-11-18 16:16:38.758836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.195 [2024-11-18 16:16:38.759112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.195 [2024-11-18 16:16:38.759143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.195 [2024-11-18 16:16:38.763860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.195 [2024-11-18 16:16:38.764040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.195 [2024-11-18 16:16:38.764072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.195 [2024-11-18 16:16:38.769050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.195 [2024-11-18 16:16:38.769299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.195 [2024-11-18 16:16:38.769331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.195 [2024-11-18 16:16:38.774012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.195 [2024-11-18 16:16:38.774182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.195 [2024-11-18 16:16:38.774209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.195 [2024-11-18 16:16:38.779126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.195 [2024-11-18 16:16:38.779316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.195 [2024-11-18 16:16:38.779347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.784276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.784437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.784469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.789347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.789519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.789550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.794479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.794619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.794650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.800518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.800755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.800783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.806459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.806738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.806768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.811072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.811278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.811310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.815711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.815877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.815905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.820478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.820656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.820686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.825218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.825382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.825413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.829871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.830007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.830038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.834749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.834870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.834899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.839468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.839620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.839672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.844409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.844625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.844670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.849153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.849314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.849345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.853942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.854090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.854127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.858490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.858694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.858721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.863222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.863339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.863371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.867817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.867953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.867996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.455 [2024-11-18 16:16:38.872503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.455 [2024-11-18 16:16:38.872682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.455 [2024-11-18 16:16:38.872711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.877196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.877340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.877372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.881891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.882098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.882130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.886388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.886556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.886587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.891257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.891393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.891424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.896395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.896624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.896671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.902561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.902698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.902726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.908023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.908149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.908181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.912584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.912778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.912806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.917428] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.917626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.917657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.922168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.922351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.922382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.926766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.926925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.926956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.931605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.931778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.931806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.936935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.937127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.937157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.942222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.942496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.942528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.948093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.948198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.948229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.954232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.954430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.954461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.960806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.960959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.960990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.967439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.967681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.967710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.973759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.974029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.974058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.980346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.980562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.980593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.986691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.986779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.986807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.993332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.993473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.993510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:38.998762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:38.998960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:38.998991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:39.003616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:39.003760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:39.003788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:39.008855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:39.009016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:39.009048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:39.014174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:39.014410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.456 [2024-11-18 16:16:39.014443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.456 [2024-11-18 16:16:39.020249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.456 [2024-11-18 16:16:39.020534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.457 [2024-11-18 16:16:39.020565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.457 [2024-11-18 16:16:39.025290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.457 [2024-11-18 16:16:39.025485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.457 [2024-11-18 16:16:39.025516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.457 [2024-11-18 16:16:39.029843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.457 [2024-11-18 16:16:39.030021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.457 [2024-11-18 16:16:39.030052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.457 [2024-11-18 16:16:39.034438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.457 [2024-11-18 16:16:39.034550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.457 [2024-11-18 16:16:39.034581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.457 [2024-11-18 16:16:39.038801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.457 [2024-11-18 16:16:39.038929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.457 [2024-11-18 16:16:39.038961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.457 [2024-11-18 16:16:39.043151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.457 [2024-11-18 16:16:39.043261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.457 [2024-11-18 16:16:39.043293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.047493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.047594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.047633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.051872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.052003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.052034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.056357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.056583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.056622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.060776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.060959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.060991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.065110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.065222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.065254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.069423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.069521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.069552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.073788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.073915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.073946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.078261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.078429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.078460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.082600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.082760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.082789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.087105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.087344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.087375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.091430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.091675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.091704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.095868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.096069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.096100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.100230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.100350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.100381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.104574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.104709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.104737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.108900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.109017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.109048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.113335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.113505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.113544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.117681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.117811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.117839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.122175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.122411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.122442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.126552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.126791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.126819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.130911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.131119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.131150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.135236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.135381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.135410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.139721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.139823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.139851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.145013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.145174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.145205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.722 [2024-11-18 16:16:39.150437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.722 [2024-11-18 16:16:39.150726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.722 [2024-11-18 16:16:39.150755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.156615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.156781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.156809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.161264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.161488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.161520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.165841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.166014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.166046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.170329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.170460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.170491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.174790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.174962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.174992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.179570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.179758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.179786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.184765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.184955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.184987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.190204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.190448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.190476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.195881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.196171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.196200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.201355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.201568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.201596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.205895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.206059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.206088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.209858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.209984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.210012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.213789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.213930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.213958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.218150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.218290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.218321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.223315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.223419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.223450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.228576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.228873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.228918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.233990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.234275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.234308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.239452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.239651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.239701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.244666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.244788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.244817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.249890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.250034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.250066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.255420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.255564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.255596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.260859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.261052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.261084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.266307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.266561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.266593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.272600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.272852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.272881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.278427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.278543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.278576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.284727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.284935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.284966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.290955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.291068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.291099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.296486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.296574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.296605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.301274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.301386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.301418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.305557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.305723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.305752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.723 [2024-11-18 16:16:39.310000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.723 [2024-11-18 16:16:39.310221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.723 [2024-11-18 16:16:39.310253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.981 [2024-11-18 16:16:39.314306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.981 [2024-11-18 16:16:39.314507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.981 [2024-11-18 16:16:39.314537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.981 [2024-11-18 16:16:39.318698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.981 [2024-11-18 16:16:39.318836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.981 [2024-11-18 16:16:39.318865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.981 [2024-11-18 16:16:39.323079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.981 [2024-11-18 16:16:39.323199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.981 [2024-11-18 16:16:39.323231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.981 [2024-11-18 16:16:39.327436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.981 [2024-11-18 16:16:39.327536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.981 [2024-11-18 16:16:39.327567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.981 [2024-11-18 16:16:39.331806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.981 [2024-11-18 16:16:39.331975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.981 [2024-11-18 16:16:39.332007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.981 [2024-11-18 16:16:39.336191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.981 [2024-11-18 16:16:39.336311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.981 [2024-11-18 16:16:39.336342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.981 [2024-11-18 16:16:39.340547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.981 [2024-11-18 16:16:39.340702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.981 [2024-11-18 16:16:39.340730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.981 [2024-11-18 16:16:39.344992] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.981 [2024-11-18 16:16:39.345197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.981 [2024-11-18 16:16:39.345228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.981 [2024-11-18 16:16:39.349379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.981 [2024-11-18 16:16:39.349577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.981 [2024-11-18 16:16:39.349615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.981 [2024-11-18 16:16:39.353765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.353928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.353960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.358130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.358247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.358278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.362451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.362575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.362615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.366799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.366967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.367005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.371140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.371252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.371283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.375439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.375576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.375616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.379874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.380092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.380123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.384359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.384540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.384571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.388825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.388989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.389021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.393202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.393311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.393342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.397523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.397649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.397676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.401902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.402066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.402097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.406294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.406426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.406457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.410654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.410782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.410810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.415045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.415250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.415282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.419449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.419670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.419699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.423798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.423939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.423985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.428133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.428254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.428285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.432453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.432570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.432600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.436830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.436992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.437023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.441165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.441292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.441323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.445492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.445637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.445682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.449954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.450159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.450191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.454327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.454522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.454553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.458737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.458884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.458930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.463065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.463212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.463244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.467996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.982 [2024-11-18 16:16:39.468172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.982 [2024-11-18 16:16:39.468203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.982 [2024-11-18 16:16:39.473076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.473252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.473284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.478178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.478364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.478396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.483247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.483433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.483470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.488436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.488711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.488739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.493096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.493291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.493323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.498150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.498376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.498407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.503507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.503697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.503726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.508547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.508718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.508746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.513501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.513681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.513710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.518599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.518745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.518772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.523213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.523403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.523435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.528423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.528705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.528735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.533730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.533970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.534004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.539719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.539901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.539933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.544413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.544543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.544574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.548911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.549078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.549110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.553788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.553959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.553991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.558321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.558466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.558496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.563006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.563196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.563228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:15.983 [2024-11-18 16:16:39.567725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:15.983 [2024-11-18 16:16:39.567895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:15.983 [2024-11-18 16:16:39.567941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.572881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.573124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.573155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.578087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.578199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.578230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.584449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.584736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.584765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.589102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.589222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.589253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.593602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.593757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.593785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.598154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.598309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.598339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.602899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.603096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.603126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.607688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.607812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.607839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.612218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.612329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.612367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.616748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.616867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.616895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.621810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.622083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.622115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.626857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.627135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.627167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.631883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.632082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.632113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.636732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.636941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.636973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.642234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.642372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.642404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.648007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.648133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.648164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.652662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.652793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.652821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.657307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.657473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.657504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.662811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.662976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.663008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.668009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.668136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.668168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.672503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.672658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.672686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.677733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.677876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.677904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.682877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.683083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.683113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.689414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.689568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.689600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.694070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.694208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.694240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.698694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.698788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.698816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.703313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.703481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.703513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.707847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.708015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.708046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.712169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.712285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.712317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.716536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.716667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.716697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.720970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.721070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.721102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.725312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.725418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.725448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.241 [2024-11-18 16:16:39.729717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.241 [2024-11-18 16:16:39.729840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.241 [2024-11-18 16:16:39.729868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.734215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.734384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.734423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.738756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.738982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.739021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.743226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.743372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.743404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.747581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.747721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.747762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.752051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.752215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.752247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.756409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.756531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.756562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.760780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.760889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.760933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.765154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.765294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.765325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.769596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.769782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.769810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.774289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.774525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.774557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.779735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.779992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.780025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.784809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.785063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.785095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.790490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.790616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.790660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.795719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.795985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.796013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.801056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.801278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.801310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.806368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.806604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.806661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.812690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.812874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.812920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.817990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.818214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.818246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.823264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.823469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.823500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.242 [2024-11-18 16:16:39.828545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.242 [2024-11-18 16:16:39.828720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.242 [2024-11-18 16:16:39.828750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.501 [2024-11-18 16:16:39.834244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.501 [2024-11-18 16:16:39.834373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.501 [2024-11-18 16:16:39.834418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.501 [2024-11-18 16:16:39.840375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.501 [2024-11-18 16:16:39.840513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.501 [2024-11-18 16:16:39.840544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.501 [2024-11-18 16:16:39.845625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.501 [2024-11-18 16:16:39.845739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.501 [2024-11-18 16:16:39.845768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.501 [2024-11-18 16:16:39.850274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.501 [2024-11-18 16:16:39.850416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.501 [2024-11-18 16:16:39.850448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.501 [2024-11-18 16:16:39.854864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.501 [2024-11-18 16:16:39.855117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.501 [2024-11-18 16:16:39.855148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.501 [2024-11-18 16:16:39.859328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.501 [2024-11-18 16:16:39.859526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.501 [2024-11-18 16:16:39.859557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.501 [2024-11-18 16:16:39.863981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.501 [2024-11-18 16:16:39.864188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.501 [2024-11-18 16:16:39.864220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.501 [2024-11-18 16:16:39.868477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.501 [2024-11-18 16:16:39.868671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.501 [2024-11-18 16:16:39.868709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.501 [2024-11-18 16:16:39.873766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.501 [2024-11-18 16:16:39.873870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.501 [2024-11-18 16:16:39.873899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.501 [2024-11-18 16:16:39.878215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.501 [2024-11-18 16:16:39.878327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.501 [2024-11-18 16:16:39.878359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.501 [2024-11-18 16:16:39.882631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.501 [2024-11-18 16:16:39.882803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.882831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.886938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.887097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.887128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.891399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.891659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.891687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.895765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.895990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.896021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.900129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.900301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.900333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.904491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.904657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.904686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.908867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.909000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.909031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.913304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.913413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.913445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.917723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.917875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.917904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.922057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.922216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.922247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.926535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.926768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.926798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.930911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.931103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.931135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.935279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.935423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.935456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.939690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.939823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.939852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.944091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.944207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.944238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.948449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.948573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.948604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.952852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.953032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.953064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.957268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.957432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.957464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.961768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.961992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.962024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.966160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.966323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.966355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.970615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.970771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.970799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.974871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.975028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.975059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.979794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.979865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.979893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.984211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.984328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.984365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.988658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.988811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.502 [2024-11-18 16:16:39.988839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.502 [2024-11-18 16:16:39.993027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.502 [2024-11-18 16:16:39.993188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:39.993219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:39.997478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:39.997719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:39.997747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.002091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.002338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.002379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.007095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.007284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.007323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.012063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.012187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.012220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.017570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.017738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.017768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.024208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.024423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.024455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.029750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.029948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.029987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.035107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.035243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.035276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.040867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.041006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.041047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.045525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.045711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.045741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.049977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.050097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.050128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.054654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.054765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.054793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.059187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.059306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.059338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.063799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.063893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.063925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.068244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.068407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.068437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.072670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.072810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.072838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.077125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.077340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.077370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.081474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.081658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.081687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.503 [2024-11-18 16:16:40.085878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.503 [2024-11-18 16:16:40.086060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.503 [2024-11-18 16:16:40.086091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.762 [2024-11-18 16:16:40.090492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.762 [2024-11-18 16:16:40.090601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.762 [2024-11-18 16:16:40.090637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.762 [2024-11-18 16:16:40.095222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.762 [2024-11-18 16:16:40.095327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.762 [2024-11-18 16:16:40.095357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.762 [2024-11-18 16:16:40.099697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.762 [2024-11-18 16:16:40.099790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.762 [2024-11-18 16:16:40.099819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.762 [2024-11-18 16:16:40.104261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.762 [2024-11-18 16:16:40.104431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.762 [2024-11-18 16:16:40.104462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.762 [2024-11-18 16:16:40.108760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.762 [2024-11-18 16:16:40.108902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.762 [2024-11-18 16:16:40.108954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.762 [2024-11-18 16:16:40.113337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.762 [2024-11-18 16:16:40.113561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.762 [2024-11-18 16:16:40.113593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:16.762 [2024-11-18 16:16:40.117930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.762 [2024-11-18 16:16:40.118083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.762 [2024-11-18 16:16:40.118115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:16.762 [2024-11-18 16:16:40.122477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.762 [2024-11-18 16:16:40.122649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.762 [2024-11-18 16:16:40.122692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:16.762 [2024-11-18 16:16:40.127151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2091590) with pdu=0x2000190fef90 00:30:16.762 [2024-11-18 16:16:40.127310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.762 [2024-11-18 16:16:40.127341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:16.762 00:30:16.762 Latency(us) 00:30:16.762 [2024-11-18T15:16:40.353Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:16.762 [2024-11-18T15:16:40.353Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:16.762 nvme0n1 : 2.00 6205.54 775.69 0.00 0.00 2571.51 1844.72 6796.33 00:30:16.762 [2024-11-18T15:16:40.353Z] =================================================================================================================== 00:30:16.762 [2024-11-18T15:16:40.353Z] Total : 6205.54 775.69 0.00 0.00 2571.51 1844.72 6796.33 00:30:16.762 0 00:30:16.762 16:16:40 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:16.762 16:16:40 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:16.762 16:16:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:16.762 16:16:40 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:16.762 | .driver_specific 00:30:16.762 | .nvme_error 00:30:16.762 | .status_code 00:30:16.762 | .command_transient_transport_error' 00:30:17.020 16:16:40 -- host/digest.sh@71 -- # (( 400 > 0 )) 00:30:17.020 16:16:40 -- host/digest.sh@73 -- # killprocess 1710264 00:30:17.020 16:16:40 -- common/autotest_common.sh@936 -- # '[' -z 1710264 ']' 00:30:17.020 16:16:40 -- common/autotest_common.sh@940 -- # kill -0 1710264 00:30:17.020 16:16:40 -- common/autotest_common.sh@941 -- # uname 00:30:17.020 16:16:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:17.020 16:16:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1710264 00:30:17.020 16:16:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:17.020 16:16:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:17.020 16:16:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1710264' 00:30:17.020 killing process with pid 1710264 00:30:17.020 16:16:40 -- common/autotest_common.sh@955 -- # kill 1710264 00:30:17.020 Received shutdown signal, test time was about 2.000000 seconds 00:30:17.020 00:30:17.020 Latency(us) 00:30:17.020 [2024-11-18T15:16:40.611Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:17.020 [2024-11-18T15:16:40.611Z] =================================================================================================================== 00:30:17.020 [2024-11-18T15:16:40.611Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:17.020 16:16:40 -- common/autotest_common.sh@960 -- # wait 1710264 00:30:17.278 16:16:40 -- host/digest.sh@115 -- # killprocess 1708582 00:30:17.278 16:16:40 -- common/autotest_common.sh@936 -- # '[' -z 1708582 ']' 00:30:17.278 16:16:40 -- common/autotest_common.sh@940 -- # kill -0 1708582 00:30:17.278 16:16:40 -- common/autotest_common.sh@941 -- # uname 00:30:17.278 16:16:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:17.278 16:16:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1708582 00:30:17.278 16:16:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:17.278 16:16:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:17.278 16:16:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1708582' 00:30:17.278 killing process with pid 1708582 00:30:17.278 16:16:40 -- common/autotest_common.sh@955 -- # kill 1708582 00:30:17.278 16:16:40 -- common/autotest_common.sh@960 -- # wait 1708582 00:30:17.536 00:30:17.536 real 0m18.404s 00:30:17.536 user 0m37.416s 00:30:17.536 sys 0m4.602s 00:30:17.536 16:16:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:17.536 16:16:40 -- common/autotest_common.sh@10 -- # set +x 00:30:17.536 ************************************ 00:30:17.536 END TEST nvmf_digest_error 00:30:17.536 ************************************ 00:30:17.536 16:16:40 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:17.536 16:16:40 -- host/digest.sh@139 -- # nvmftestfini 00:30:17.536 16:16:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:17.536 16:16:40 -- nvmf/common.sh@116 -- # sync 00:30:17.536 16:16:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:17.536 16:16:40 -- nvmf/common.sh@119 -- # set +e 00:30:17.536 16:16:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:17.536 16:16:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:17.536 rmmod nvme_tcp 00:30:17.536 rmmod nvme_fabrics 00:30:17.536 rmmod nvme_keyring 00:30:17.536 16:16:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:17.536 16:16:41 -- nvmf/common.sh@123 -- # set -e 00:30:17.536 16:16:41 -- nvmf/common.sh@124 -- # return 0 00:30:17.536 16:16:41 -- nvmf/common.sh@477 -- # '[' -n 1708582 ']' 00:30:17.536 16:16:41 -- nvmf/common.sh@478 -- # killprocess 1708582 00:30:17.536 16:16:41 -- common/autotest_common.sh@936 -- # '[' -z 1708582 ']' 00:30:17.536 16:16:41 -- common/autotest_common.sh@940 -- # kill -0 1708582 00:30:17.536 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1708582) - No such process 00:30:17.536 16:16:41 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1708582 is not found' 00:30:17.536 Process with pid 1708582 is not found 00:30:17.536 16:16:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:17.536 16:16:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:17.536 16:16:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:17.536 16:16:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:17.536 16:16:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:17.536 16:16:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:17.536 16:16:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:17.536 16:16:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:20.066 16:16:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:20.066 00:30:20.066 real 0m38.432s 00:30:20.066 user 1m9.526s 00:30:20.066 sys 0m10.440s 00:30:20.066 16:16:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:20.066 16:16:43 -- common/autotest_common.sh@10 -- # set +x 00:30:20.066 ************************************ 00:30:20.066 END TEST nvmf_digest 00:30:20.066 ************************************ 00:30:20.066 16:16:43 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:20.066 16:16:43 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:20.066 16:16:43 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:20.066 16:16:43 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:20.066 16:16:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:20.066 16:16:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:20.066 16:16:43 -- common/autotest_common.sh@10 -- # set +x 00:30:20.066 ************************************ 00:30:20.066 START TEST nvmf_bdevperf 00:30:20.066 ************************************ 00:30:20.066 16:16:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:20.066 * Looking for test storage... 00:30:20.066 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:20.066 16:16:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:20.066 16:16:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:20.066 16:16:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:20.066 16:16:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:20.066 16:16:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:20.066 16:16:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:20.066 16:16:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:20.066 16:16:43 -- scripts/common.sh@335 -- # IFS=.-: 00:30:20.066 16:16:43 -- scripts/common.sh@335 -- # read -ra ver1 00:30:20.066 16:16:43 -- scripts/common.sh@336 -- # IFS=.-: 00:30:20.066 16:16:43 -- scripts/common.sh@336 -- # read -ra ver2 00:30:20.066 16:16:43 -- scripts/common.sh@337 -- # local 'op=<' 00:30:20.066 16:16:43 -- scripts/common.sh@339 -- # ver1_l=2 00:30:20.067 16:16:43 -- scripts/common.sh@340 -- # ver2_l=1 00:30:20.067 16:16:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:20.067 16:16:43 -- scripts/common.sh@343 -- # case "$op" in 00:30:20.067 16:16:43 -- scripts/common.sh@344 -- # : 1 00:30:20.067 16:16:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:20.067 16:16:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:20.067 16:16:43 -- scripts/common.sh@364 -- # decimal 1 00:30:20.067 16:16:43 -- scripts/common.sh@352 -- # local d=1 00:30:20.067 16:16:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:20.067 16:16:43 -- scripts/common.sh@354 -- # echo 1 00:30:20.067 16:16:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:20.067 16:16:43 -- scripts/common.sh@365 -- # decimal 2 00:30:20.067 16:16:43 -- scripts/common.sh@352 -- # local d=2 00:30:20.067 16:16:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:20.067 16:16:43 -- scripts/common.sh@354 -- # echo 2 00:30:20.067 16:16:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:20.067 16:16:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:20.067 16:16:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:20.067 16:16:43 -- scripts/common.sh@367 -- # return 0 00:30:20.067 16:16:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:20.067 16:16:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:20.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:20.067 --rc genhtml_branch_coverage=1 00:30:20.067 --rc genhtml_function_coverage=1 00:30:20.067 --rc genhtml_legend=1 00:30:20.067 --rc geninfo_all_blocks=1 00:30:20.067 --rc geninfo_unexecuted_blocks=1 00:30:20.067 00:30:20.067 ' 00:30:20.067 16:16:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:20.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:20.067 --rc genhtml_branch_coverage=1 00:30:20.067 --rc genhtml_function_coverage=1 00:30:20.067 --rc genhtml_legend=1 00:30:20.067 --rc geninfo_all_blocks=1 00:30:20.067 --rc geninfo_unexecuted_blocks=1 00:30:20.067 00:30:20.067 ' 00:30:20.067 16:16:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:20.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:20.067 --rc genhtml_branch_coverage=1 00:30:20.067 --rc genhtml_function_coverage=1 00:30:20.067 --rc genhtml_legend=1 00:30:20.067 --rc geninfo_all_blocks=1 00:30:20.067 --rc geninfo_unexecuted_blocks=1 00:30:20.067 00:30:20.067 ' 00:30:20.067 16:16:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:20.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:20.067 --rc genhtml_branch_coverage=1 00:30:20.067 --rc genhtml_function_coverage=1 00:30:20.067 --rc genhtml_legend=1 00:30:20.067 --rc geninfo_all_blocks=1 00:30:20.067 --rc geninfo_unexecuted_blocks=1 00:30:20.067 00:30:20.067 ' 00:30:20.067 16:16:43 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:20.067 16:16:43 -- nvmf/common.sh@7 -- # uname -s 00:30:20.067 16:16:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:20.067 16:16:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:20.067 16:16:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:20.067 16:16:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:20.067 16:16:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:20.067 16:16:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:20.067 16:16:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:20.067 16:16:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:20.067 16:16:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:20.067 16:16:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:20.067 16:16:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:20.067 16:16:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:20.067 16:16:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:20.067 16:16:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:20.067 16:16:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:20.067 16:16:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:20.067 16:16:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:20.067 16:16:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:20.067 16:16:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:20.067 16:16:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:20.067 16:16:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:20.067 16:16:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:20.067 16:16:43 -- paths/export.sh@5 -- # export PATH 00:30:20.067 16:16:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:20.067 16:16:43 -- nvmf/common.sh@46 -- # : 0 00:30:20.067 16:16:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:20.067 16:16:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:20.067 16:16:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:20.067 16:16:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:20.067 16:16:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:20.067 16:16:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:20.067 16:16:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:20.067 16:16:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:20.067 16:16:43 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:20.067 16:16:43 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:20.067 16:16:43 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:20.067 16:16:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:20.067 16:16:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:20.067 16:16:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:20.067 16:16:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:20.067 16:16:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:20.067 16:16:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:20.067 16:16:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:20.067 16:16:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:20.067 16:16:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:20.067 16:16:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:20.067 16:16:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:20.067 16:16:43 -- common/autotest_common.sh@10 -- # set +x 00:30:21.968 16:16:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:21.968 16:16:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:21.968 16:16:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:21.968 16:16:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:21.968 16:16:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:21.968 16:16:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:21.968 16:16:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:21.968 16:16:45 -- nvmf/common.sh@294 -- # net_devs=() 00:30:21.968 16:16:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:21.968 16:16:45 -- nvmf/common.sh@295 -- # e810=() 00:30:21.968 16:16:45 -- nvmf/common.sh@295 -- # local -ga e810 00:30:21.968 16:16:45 -- nvmf/common.sh@296 -- # x722=() 00:30:21.968 16:16:45 -- nvmf/common.sh@296 -- # local -ga x722 00:30:21.968 16:16:45 -- nvmf/common.sh@297 -- # mlx=() 00:30:21.968 16:16:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:21.968 16:16:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:21.968 16:16:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:21.968 16:16:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:21.968 16:16:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:21.968 16:16:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:21.968 16:16:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:21.968 16:16:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:21.968 16:16:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:21.968 16:16:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:21.968 16:16:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:21.968 16:16:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:21.968 16:16:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:21.968 16:16:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:21.968 16:16:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:21.968 16:16:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:21.968 16:16:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:21.968 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:21.968 16:16:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:21.968 16:16:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:21.968 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:21.968 16:16:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:21.968 16:16:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:21.968 16:16:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:21.968 16:16:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:21.968 16:16:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:21.968 16:16:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:21.968 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:21.968 16:16:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:21.968 16:16:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:21.968 16:16:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:21.968 16:16:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:21.968 16:16:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:21.968 16:16:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:21.968 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:21.968 16:16:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:21.968 16:16:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:21.968 16:16:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:21.968 16:16:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:21.968 16:16:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:21.968 16:16:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:21.968 16:16:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:21.968 16:16:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:21.968 16:16:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:21.968 16:16:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:21.968 16:16:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:21.968 16:16:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:21.969 16:16:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:21.969 16:16:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:21.969 16:16:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:21.969 16:16:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:21.969 16:16:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:21.969 16:16:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:21.969 16:16:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:21.969 16:16:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:21.969 16:16:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:21.969 16:16:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:21.969 16:16:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:21.969 16:16:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:21.969 16:16:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:21.969 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:21.969 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.164 ms 00:30:21.969 00:30:21.969 --- 10.0.0.2 ping statistics --- 00:30:21.969 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:21.969 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:30:21.969 16:16:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:21.969 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:21.969 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:30:21.969 00:30:21.969 --- 10.0.0.1 ping statistics --- 00:30:21.969 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:21.969 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:30:21.969 16:16:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:21.969 16:16:45 -- nvmf/common.sh@410 -- # return 0 00:30:21.969 16:16:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:21.969 16:16:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:21.969 16:16:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:21.969 16:16:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:21.969 16:16:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:21.969 16:16:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:21.969 16:16:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:21.969 16:16:45 -- host/bdevperf.sh@25 -- # tgt_init 00:30:21.969 16:16:45 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:21.969 16:16:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:21.969 16:16:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:21.969 16:16:45 -- common/autotest_common.sh@10 -- # set +x 00:30:21.969 16:16:45 -- nvmf/common.sh@469 -- # nvmfpid=1712810 00:30:21.969 16:16:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:21.969 16:16:45 -- nvmf/common.sh@470 -- # waitforlisten 1712810 00:30:21.969 16:16:45 -- common/autotest_common.sh@829 -- # '[' -z 1712810 ']' 00:30:21.969 16:16:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:21.969 16:16:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:21.969 16:16:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:21.969 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:21.969 16:16:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:21.969 16:16:45 -- common/autotest_common.sh@10 -- # set +x 00:30:21.969 [2024-11-18 16:16:45.487291] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:21.969 [2024-11-18 16:16:45.487364] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:21.969 EAL: No free 2048 kB hugepages reported on node 1 00:30:21.969 [2024-11-18 16:16:45.556851] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:22.227 [2024-11-18 16:16:45.647112] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:22.227 [2024-11-18 16:16:45.647288] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:22.227 [2024-11-18 16:16:45.647320] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:22.227 [2024-11-18 16:16:45.647342] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:22.227 [2024-11-18 16:16:45.647450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:22.227 [2024-11-18 16:16:45.648626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:22.227 [2024-11-18 16:16:45.648639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:23.160 16:16:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:23.160 16:16:46 -- common/autotest_common.sh@862 -- # return 0 00:30:23.160 16:16:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:23.160 16:16:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:23.160 16:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:23.160 16:16:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:23.160 16:16:46 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:23.160 16:16:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.160 16:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:23.160 [2024-11-18 16:16:46.522268] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:23.160 16:16:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.160 16:16:46 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:23.160 16:16:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.160 16:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:23.160 Malloc0 00:30:23.160 16:16:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.160 16:16:46 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:23.160 16:16:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.160 16:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:23.160 16:16:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.160 16:16:46 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:23.160 16:16:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.160 16:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:23.160 16:16:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.160 16:16:46 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:23.160 16:16:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.160 16:16:46 -- common/autotest_common.sh@10 -- # set +x 00:30:23.160 [2024-11-18 16:16:46.588506] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:23.160 16:16:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.161 16:16:46 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:23.161 16:16:46 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:23.161 16:16:46 -- nvmf/common.sh@520 -- # config=() 00:30:23.161 16:16:46 -- nvmf/common.sh@520 -- # local subsystem config 00:30:23.161 16:16:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:23.161 16:16:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:23.161 { 00:30:23.161 "params": { 00:30:23.161 "name": "Nvme$subsystem", 00:30:23.161 "trtype": "$TEST_TRANSPORT", 00:30:23.161 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:23.161 "adrfam": "ipv4", 00:30:23.161 "trsvcid": "$NVMF_PORT", 00:30:23.161 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:23.161 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:23.161 "hdgst": ${hdgst:-false}, 00:30:23.161 "ddgst": ${ddgst:-false} 00:30:23.161 }, 00:30:23.161 "method": "bdev_nvme_attach_controller" 00:30:23.161 } 00:30:23.161 EOF 00:30:23.161 )") 00:30:23.161 16:16:46 -- nvmf/common.sh@542 -- # cat 00:30:23.161 16:16:46 -- nvmf/common.sh@544 -- # jq . 00:30:23.161 16:16:46 -- nvmf/common.sh@545 -- # IFS=, 00:30:23.161 16:16:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:23.161 "params": { 00:30:23.161 "name": "Nvme1", 00:30:23.161 "trtype": "tcp", 00:30:23.161 "traddr": "10.0.0.2", 00:30:23.161 "adrfam": "ipv4", 00:30:23.161 "trsvcid": "4420", 00:30:23.161 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:23.161 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:23.161 "hdgst": false, 00:30:23.161 "ddgst": false 00:30:23.161 }, 00:30:23.161 "method": "bdev_nvme_attach_controller" 00:30:23.161 }' 00:30:23.161 [2024-11-18 16:16:46.632430] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:23.161 [2024-11-18 16:16:46.632495] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1712988 ] 00:30:23.161 EAL: No free 2048 kB hugepages reported on node 1 00:30:23.161 [2024-11-18 16:16:46.694408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:23.419 [2024-11-18 16:16:46.783484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:23.677 Running I/O for 1 seconds... 00:30:24.610 00:30:24.610 Latency(us) 00:30:24.610 [2024-11-18T15:16:48.201Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:24.610 [2024-11-18T15:16:48.201Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:24.610 Verification LBA range: start 0x0 length 0x4000 00:30:24.610 Nvme1n1 : 1.01 12817.20 50.07 0.00 0.00 9940.06 1243.97 16117.00 00:30:24.610 [2024-11-18T15:16:48.201Z] =================================================================================================================== 00:30:24.610 [2024-11-18T15:16:48.201Z] Total : 12817.20 50.07 0.00 0.00 9940.06 1243.97 16117.00 00:30:24.867 16:16:48 -- host/bdevperf.sh@30 -- # bdevperfpid=1713204 00:30:24.867 16:16:48 -- host/bdevperf.sh@32 -- # sleep 3 00:30:24.868 16:16:48 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:24.868 16:16:48 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:24.868 16:16:48 -- nvmf/common.sh@520 -- # config=() 00:30:24.868 16:16:48 -- nvmf/common.sh@520 -- # local subsystem config 00:30:24.868 16:16:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:24.868 16:16:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:24.868 { 00:30:24.868 "params": { 00:30:24.868 "name": "Nvme$subsystem", 00:30:24.868 "trtype": "$TEST_TRANSPORT", 00:30:24.868 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:24.868 "adrfam": "ipv4", 00:30:24.868 "trsvcid": "$NVMF_PORT", 00:30:24.868 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:24.868 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:24.868 "hdgst": ${hdgst:-false}, 00:30:24.868 "ddgst": ${ddgst:-false} 00:30:24.868 }, 00:30:24.868 "method": "bdev_nvme_attach_controller" 00:30:24.868 } 00:30:24.868 EOF 00:30:24.868 )") 00:30:24.868 16:16:48 -- nvmf/common.sh@542 -- # cat 00:30:24.868 16:16:48 -- nvmf/common.sh@544 -- # jq . 00:30:24.868 16:16:48 -- nvmf/common.sh@545 -- # IFS=, 00:30:24.868 16:16:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:24.868 "params": { 00:30:24.868 "name": "Nvme1", 00:30:24.868 "trtype": "tcp", 00:30:24.868 "traddr": "10.0.0.2", 00:30:24.868 "adrfam": "ipv4", 00:30:24.868 "trsvcid": "4420", 00:30:24.868 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:24.868 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:24.868 "hdgst": false, 00:30:24.868 "ddgst": false 00:30:24.868 }, 00:30:24.868 "method": "bdev_nvme_attach_controller" 00:30:24.868 }' 00:30:24.868 [2024-11-18 16:16:48.332648] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:24.868 [2024-11-18 16:16:48.332725] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1713204 ] 00:30:24.868 EAL: No free 2048 kB hugepages reported on node 1 00:30:24.868 [2024-11-18 16:16:48.393085] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:25.126 [2024-11-18 16:16:48.476034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:25.383 Running I/O for 15 seconds... 00:30:27.915 16:16:51 -- host/bdevperf.sh@33 -- # kill -9 1712810 00:30:27.915 16:16:51 -- host/bdevperf.sh@35 -- # sleep 3 00:30:27.915 [2024-11-18 16:16:51.308741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:122792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.308792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.308822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:122800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.308840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.308857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:122808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.308872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.308908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:122840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.308923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.308938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:122848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.308966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.308982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:122880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.308996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:122888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:122904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:122912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:122920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:122936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:122944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:122968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:122976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:122984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:122992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:122248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:122256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:122288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:122304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:122312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:122320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:122448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:122464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:123040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.915 [2024-11-18 16:16:51.309706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:123048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.915 [2024-11-18 16:16:51.309736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:123056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:123064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.915 [2024-11-18 16:16:51.309793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:123072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.915 [2024-11-18 16:16:51.309822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.915 [2024-11-18 16:16:51.309837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:123080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.309857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.309872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:123088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.309901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.309919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:123096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.309934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.309951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:122480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.309966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.309982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:122496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.309996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:122512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:122560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:122592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:122616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:122624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:122640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:123104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:123112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:123120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:123128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:123136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:123144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:123152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:123160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:123168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:123176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:123184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:123192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:123200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:123208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:123216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:123224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:123232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:123240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:123248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:123256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:123264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:123272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:123280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.310960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.310977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:123288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.310992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.311008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:123296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.311024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.311040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:123304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.916 [2024-11-18 16:16:51.311056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.311073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:122648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.311087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.311105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:122680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.311120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.916 [2024-11-18 16:16:51.311136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:122688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.916 [2024-11-18 16:16:51.311151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:122696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:122712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:122728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:122752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:122768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:123312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:123320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:123328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:123336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:123344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:123352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:123360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:123368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:123376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:123384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:123392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:123400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:123408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:123416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:123424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.311816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:123432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:123440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:123448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:123456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.311970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:123464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.311985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:123472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.312016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:123480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.312047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:123488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.312078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:123496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.312110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:123504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.312141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:123512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.312173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:123520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.312215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:123528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.312247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:123536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.312280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:123544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.312312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:123552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.312344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:123560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.312376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:123568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.917 [2024-11-18 16:16:51.312407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:123576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.917 [2024-11-18 16:16:51.312439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.917 [2024-11-18 16:16:51.312456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:123584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.918 [2024-11-18 16:16:51.312471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:123592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:123600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:27.918 [2024-11-18 16:16:51.312534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:123608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:122784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:122816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:122824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:122832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:122856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:122864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:122872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:122896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:122928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:122952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:122960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:123000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.312982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.312999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:123008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.313013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.313034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:123016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.313050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.313067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:123024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:27.918 [2024-11-18 16:16:51.313082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.313098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd97820 is same with the state(5) to be set 00:30:27.918 [2024-11-18 16:16:51.313117] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:27.918 [2024-11-18 16:16:51.313130] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:27.918 [2024-11-18 16:16:51.313143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:123032 len:8 PRP1 0x0 PRP2 0x0 00:30:27.918 [2024-11-18 16:16:51.313157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:27.918 [2024-11-18 16:16:51.313230] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xd97820 was disconnected and freed. reset controller. 00:30:27.918 [2024-11-18 16:16:51.315508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.918 [2024-11-18 16:16:51.315585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.918 [2024-11-18 16:16:51.316139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.918 [2024-11-18 16:16:51.316245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.918 [2024-11-18 16:16:51.316275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.918 [2024-11-18 16:16:51.316294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.918 [2024-11-18 16:16:51.316498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.918 [2024-11-18 16:16:51.316910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.918 [2024-11-18 16:16:51.316931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.918 [2024-11-18 16:16:51.316949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.918 [2024-11-18 16:16:51.319166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.918 [2024-11-18 16:16:51.328312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.918 [2024-11-18 16:16:51.328652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.918 [2024-11-18 16:16:51.328781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.918 [2024-11-18 16:16:51.328809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.918 [2024-11-18 16:16:51.328827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.918 [2024-11-18 16:16:51.328975] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.918 [2024-11-18 16:16:51.329162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.918 [2024-11-18 16:16:51.329186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.918 [2024-11-18 16:16:51.329202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.918 [2024-11-18 16:16:51.331618] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.918 [2024-11-18 16:16:51.341090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.918 [2024-11-18 16:16:51.341370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.918 [2024-11-18 16:16:51.341476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.918 [2024-11-18 16:16:51.341504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.918 [2024-11-18 16:16:51.341522] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.918 [2024-11-18 16:16:51.341740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.918 [2024-11-18 16:16:51.341893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.918 [2024-11-18 16:16:51.341916] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.918 [2024-11-18 16:16:51.341931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.918 [2024-11-18 16:16:51.344043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.918 [2024-11-18 16:16:51.353746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.918 [2024-11-18 16:16:51.354076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.918 [2024-11-18 16:16:51.354206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.918 [2024-11-18 16:16:51.354232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.918 [2024-11-18 16:16:51.354248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.918 [2024-11-18 16:16:51.354426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.918 [2024-11-18 16:16:51.354624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.918 [2024-11-18 16:16:51.354648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.918 [2024-11-18 16:16:51.354664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.918 [2024-11-18 16:16:51.356971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.918 [2024-11-18 16:16:51.366324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.918 [2024-11-18 16:16:51.366668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.918 [2024-11-18 16:16:51.366806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.366835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.919 [2024-11-18 16:16:51.366854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.919 [2024-11-18 16:16:51.367037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.919 [2024-11-18 16:16:51.367242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.919 [2024-11-18 16:16:51.367265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.919 [2024-11-18 16:16:51.367280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.919 [2024-11-18 16:16:51.369695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.919 [2024-11-18 16:16:51.379030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.919 [2024-11-18 16:16:51.379254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.379495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.379555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.919 [2024-11-18 16:16:51.379573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.919 [2024-11-18 16:16:51.379786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.919 [2024-11-18 16:16:51.379938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.919 [2024-11-18 16:16:51.379962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.919 [2024-11-18 16:16:51.379977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.919 [2024-11-18 16:16:51.382194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.919 [2024-11-18 16:16:51.391594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.919 [2024-11-18 16:16:51.391901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.392001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.392030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.919 [2024-11-18 16:16:51.392048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.919 [2024-11-18 16:16:51.392195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.919 [2024-11-18 16:16:51.392347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.919 [2024-11-18 16:16:51.392371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.919 [2024-11-18 16:16:51.392385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.919 [2024-11-18 16:16:51.394594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.919 [2024-11-18 16:16:51.404137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.919 [2024-11-18 16:16:51.404420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.404550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.404579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.919 [2024-11-18 16:16:51.404597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.919 [2024-11-18 16:16:51.404756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.919 [2024-11-18 16:16:51.404925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.919 [2024-11-18 16:16:51.404949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.919 [2024-11-18 16:16:51.404964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.919 [2024-11-18 16:16:51.407505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.919 [2024-11-18 16:16:51.416789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.919 [2024-11-18 16:16:51.417046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.417175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.417204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.919 [2024-11-18 16:16:51.417222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.919 [2024-11-18 16:16:51.417369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.919 [2024-11-18 16:16:51.417556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.919 [2024-11-18 16:16:51.417580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.919 [2024-11-18 16:16:51.417595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.919 [2024-11-18 16:16:51.420004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.919 [2024-11-18 16:16:51.429236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.919 [2024-11-18 16:16:51.429623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.429758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.429787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.919 [2024-11-18 16:16:51.429805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.919 [2024-11-18 16:16:51.429969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.919 [2024-11-18 16:16:51.430193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.919 [2024-11-18 16:16:51.430217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.919 [2024-11-18 16:16:51.430233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.919 [2024-11-18 16:16:51.432502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.919 [2024-11-18 16:16:51.441883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.919 [2024-11-18 16:16:51.442165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.442301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.442329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.919 [2024-11-18 16:16:51.442347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.919 [2024-11-18 16:16:51.442511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.919 [2024-11-18 16:16:51.442710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.919 [2024-11-18 16:16:51.442735] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.919 [2024-11-18 16:16:51.442750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.919 [2024-11-18 16:16:51.445302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.919 [2024-11-18 16:16:51.454404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.919 [2024-11-18 16:16:51.454720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.454819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.454853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.919 [2024-11-18 16:16:51.454872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.919 [2024-11-18 16:16:51.455018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.919 [2024-11-18 16:16:51.455206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.919 [2024-11-18 16:16:51.455229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.919 [2024-11-18 16:16:51.455244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.919 [2024-11-18 16:16:51.457616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.919 [2024-11-18 16:16:51.466872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.919 [2024-11-18 16:16:51.467109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.919 [2024-11-18 16:16:51.467223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.920 [2024-11-18 16:16:51.467254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.920 [2024-11-18 16:16:51.467271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.920 [2024-11-18 16:16:51.467472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.920 [2024-11-18 16:16:51.467605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.920 [2024-11-18 16:16:51.467640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.920 [2024-11-18 16:16:51.467655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.920 [2024-11-18 16:16:51.469929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.920 [2024-11-18 16:16:51.479534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.920 [2024-11-18 16:16:51.479877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.920 [2024-11-18 16:16:51.479984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.920 [2024-11-18 16:16:51.480026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.920 [2024-11-18 16:16:51.480042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.920 [2024-11-18 16:16:51.480204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.920 [2024-11-18 16:16:51.480413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.920 [2024-11-18 16:16:51.480437] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.920 [2024-11-18 16:16:51.480453] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.920 [2024-11-18 16:16:51.482601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:27.920 [2024-11-18 16:16:51.492276] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:27.920 [2024-11-18 16:16:51.492573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.920 [2024-11-18 16:16:51.492701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.920 [2024-11-18 16:16:51.492730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:27.920 [2024-11-18 16:16:51.492755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:27.920 [2024-11-18 16:16:51.492921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:27.920 [2024-11-18 16:16:51.493091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:27.920 [2024-11-18 16:16:51.493115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:27.920 [2024-11-18 16:16:51.493130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:27.920 [2024-11-18 16:16:51.495548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.180 [2024-11-18 16:16:51.505056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.180 [2024-11-18 16:16:51.505394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.180 [2024-11-18 16:16:51.505552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.180 [2024-11-18 16:16:51.505592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.180 [2024-11-18 16:16:51.505636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.180 [2024-11-18 16:16:51.505854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.180 [2024-11-18 16:16:51.506082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.180 [2024-11-18 16:16:51.506115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.180 [2024-11-18 16:16:51.506141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.180 [2024-11-18 16:16:51.509418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.180 [2024-11-18 16:16:51.518463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.180 [2024-11-18 16:16:51.518893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.180 [2024-11-18 16:16:51.519054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.180 [2024-11-18 16:16:51.519094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.180 [2024-11-18 16:16:51.519120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.180 [2024-11-18 16:16:51.519328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.180 [2024-11-18 16:16:51.519495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.180 [2024-11-18 16:16:51.519526] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.180 [2024-11-18 16:16:51.519547] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.180 [2024-11-18 16:16:51.522488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.180 [2024-11-18 16:16:51.531878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.180 [2024-11-18 16:16:51.532284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.180 [2024-11-18 16:16:51.532426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.180 [2024-11-18 16:16:51.532476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.180 [2024-11-18 16:16:51.532500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.180 [2024-11-18 16:16:51.532750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.180 [2024-11-18 16:16:51.532939] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.180 [2024-11-18 16:16:51.532970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.180 [2024-11-18 16:16:51.532993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.180 [2024-11-18 16:16:51.535710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.180 [2024-11-18 16:16:51.545246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.180 [2024-11-18 16:16:51.545600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.180 [2024-11-18 16:16:51.545769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.180 [2024-11-18 16:16:51.545809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.180 [2024-11-18 16:16:51.545836] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.180 [2024-11-18 16:16:51.546066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.180 [2024-11-18 16:16:51.546299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.180 [2024-11-18 16:16:51.546332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.180 [2024-11-18 16:16:51.546356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.180 [2024-11-18 16:16:51.549295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.180 [2024-11-18 16:16:51.558404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.180 [2024-11-18 16:16:51.558818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.180 [2024-11-18 16:16:51.559013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.180 [2024-11-18 16:16:51.559056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.180 [2024-11-18 16:16:51.559088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.180 [2024-11-18 16:16:51.559321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.180 [2024-11-18 16:16:51.559514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.180 [2024-11-18 16:16:51.559549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.180 [2024-11-18 16:16:51.559577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.181 [2024-11-18 16:16:51.562283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.181 [2024-11-18 16:16:51.571333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.181 [2024-11-18 16:16:51.571672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.571822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.571857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.181 [2024-11-18 16:16:51.571882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.181 [2024-11-18 16:16:51.572118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.181 [2024-11-18 16:16:51.572302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.181 [2024-11-18 16:16:51.572331] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.181 [2024-11-18 16:16:51.572351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.181 [2024-11-18 16:16:51.575279] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.181 [2024-11-18 16:16:51.583917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.181 [2024-11-18 16:16:51.584277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.584418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.584452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.181 [2024-11-18 16:16:51.584476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.181 [2024-11-18 16:16:51.584731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.181 [2024-11-18 16:16:51.584947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.181 [2024-11-18 16:16:51.584987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.181 [2024-11-18 16:16:51.585006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.181 [2024-11-18 16:16:51.587431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.181 [2024-11-18 16:16:51.596500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.181 [2024-11-18 16:16:51.596881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.597004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.597038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.181 [2024-11-18 16:16:51.597061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.181 [2024-11-18 16:16:51.597269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.181 [2024-11-18 16:16:51.597453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.181 [2024-11-18 16:16:51.597477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.181 [2024-11-18 16:16:51.597496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.181 [2024-11-18 16:16:51.599928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.181 [2024-11-18 16:16:51.609117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.181 [2024-11-18 16:16:51.609438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.609573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.609618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.181 [2024-11-18 16:16:51.609645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.181 [2024-11-18 16:16:51.609860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.181 [2024-11-18 16:16:51.609976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.181 [2024-11-18 16:16:51.610005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.181 [2024-11-18 16:16:51.610024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.181 [2024-11-18 16:16:51.612364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.181 [2024-11-18 16:16:51.621711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.181 [2024-11-18 16:16:51.622083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.622270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.622304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.181 [2024-11-18 16:16:51.622328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.181 [2024-11-18 16:16:51.622592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.181 [2024-11-18 16:16:51.622842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.181 [2024-11-18 16:16:51.622873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.181 [2024-11-18 16:16:51.622897] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.181 [2024-11-18 16:16:51.625146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.181 [2024-11-18 16:16:51.634237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.181 [2024-11-18 16:16:51.634581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.634744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.634778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.181 [2024-11-18 16:16:51.634802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.181 [2024-11-18 16:16:51.635020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.181 [2024-11-18 16:16:51.635204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.181 [2024-11-18 16:16:51.635229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.181 [2024-11-18 16:16:51.635248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.181 [2024-11-18 16:16:51.637449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.181 [2024-11-18 16:16:51.646849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.181 [2024-11-18 16:16:51.647219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.647407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.647456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.181 [2024-11-18 16:16:51.647481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.181 [2024-11-18 16:16:51.647718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.181 [2024-11-18 16:16:51.647896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.181 [2024-11-18 16:16:51.647922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.181 [2024-11-18 16:16:51.647945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.181 [2024-11-18 16:16:51.650201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.181 [2024-11-18 16:16:51.659353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.181 [2024-11-18 16:16:51.659713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.659866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.181 [2024-11-18 16:16:51.659917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.181 [2024-11-18 16:16:51.659942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.181 [2024-11-18 16:16:51.660160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.181 [2024-11-18 16:16:51.660360] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.181 [2024-11-18 16:16:51.660385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.181 [2024-11-18 16:16:51.660402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.182 [2024-11-18 16:16:51.662744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.182 [2024-11-18 16:16:51.671980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.182 [2024-11-18 16:16:51.672333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.672524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.672559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.182 [2024-11-18 16:16:51.672583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.182 [2024-11-18 16:16:51.672702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.182 [2024-11-18 16:16:51.672920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.182 [2024-11-18 16:16:51.672944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.182 [2024-11-18 16:16:51.672961] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.182 [2024-11-18 16:16:51.675266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.182 [2024-11-18 16:16:51.684651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.182 [2024-11-18 16:16:51.684963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.685113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.685152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.182 [2024-11-18 16:16:51.685195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.182 [2024-11-18 16:16:51.685409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.182 [2024-11-18 16:16:51.685627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.182 [2024-11-18 16:16:51.685671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.182 [2024-11-18 16:16:51.685695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.182 [2024-11-18 16:16:51.688116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.182 [2024-11-18 16:16:51.697339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.182 [2024-11-18 16:16:51.697730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.697876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.697908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.182 [2024-11-18 16:16:51.697931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.182 [2024-11-18 16:16:51.698134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.182 [2024-11-18 16:16:51.698258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.182 [2024-11-18 16:16:51.698281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.182 [2024-11-18 16:16:51.698297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.182 [2024-11-18 16:16:51.700732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.182 [2024-11-18 16:16:51.710072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.182 [2024-11-18 16:16:51.710380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.710529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.710563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.182 [2024-11-18 16:16:51.710588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.182 [2024-11-18 16:16:51.710769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.182 [2024-11-18 16:16:51.710961] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.182 [2024-11-18 16:16:51.711002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.182 [2024-11-18 16:16:51.711019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.182 [2024-11-18 16:16:51.713291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.182 [2024-11-18 16:16:51.722800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.182 [2024-11-18 16:16:51.723173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.723306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.723341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.182 [2024-11-18 16:16:51.723367] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.182 [2024-11-18 16:16:51.723623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.182 [2024-11-18 16:16:51.723840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.182 [2024-11-18 16:16:51.723868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.182 [2024-11-18 16:16:51.723887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.182 [2024-11-18 16:16:51.726137] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.182 [2024-11-18 16:16:51.735347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.182 [2024-11-18 16:16:51.735772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.735908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.735944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.182 [2024-11-18 16:16:51.735968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.182 [2024-11-18 16:16:51.736160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.182 [2024-11-18 16:16:51.736358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.182 [2024-11-18 16:16:51.736383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.182 [2024-11-18 16:16:51.736400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.182 [2024-11-18 16:16:51.738758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.182 [2024-11-18 16:16:51.748014] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.182 [2024-11-18 16:16:51.748342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.748514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.748551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.182 [2024-11-18 16:16:51.748578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.182 [2024-11-18 16:16:51.748774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.182 [2024-11-18 16:16:51.748994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.182 [2024-11-18 16:16:51.749018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.182 [2024-11-18 16:16:51.749035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.182 [2024-11-18 16:16:51.751339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.182 [2024-11-18 16:16:51.760572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.182 [2024-11-18 16:16:51.760999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.761213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.182 [2024-11-18 16:16:51.761247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.182 [2024-11-18 16:16:51.761283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.182 [2024-11-18 16:16:51.761569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.183 [2024-11-18 16:16:51.761820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.183 [2024-11-18 16:16:51.761848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.183 [2024-11-18 16:16:51.761868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.183 [2024-11-18 16:16:51.764189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.442 [2024-11-18 16:16:51.773168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.442 [2024-11-18 16:16:51.773593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.442 [2024-11-18 16:16:51.773760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.442 [2024-11-18 16:16:51.773795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.442 [2024-11-18 16:16:51.773819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.442 [2024-11-18 16:16:51.773990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.442 [2024-11-18 16:16:51.774200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.442 [2024-11-18 16:16:51.774240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.442 [2024-11-18 16:16:51.774259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.442 [2024-11-18 16:16:51.776814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.442 [2024-11-18 16:16:51.785637] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.442 [2024-11-18 16:16:51.785973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.442 [2024-11-18 16:16:51.786133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.786168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.443 [2024-11-18 16:16:51.786191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.443 [2024-11-18 16:16:51.786438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.443 [2024-11-18 16:16:51.786616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.443 [2024-11-18 16:16:51.786657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.443 [2024-11-18 16:16:51.786677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.443 [2024-11-18 16:16:51.789024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.443 [2024-11-18 16:16:51.798195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.443 [2024-11-18 16:16:51.798482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.798671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.798705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.443 [2024-11-18 16:16:51.798729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.443 [2024-11-18 16:16:51.798947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.443 [2024-11-18 16:16:51.799165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.443 [2024-11-18 16:16:51.799191] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.443 [2024-11-18 16:16:51.799209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.443 [2024-11-18 16:16:51.801455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.443 [2024-11-18 16:16:51.810890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.443 [2024-11-18 16:16:51.811218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.811394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.811435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.443 [2024-11-18 16:16:51.811463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.443 [2024-11-18 16:16:51.811686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.443 [2024-11-18 16:16:51.811875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.443 [2024-11-18 16:16:51.811922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.443 [2024-11-18 16:16:51.811941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.443 [2024-11-18 16:16:51.814550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.443 [2024-11-18 16:16:51.823172] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.443 [2024-11-18 16:16:51.823569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.823731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.823767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.443 [2024-11-18 16:16:51.823790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.443 [2024-11-18 16:16:51.823918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.443 [2024-11-18 16:16:51.824172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.443 [2024-11-18 16:16:51.824198] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.443 [2024-11-18 16:16:51.824216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.443 [2024-11-18 16:16:51.826538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.443 [2024-11-18 16:16:51.835840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.443 [2024-11-18 16:16:51.836218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.836391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.836426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.443 [2024-11-18 16:16:51.836450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.443 [2024-11-18 16:16:51.836647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.443 [2024-11-18 16:16:51.836822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.443 [2024-11-18 16:16:51.836850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.443 [2024-11-18 16:16:51.836869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.443 [2024-11-18 16:16:51.839185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.443 [2024-11-18 16:16:51.848166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.443 [2024-11-18 16:16:51.848490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.848660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.848695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.443 [2024-11-18 16:16:51.848725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.443 [2024-11-18 16:16:51.848907] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.443 [2024-11-18 16:16:51.849112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.443 [2024-11-18 16:16:51.849138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.443 [2024-11-18 16:16:51.849157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.443 [2024-11-18 16:16:51.851408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.443 [2024-11-18 16:16:51.860633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.443 [2024-11-18 16:16:51.860984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.861116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.861149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.443 [2024-11-18 16:16:51.861173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.443 [2024-11-18 16:16:51.861408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.443 [2024-11-18 16:16:51.861618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.443 [2024-11-18 16:16:51.861645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.443 [2024-11-18 16:16:51.861678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.443 [2024-11-18 16:16:51.863936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.443 [2024-11-18 16:16:51.873118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.443 [2024-11-18 16:16:51.873502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.873716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.873751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.443 [2024-11-18 16:16:51.873789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.443 [2024-11-18 16:16:51.873915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.443 [2024-11-18 16:16:51.874103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.443 [2024-11-18 16:16:51.874129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.443 [2024-11-18 16:16:51.874146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.443 [2024-11-18 16:16:51.876228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.443 [2024-11-18 16:16:51.885731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.443 [2024-11-18 16:16:51.886146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.886318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.886353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.443 [2024-11-18 16:16:51.886378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.443 [2024-11-18 16:16:51.886593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.443 [2024-11-18 16:16:51.886773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.443 [2024-11-18 16:16:51.886799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.443 [2024-11-18 16:16:51.886819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.443 [2024-11-18 16:16:51.889219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.443 [2024-11-18 16:16:51.898230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.443 [2024-11-18 16:16:51.898584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.898778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.443 [2024-11-18 16:16:51.898827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.443 [2024-11-18 16:16:51.898851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.444 [2024-11-18 16:16:51.899088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.444 [2024-11-18 16:16:51.899293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.444 [2024-11-18 16:16:51.899320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.444 [2024-11-18 16:16:51.899337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.444 [2024-11-18 16:16:51.901822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.444 [2024-11-18 16:16:51.910724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.444 [2024-11-18 16:16:51.911064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.911251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.911286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.444 [2024-11-18 16:16:51.911324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.444 [2024-11-18 16:16:51.911587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.444 [2024-11-18 16:16:51.911793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.444 [2024-11-18 16:16:51.911820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.444 [2024-11-18 16:16:51.911838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.444 [2024-11-18 16:16:51.914138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.444 [2024-11-18 16:16:51.923357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.444 [2024-11-18 16:16:51.923661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.923851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.923887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.444 [2024-11-18 16:16:51.923915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.444 [2024-11-18 16:16:51.924088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.444 [2024-11-18 16:16:51.924262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.444 [2024-11-18 16:16:51.924288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.444 [2024-11-18 16:16:51.924306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.444 [2024-11-18 16:16:51.926722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.444 [2024-11-18 16:16:51.935998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.444 [2024-11-18 16:16:51.936345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.936489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.936523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.444 [2024-11-18 16:16:51.936548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.444 [2024-11-18 16:16:51.936770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.444 [2024-11-18 16:16:51.936976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.444 [2024-11-18 16:16:51.937000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.444 [2024-11-18 16:16:51.937016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.444 [2024-11-18 16:16:51.939319] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.444 [2024-11-18 16:16:51.948401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.444 [2024-11-18 16:16:51.948748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.948856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.948889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.444 [2024-11-18 16:16:51.948911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.444 [2024-11-18 16:16:51.949131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.444 [2024-11-18 16:16:51.949249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.444 [2024-11-18 16:16:51.949274] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.444 [2024-11-18 16:16:51.949292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.444 [2024-11-18 16:16:51.951420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.444 [2024-11-18 16:16:51.960926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.444 [2024-11-18 16:16:51.961269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.961457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.961492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.444 [2024-11-18 16:16:51.961516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.444 [2024-11-18 16:16:51.961718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.444 [2024-11-18 16:16:51.961860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.444 [2024-11-18 16:16:51.961900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.444 [2024-11-18 16:16:51.961925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.444 [2024-11-18 16:16:51.964435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.444 [2024-11-18 16:16:51.973393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.444 [2024-11-18 16:16:51.973764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.973906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.973940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.444 [2024-11-18 16:16:51.973964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.444 [2024-11-18 16:16:51.974111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.444 [2024-11-18 16:16:51.974296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.444 [2024-11-18 16:16:51.974321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.444 [2024-11-18 16:16:51.974341] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.444 [2024-11-18 16:16:51.976786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.444 [2024-11-18 16:16:51.985775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.444 [2024-11-18 16:16:51.986150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.986291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.986325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.444 [2024-11-18 16:16:51.986350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.444 [2024-11-18 16:16:51.986557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.444 [2024-11-18 16:16:51.986771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.444 [2024-11-18 16:16:51.986799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.444 [2024-11-18 16:16:51.986818] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.444 [2024-11-18 16:16:51.989087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.444 [2024-11-18 16:16:51.998397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.444 [2024-11-18 16:16:51.998762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.998905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:51.998940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.444 [2024-11-18 16:16:51.998967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.444 [2024-11-18 16:16:51.999195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.444 [2024-11-18 16:16:51.999362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.444 [2024-11-18 16:16:51.999387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.444 [2024-11-18 16:16:51.999405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.444 [2024-11-18 16:16:52.001772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.444 [2024-11-18 16:16:52.011097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.444 [2024-11-18 16:16:52.011483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:52.011649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.444 [2024-11-18 16:16:52.011684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.444 [2024-11-18 16:16:52.011710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.444 [2024-11-18 16:16:52.011870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.444 [2024-11-18 16:16:52.012089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.445 [2024-11-18 16:16:52.012113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.445 [2024-11-18 16:16:52.012130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.445 [2024-11-18 16:16:52.014496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.445 [2024-11-18 16:16:52.023881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.445 [2024-11-18 16:16:52.024226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.445 [2024-11-18 16:16:52.024368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.445 [2024-11-18 16:16:52.024407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.445 [2024-11-18 16:16:52.024437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.445 [2024-11-18 16:16:52.024668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.445 [2024-11-18 16:16:52.024896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.445 [2024-11-18 16:16:52.024941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.445 [2024-11-18 16:16:52.024965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.445 [2024-11-18 16:16:52.027421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.706 [2024-11-18 16:16:52.036585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.706 [2024-11-18 16:16:52.036926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.037068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.037103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.706 [2024-11-18 16:16:52.037126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.706 [2024-11-18 16:16:52.037291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.706 [2024-11-18 16:16:52.037511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.706 [2024-11-18 16:16:52.037537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.706 [2024-11-18 16:16:52.037555] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.706 [2024-11-18 16:16:52.039947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.706 [2024-11-18 16:16:52.049148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.706 [2024-11-18 16:16:52.049521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.049714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.049750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.706 [2024-11-18 16:16:52.049774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.706 [2024-11-18 16:16:52.050004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.706 [2024-11-18 16:16:52.050188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.706 [2024-11-18 16:16:52.050213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.706 [2024-11-18 16:16:52.050231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.706 [2024-11-18 16:16:52.052384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.706 [2024-11-18 16:16:52.061895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.706 [2024-11-18 16:16:52.062320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.062430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.062464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.706 [2024-11-18 16:16:52.062486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.706 [2024-11-18 16:16:52.062662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.706 [2024-11-18 16:16:52.062856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.706 [2024-11-18 16:16:52.062887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.706 [2024-11-18 16:16:52.062910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.706 [2024-11-18 16:16:52.065816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.706 [2024-11-18 16:16:52.074551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.706 [2024-11-18 16:16:52.074886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.075104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.075134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.706 [2024-11-18 16:16:52.075168] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.706 [2024-11-18 16:16:52.075355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.706 [2024-11-18 16:16:52.075507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.706 [2024-11-18 16:16:52.075533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.706 [2024-11-18 16:16:52.075554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.706 [2024-11-18 16:16:52.078056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.706 [2024-11-18 16:16:52.087302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.706 [2024-11-18 16:16:52.087602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.087772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.087812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.706 [2024-11-18 16:16:52.087840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.706 [2024-11-18 16:16:52.088058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.706 [2024-11-18 16:16:52.088248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.706 [2024-11-18 16:16:52.088275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.706 [2024-11-18 16:16:52.088296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.706 [2024-11-18 16:16:52.090687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.706 [2024-11-18 16:16:52.100032] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.706 [2024-11-18 16:16:52.100370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.100501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.706 [2024-11-18 16:16:52.100534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.706 [2024-11-18 16:16:52.100559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.706 [2024-11-18 16:16:52.100752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.706 [2024-11-18 16:16:52.101003] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.706 [2024-11-18 16:16:52.101030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.707 [2024-11-18 16:16:52.101048] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.707 [2024-11-18 16:16:52.103313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.707 [2024-11-18 16:16:52.112509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.707 [2024-11-18 16:16:52.112903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.113065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.113101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.707 [2024-11-18 16:16:52.113125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.707 [2024-11-18 16:16:52.113374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.707 [2024-11-18 16:16:52.113522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.707 [2024-11-18 16:16:52.113547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.707 [2024-11-18 16:16:52.113564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.707 [2024-11-18 16:16:52.115952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.707 [2024-11-18 16:16:52.124896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.707 [2024-11-18 16:16:52.125249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.125381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.125421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.707 [2024-11-18 16:16:52.125447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.707 [2024-11-18 16:16:52.125704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.707 [2024-11-18 16:16:52.125938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.707 [2024-11-18 16:16:52.125980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.707 [2024-11-18 16:16:52.125999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.707 [2024-11-18 16:16:52.128291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.707 [2024-11-18 16:16:52.137287] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.707 [2024-11-18 16:16:52.137711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.137830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.137865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.707 [2024-11-18 16:16:52.137889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.707 [2024-11-18 16:16:52.138149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.707 [2024-11-18 16:16:52.138315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.707 [2024-11-18 16:16:52.138340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.707 [2024-11-18 16:16:52.138357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.707 [2024-11-18 16:16:52.140874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.707 [2024-11-18 16:16:52.150073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.707 [2024-11-18 16:16:52.150433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.150626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.150662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.707 [2024-11-18 16:16:52.150685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.707 [2024-11-18 16:16:52.150946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.707 [2024-11-18 16:16:52.151117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.707 [2024-11-18 16:16:52.151143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.707 [2024-11-18 16:16:52.151161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.707 [2024-11-18 16:16:52.153404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.707 [2024-11-18 16:16:52.162711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.707 [2024-11-18 16:16:52.163062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.163260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.163295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.707 [2024-11-18 16:16:52.163325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.707 [2024-11-18 16:16:52.163618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.707 [2024-11-18 16:16:52.163842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.707 [2024-11-18 16:16:52.163869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.707 [2024-11-18 16:16:52.163887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.707 [2024-11-18 16:16:52.166282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.707 [2024-11-18 16:16:52.175294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.707 [2024-11-18 16:16:52.175653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.175824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.175858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.707 [2024-11-18 16:16:52.175883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.707 [2024-11-18 16:16:52.176065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.707 [2024-11-18 16:16:52.176220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.707 [2024-11-18 16:16:52.176243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.707 [2024-11-18 16:16:52.176259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.707 [2024-11-18 16:16:52.178724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.707 [2024-11-18 16:16:52.187762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.707 [2024-11-18 16:16:52.188139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.188320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.188355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.707 [2024-11-18 16:16:52.188379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.707 [2024-11-18 16:16:52.188617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.707 [2024-11-18 16:16:52.188825] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.707 [2024-11-18 16:16:52.188851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.707 [2024-11-18 16:16:52.188871] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.707 [2024-11-18 16:16:52.191211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.707 [2024-11-18 16:16:52.200330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.707 [2024-11-18 16:16:52.200702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.200880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.200914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.707 [2024-11-18 16:16:52.200938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.707 [2024-11-18 16:16:52.201180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.707 [2024-11-18 16:16:52.201350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.707 [2024-11-18 16:16:52.201374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.707 [2024-11-18 16:16:52.201389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.707 [2024-11-18 16:16:52.203791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.707 [2024-11-18 16:16:52.213000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.707 [2024-11-18 16:16:52.213364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.213557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.707 [2024-11-18 16:16:52.213616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.707 [2024-11-18 16:16:52.213656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.707 [2024-11-18 16:16:52.213840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.707 [2024-11-18 16:16:52.214027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.707 [2024-11-18 16:16:52.214052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.707 [2024-11-18 16:16:52.214071] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.707 [2024-11-18 16:16:52.216220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.707 [2024-11-18 16:16:52.225541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.707 [2024-11-18 16:16:52.225926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.226058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.226091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.708 [2024-11-18 16:16:52.226113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.708 [2024-11-18 16:16:52.226277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.708 [2024-11-18 16:16:52.226482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.708 [2024-11-18 16:16:52.226507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.708 [2024-11-18 16:16:52.226526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.708 [2024-11-18 16:16:52.228802] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.708 [2024-11-18 16:16:52.238377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.708 [2024-11-18 16:16:52.238670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.238809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.238842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.708 [2024-11-18 16:16:52.238865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.708 [2024-11-18 16:16:52.239080] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.708 [2024-11-18 16:16:52.239234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.708 [2024-11-18 16:16:52.239260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.708 [2024-11-18 16:16:52.239277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.708 [2024-11-18 16:16:52.241812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.708 [2024-11-18 16:16:52.250980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.708 [2024-11-18 16:16:52.251376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.251521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.251555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.708 [2024-11-18 16:16:52.251583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.708 [2024-11-18 16:16:52.251787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.708 [2024-11-18 16:16:52.251993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.708 [2024-11-18 16:16:52.252019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.708 [2024-11-18 16:16:52.252036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.708 [2024-11-18 16:16:52.254322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.708 [2024-11-18 16:16:52.263449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.708 [2024-11-18 16:16:52.263793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.264001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.264036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.708 [2024-11-18 16:16:52.264074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.708 [2024-11-18 16:16:52.264295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.708 [2024-11-18 16:16:52.264442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.708 [2024-11-18 16:16:52.264467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.708 [2024-11-18 16:16:52.264486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.708 [2024-11-18 16:16:52.266715] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.708 [2024-11-18 16:16:52.276073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.708 [2024-11-18 16:16:52.276488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.276654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.276690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.708 [2024-11-18 16:16:52.276714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.708 [2024-11-18 16:16:52.276931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.708 [2024-11-18 16:16:52.277112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.708 [2024-11-18 16:16:52.277147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.708 [2024-11-18 16:16:52.277166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.708 [2024-11-18 16:16:52.279426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:28.708 [2024-11-18 16:16:52.288540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:28.708 [2024-11-18 16:16:52.288912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.289023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.708 [2024-11-18 16:16:52.289058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:28.708 [2024-11-18 16:16:52.289082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:28.708 [2024-11-18 16:16:52.289302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:28.708 [2024-11-18 16:16:52.289502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:28.708 [2024-11-18 16:16:52.289528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:28.708 [2024-11-18 16:16:52.289546] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:28.708 [2024-11-18 16:16:52.292224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.020 [2024-11-18 16:16:52.301705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.020 [2024-11-18 16:16:52.302048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.302192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.302231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.020 [2024-11-18 16:16:52.302257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.020 [2024-11-18 16:16:52.302487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.020 [2024-11-18 16:16:52.302743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.020 [2024-11-18 16:16:52.302790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.020 [2024-11-18 16:16:52.302815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.020 [2024-11-18 16:16:52.305477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.020 [2024-11-18 16:16:52.314646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.020 [2024-11-18 16:16:52.315020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.315160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.315195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.020 [2024-11-18 16:16:52.315218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.020 [2024-11-18 16:16:52.315436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.020 [2024-11-18 16:16:52.315640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.020 [2024-11-18 16:16:52.315675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.020 [2024-11-18 16:16:52.315702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.020 [2024-11-18 16:16:52.318390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.020 [2024-11-18 16:16:52.327322] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.020 [2024-11-18 16:16:52.327641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.327756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.327789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.020 [2024-11-18 16:16:52.327814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.020 [2024-11-18 16:16:52.328043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.020 [2024-11-18 16:16:52.328195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.020 [2024-11-18 16:16:52.328221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.020 [2024-11-18 16:16:52.328240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.020 [2024-11-18 16:16:52.330392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.020 [2024-11-18 16:16:52.340003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.020 [2024-11-18 16:16:52.340316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.340454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.340488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.020 [2024-11-18 16:16:52.340511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.020 [2024-11-18 16:16:52.340770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.020 [2024-11-18 16:16:52.341016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.020 [2024-11-18 16:16:52.341043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.020 [2024-11-18 16:16:52.341062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.020 [2024-11-18 16:16:52.343385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.020 [2024-11-18 16:16:52.352582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.020 [2024-11-18 16:16:52.352914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.353107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.353149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.020 [2024-11-18 16:16:52.353174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.020 [2024-11-18 16:16:52.353425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.020 [2024-11-18 16:16:52.353685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.020 [2024-11-18 16:16:52.353714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.020 [2024-11-18 16:16:52.353735] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.020 [2024-11-18 16:16:52.356100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.020 [2024-11-18 16:16:52.365134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.020 [2024-11-18 16:16:52.365507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.365650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.365685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.020 [2024-11-18 16:16:52.365708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.020 [2024-11-18 16:16:52.365883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.020 [2024-11-18 16:16:52.366111] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.020 [2024-11-18 16:16:52.366138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.020 [2024-11-18 16:16:52.366160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.020 [2024-11-18 16:16:52.368732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.020 [2024-11-18 16:16:52.377656] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.020 [2024-11-18 16:16:52.378085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.378207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.020 [2024-11-18 16:16:52.378243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.020 [2024-11-18 16:16:52.378268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.021 [2024-11-18 16:16:52.378449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.021 [2024-11-18 16:16:52.378596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.021 [2024-11-18 16:16:52.378645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.021 [2024-11-18 16:16:52.378665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.021 [2024-11-18 16:16:52.380903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.021 [2024-11-18 16:16:52.390270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.021 [2024-11-18 16:16:52.390591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.390771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.390805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.021 [2024-11-18 16:16:52.390828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.021 [2024-11-18 16:16:52.391033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.021 [2024-11-18 16:16:52.391233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.021 [2024-11-18 16:16:52.391257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.021 [2024-11-18 16:16:52.391273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.021 [2024-11-18 16:16:52.393694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.021 [2024-11-18 16:16:52.402959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.021 [2024-11-18 16:16:52.403298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.403407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.403440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.021 [2024-11-18 16:16:52.403463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.021 [2024-11-18 16:16:52.403719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.021 [2024-11-18 16:16:52.403867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.021 [2024-11-18 16:16:52.403895] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.021 [2024-11-18 16:16:52.403929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.021 [2024-11-18 16:16:52.406101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.021 [2024-11-18 16:16:52.415552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.021 [2024-11-18 16:16:52.415893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.416068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.416100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.021 [2024-11-18 16:16:52.416121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.021 [2024-11-18 16:16:52.416337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.021 [2024-11-18 16:16:52.416538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.021 [2024-11-18 16:16:52.416563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.021 [2024-11-18 16:16:52.416582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.021 [2024-11-18 16:16:52.418922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.021 [2024-11-18 16:16:52.428347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.021 [2024-11-18 16:16:52.428638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.428821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.428861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.021 [2024-11-18 16:16:52.428889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.021 [2024-11-18 16:16:52.429084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.021 [2024-11-18 16:16:52.429278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.021 [2024-11-18 16:16:52.429306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.021 [2024-11-18 16:16:52.429324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.021 [2024-11-18 16:16:52.431774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.021 [2024-11-18 16:16:52.441027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.021 [2024-11-18 16:16:52.441397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.441548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.441580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.021 [2024-11-18 16:16:52.441602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.021 [2024-11-18 16:16:52.441804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.021 [2024-11-18 16:16:52.442005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.021 [2024-11-18 16:16:52.442032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.021 [2024-11-18 16:16:52.442052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.021 [2024-11-18 16:16:52.444387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.021 [2024-11-18 16:16:52.453448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.021 [2024-11-18 16:16:52.453736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.453873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.453906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.021 [2024-11-18 16:16:52.453928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.021 [2024-11-18 16:16:52.454104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.021 [2024-11-18 16:16:52.454252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.021 [2024-11-18 16:16:52.454277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.021 [2024-11-18 16:16:52.454296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.021 [2024-11-18 16:16:52.456563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.021 [2024-11-18 16:16:52.466056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.021 [2024-11-18 16:16:52.466380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.466523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.466556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.021 [2024-11-18 16:16:52.466576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.021 [2024-11-18 16:16:52.466775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.021 [2024-11-18 16:16:52.466980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.021 [2024-11-18 16:16:52.467006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.021 [2024-11-18 16:16:52.467029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.021 [2024-11-18 16:16:52.469534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.021 [2024-11-18 16:16:52.478380] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.021 [2024-11-18 16:16:52.478805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.478941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.478981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.021 [2024-11-18 16:16:52.479005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.021 [2024-11-18 16:16:52.479250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.021 [2024-11-18 16:16:52.479399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.021 [2024-11-18 16:16:52.479425] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.021 [2024-11-18 16:16:52.479444] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.021 [2024-11-18 16:16:52.481748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.021 [2024-11-18 16:16:52.491046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.021 [2024-11-18 16:16:52.491394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.021 [2024-11-18 16:16:52.491543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.491576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.022 [2024-11-18 16:16:52.491626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.022 [2024-11-18 16:16:52.491809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.022 [2024-11-18 16:16:52.492047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.022 [2024-11-18 16:16:52.492072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.022 [2024-11-18 16:16:52.492091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.022 [2024-11-18 16:16:52.494306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.022 [2024-11-18 16:16:52.503677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.022 [2024-11-18 16:16:52.504098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.504238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.504272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.022 [2024-11-18 16:16:52.504295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.022 [2024-11-18 16:16:52.504487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.022 [2024-11-18 16:16:52.504694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.022 [2024-11-18 16:16:52.504722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.022 [2024-11-18 16:16:52.504741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.022 [2024-11-18 16:16:52.507065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.022 [2024-11-18 16:16:52.516044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.022 [2024-11-18 16:16:52.516431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.516576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.516621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.022 [2024-11-18 16:16:52.516657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.022 [2024-11-18 16:16:52.516815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.022 [2024-11-18 16:16:52.516993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.022 [2024-11-18 16:16:52.517017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.022 [2024-11-18 16:16:52.517032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.022 [2024-11-18 16:16:52.519305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.022 [2024-11-18 16:16:52.528443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.022 [2024-11-18 16:16:52.528841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.528976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.529011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.022 [2024-11-18 16:16:52.529034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.022 [2024-11-18 16:16:52.529211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.022 [2024-11-18 16:16:52.529408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.022 [2024-11-18 16:16:52.529433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.022 [2024-11-18 16:16:52.529451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.022 [2024-11-18 16:16:52.531945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.022 [2024-11-18 16:16:52.541019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.022 [2024-11-18 16:16:52.541396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.541536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.541569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.022 [2024-11-18 16:16:52.541595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.022 [2024-11-18 16:16:52.541748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.022 [2024-11-18 16:16:52.541969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.022 [2024-11-18 16:16:52.541992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.022 [2024-11-18 16:16:52.542008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.022 [2024-11-18 16:16:52.544301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.022 [2024-11-18 16:16:52.553681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.022 [2024-11-18 16:16:52.554063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.554257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.554291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.022 [2024-11-18 16:16:52.554330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.022 [2024-11-18 16:16:52.554571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.022 [2024-11-18 16:16:52.554769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.022 [2024-11-18 16:16:52.554797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.022 [2024-11-18 16:16:52.554816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.022 [2024-11-18 16:16:52.557150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.022 [2024-11-18 16:16:52.566139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.022 [2024-11-18 16:16:52.566511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.566648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.566684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.022 [2024-11-18 16:16:52.566708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.022 [2024-11-18 16:16:52.566951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.022 [2024-11-18 16:16:52.567124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.022 [2024-11-18 16:16:52.567152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.022 [2024-11-18 16:16:52.567171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.022 [2024-11-18 16:16:52.569920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.022 [2024-11-18 16:16:52.579141] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.022 [2024-11-18 16:16:52.579500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.579638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.022 [2024-11-18 16:16:52.579673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.022 [2024-11-18 16:16:52.579697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.022 [2024-11-18 16:16:52.579907] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.022 [2024-11-18 16:16:52.580060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.022 [2024-11-18 16:16:52.580090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.022 [2024-11-18 16:16:52.580112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.022 [2024-11-18 16:16:52.582709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.305 [2024-11-18 16:16:52.592005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.305 [2024-11-18 16:16:52.592372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.305 [2024-11-18 16:16:52.592492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.305 [2024-11-18 16:16:52.592527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.305 [2024-11-18 16:16:52.592551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.305 [2024-11-18 16:16:52.592730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.305 [2024-11-18 16:16:52.592905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.305 [2024-11-18 16:16:52.592934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.305 [2024-11-18 16:16:52.592954] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.305 [2024-11-18 16:16:52.595757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.305 [2024-11-18 16:16:52.604909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.305 [2024-11-18 16:16:52.605258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.305 [2024-11-18 16:16:52.605405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.305 [2024-11-18 16:16:52.605440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.305 [2024-11-18 16:16:52.605479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.305 [2024-11-18 16:16:52.605642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.305 [2024-11-18 16:16:52.605810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.305 [2024-11-18 16:16:52.605839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.305 [2024-11-18 16:16:52.605859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.305 [2024-11-18 16:16:52.608103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.306 [2024-11-18 16:16:52.617700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.306 [2024-11-18 16:16:52.618136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.618325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.618360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.306 [2024-11-18 16:16:52.618382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.306 [2024-11-18 16:16:52.618561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.306 [2024-11-18 16:16:52.618799] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.306 [2024-11-18 16:16:52.618827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.306 [2024-11-18 16:16:52.618846] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.306 [2024-11-18 16:16:52.621220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.306 [2024-11-18 16:16:52.630389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.306 [2024-11-18 16:16:52.630775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.630945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.630980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.306 [2024-11-18 16:16:52.631006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.306 [2024-11-18 16:16:52.631233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.306 [2024-11-18 16:16:52.631402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.306 [2024-11-18 16:16:52.631428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.306 [2024-11-18 16:16:52.631453] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.306 [2024-11-18 16:16:52.633815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.306 [2024-11-18 16:16:52.643013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.306 [2024-11-18 16:16:52.643354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.643467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.643502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.306 [2024-11-18 16:16:52.643525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.306 [2024-11-18 16:16:52.643723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.306 [2024-11-18 16:16:52.643914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.306 [2024-11-18 16:16:52.643939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.306 [2024-11-18 16:16:52.643955] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.306 [2024-11-18 16:16:52.646142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.306 [2024-11-18 16:16:52.655791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.306 [2024-11-18 16:16:52.656097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.656289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.656324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.306 [2024-11-18 16:16:52.656350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.306 [2024-11-18 16:16:52.656576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.306 [2024-11-18 16:16:52.656788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.306 [2024-11-18 16:16:52.656814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.306 [2024-11-18 16:16:52.656832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.306 [2024-11-18 16:16:52.659217] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.306 [2024-11-18 16:16:52.668401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.306 [2024-11-18 16:16:52.668814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.669003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.669037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.306 [2024-11-18 16:16:52.669062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.306 [2024-11-18 16:16:52.669235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.306 [2024-11-18 16:16:52.669425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.306 [2024-11-18 16:16:52.669452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.306 [2024-11-18 16:16:52.669477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.306 [2024-11-18 16:16:52.671720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.306 [2024-11-18 16:16:52.680556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.306 [2024-11-18 16:16:52.680838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.680991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.681016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.306 [2024-11-18 16:16:52.681032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.306 [2024-11-18 16:16:52.681164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.306 [2024-11-18 16:16:52.681375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.306 [2024-11-18 16:16:52.681395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.306 [2024-11-18 16:16:52.681408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.306 [2024-11-18 16:16:52.683544] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.306 [2024-11-18 16:16:52.692817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.306 [2024-11-18 16:16:52.693144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.693298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.693324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.306 [2024-11-18 16:16:52.693340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.306 [2024-11-18 16:16:52.693505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.306 [2024-11-18 16:16:52.693712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.306 [2024-11-18 16:16:52.693734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.306 [2024-11-18 16:16:52.693747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.306 [2024-11-18 16:16:52.695660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.306 [2024-11-18 16:16:52.705144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.306 [2024-11-18 16:16:52.705476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.705634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.705665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.306 [2024-11-18 16:16:52.705681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.306 [2024-11-18 16:16:52.705889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.306 [2024-11-18 16:16:52.706074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.306 [2024-11-18 16:16:52.706093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.306 [2024-11-18 16:16:52.706105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.306 [2024-11-18 16:16:52.708072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.306 [2024-11-18 16:16:52.717354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.306 [2024-11-18 16:16:52.717639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.717764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.306 [2024-11-18 16:16:52.717790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.306 [2024-11-18 16:16:52.717806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.306 [2024-11-18 16:16:52.717938] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.306 [2024-11-18 16:16:52.718142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.306 [2024-11-18 16:16:52.718162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.306 [2024-11-18 16:16:52.718174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.306 [2024-11-18 16:16:52.720096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.307 [2024-11-18 16:16:52.729394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.307 [2024-11-18 16:16:52.729687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.729805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.729830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.307 [2024-11-18 16:16:52.729846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.307 [2024-11-18 16:16:52.729980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.307 [2024-11-18 16:16:52.730181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.307 [2024-11-18 16:16:52.730216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.307 [2024-11-18 16:16:52.730229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.307 [2024-11-18 16:16:52.732356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.307 [2024-11-18 16:16:52.741576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.307 [2024-11-18 16:16:52.741920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.742069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.742095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.307 [2024-11-18 16:16:52.742111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.307 [2024-11-18 16:16:52.742243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.307 [2024-11-18 16:16:52.742417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.307 [2024-11-18 16:16:52.742437] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.307 [2024-11-18 16:16:52.742450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.307 [2024-11-18 16:16:52.744394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.307 [2024-11-18 16:16:52.753601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.307 [2024-11-18 16:16:52.753902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.754084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.754110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.307 [2024-11-18 16:16:52.754126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.307 [2024-11-18 16:16:52.754273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.307 [2024-11-18 16:16:52.754417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.307 [2024-11-18 16:16:52.754436] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.307 [2024-11-18 16:16:52.754448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.307 [2024-11-18 16:16:52.756396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.307 [2024-11-18 16:16:52.765722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.307 [2024-11-18 16:16:52.766102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.766199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.766225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.307 [2024-11-18 16:16:52.766241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.307 [2024-11-18 16:16:52.766388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.307 [2024-11-18 16:16:52.766517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.307 [2024-11-18 16:16:52.766536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.307 [2024-11-18 16:16:52.766548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.307 [2024-11-18 16:16:52.768595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.307 [2024-11-18 16:16:52.777777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.307 [2024-11-18 16:16:52.778079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.778232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.778257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.307 [2024-11-18 16:16:52.778273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.307 [2024-11-18 16:16:52.778434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.307 [2024-11-18 16:16:52.778591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.307 [2024-11-18 16:16:52.778633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.307 [2024-11-18 16:16:52.778649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.307 [2024-11-18 16:16:52.780636] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.307 [2024-11-18 16:16:52.790071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.307 [2024-11-18 16:16:52.790404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.790526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.790551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.307 [2024-11-18 16:16:52.790567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.307 [2024-11-18 16:16:52.790692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.307 [2024-11-18 16:16:52.790875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.307 [2024-11-18 16:16:52.790896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.307 [2024-11-18 16:16:52.790927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.307 [2024-11-18 16:16:52.793005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.307 [2024-11-18 16:16:52.802207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.307 [2024-11-18 16:16:52.802458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.802585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.802618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.307 [2024-11-18 16:16:52.802636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.307 [2024-11-18 16:16:52.802782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.307 [2024-11-18 16:16:52.802913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.307 [2024-11-18 16:16:52.802933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.307 [2024-11-18 16:16:52.802960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.307 [2024-11-18 16:16:52.804952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.307 [2024-11-18 16:16:52.814245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.307 [2024-11-18 16:16:52.814636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.814761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.814788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.307 [2024-11-18 16:16:52.814803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.307 [2024-11-18 16:16:52.814952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.307 [2024-11-18 16:16:52.815104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.307 [2024-11-18 16:16:52.815126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.307 [2024-11-18 16:16:52.815139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.307 [2024-11-18 16:16:52.817265] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.307 [2024-11-18 16:16:52.826663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.307 [2024-11-18 16:16:52.826998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.827120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.827145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.307 [2024-11-18 16:16:52.827166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.307 [2024-11-18 16:16:52.827298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.307 [2024-11-18 16:16:52.827457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.307 [2024-11-18 16:16:52.827477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.307 [2024-11-18 16:16:52.827489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.307 [2024-11-18 16:16:52.829618] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.307 [2024-11-18 16:16:52.838873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.307 [2024-11-18 16:16:52.839182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.307 [2024-11-18 16:16:52.839298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.308 [2024-11-18 16:16:52.839324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.308 [2024-11-18 16:16:52.839340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.308 [2024-11-18 16:16:52.839519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.308 [2024-11-18 16:16:52.839702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.308 [2024-11-18 16:16:52.839723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.308 [2024-11-18 16:16:52.839735] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.308 [2024-11-18 16:16:52.841684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.308 [2024-11-18 16:16:52.851186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.308 [2024-11-18 16:16:52.851443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.308 [2024-11-18 16:16:52.851537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.308 [2024-11-18 16:16:52.851562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.308 [2024-11-18 16:16:52.851578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.308 [2024-11-18 16:16:52.851734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.308 [2024-11-18 16:16:52.851913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.308 [2024-11-18 16:16:52.851933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.308 [2024-11-18 16:16:52.851946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.308 [2024-11-18 16:16:52.853984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.308 [2024-11-18 16:16:52.863334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.308 [2024-11-18 16:16:52.863604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.308 [2024-11-18 16:16:52.863726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.308 [2024-11-18 16:16:52.863751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.308 [2024-11-18 16:16:52.863767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.308 [2024-11-18 16:16:52.863908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.308 [2024-11-18 16:16:52.864089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.308 [2024-11-18 16:16:52.864109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.308 [2024-11-18 16:16:52.864121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.308 [2024-11-18 16:16:52.865926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.308 [2024-11-18 16:16:52.875533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.308 [2024-11-18 16:16:52.875892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.308 [2024-11-18 16:16:52.876038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.308 [2024-11-18 16:16:52.876064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.308 [2024-11-18 16:16:52.876081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.308 [2024-11-18 16:16:52.876244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.308 [2024-11-18 16:16:52.876372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.308 [2024-11-18 16:16:52.876392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.308 [2024-11-18 16:16:52.876405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.308 [2024-11-18 16:16:52.878243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.308 [2024-11-18 16:16:52.887685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.308 [2024-11-18 16:16:52.888067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.308 [2024-11-18 16:16:52.888196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.308 [2024-11-18 16:16:52.888222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.308 [2024-11-18 16:16:52.888239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.308 [2024-11-18 16:16:52.888432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.308 [2024-11-18 16:16:52.888674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.308 [2024-11-18 16:16:52.888696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.308 [2024-11-18 16:16:52.888710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.308 [2024-11-18 16:16:52.891016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.568 [2024-11-18 16:16:52.900000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.568 [2024-11-18 16:16:52.900354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.900482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.900509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.568 [2024-11-18 16:16:52.900526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.568 [2024-11-18 16:16:52.900718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.568 [2024-11-18 16:16:52.900869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.568 [2024-11-18 16:16:52.900890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.568 [2024-11-18 16:16:52.900904] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.568 [2024-11-18 16:16:52.903072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.568 [2024-11-18 16:16:52.912168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.568 [2024-11-18 16:16:52.912448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.912575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.912600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.568 [2024-11-18 16:16:52.912626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.568 [2024-11-18 16:16:52.912776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.568 [2024-11-18 16:16:52.912969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.568 [2024-11-18 16:16:52.912989] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.568 [2024-11-18 16:16:52.913002] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.568 [2024-11-18 16:16:52.914907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.568 [2024-11-18 16:16:52.924288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.568 [2024-11-18 16:16:52.924602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.924739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.924765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.568 [2024-11-18 16:16:52.924781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.568 [2024-11-18 16:16:52.924976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.568 [2024-11-18 16:16:52.925149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.568 [2024-11-18 16:16:52.925169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.568 [2024-11-18 16:16:52.925182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.568 [2024-11-18 16:16:52.927200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.568 [2024-11-18 16:16:52.936371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.568 [2024-11-18 16:16:52.936672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.936809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.936835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.568 [2024-11-18 16:16:52.936851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.568 [2024-11-18 16:16:52.936983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.568 [2024-11-18 16:16:52.937113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.568 [2024-11-18 16:16:52.937163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.568 [2024-11-18 16:16:52.937177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.568 [2024-11-18 16:16:52.939025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.568 [2024-11-18 16:16:52.948502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.568 [2024-11-18 16:16:52.948799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.948924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.948950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.568 [2024-11-18 16:16:52.948966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.568 [2024-11-18 16:16:52.949067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.568 [2024-11-18 16:16:52.949236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.568 [2024-11-18 16:16:52.949270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.568 [2024-11-18 16:16:52.949282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.568 [2024-11-18 16:16:52.951258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.568 [2024-11-18 16:16:52.960583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.568 [2024-11-18 16:16:52.960895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.961048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.961074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.568 [2024-11-18 16:16:52.961090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.568 [2024-11-18 16:16:52.961239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.568 [2024-11-18 16:16:52.961399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.568 [2024-11-18 16:16:52.961418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.568 [2024-11-18 16:16:52.961430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.568 [2024-11-18 16:16:52.963436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.568 [2024-11-18 16:16:52.972847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.568 [2024-11-18 16:16:52.973190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.973362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.568 [2024-11-18 16:16:52.973387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.568 [2024-11-18 16:16:52.973404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.568 [2024-11-18 16:16:52.973580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.568 [2024-11-18 16:16:52.973767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.569 [2024-11-18 16:16:52.973788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.569 [2024-11-18 16:16:52.973818] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.569 [2024-11-18 16:16:52.975797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.569 [2024-11-18 16:16:52.984811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.569 [2024-11-18 16:16:52.985110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:52.985285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:52.985310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.569 [2024-11-18 16:16:52.985327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.569 [2024-11-18 16:16:52.985519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.569 [2024-11-18 16:16:52.985713] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.569 [2024-11-18 16:16:52.985734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.569 [2024-11-18 16:16:52.985747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.569 [2024-11-18 16:16:52.987571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.569 [2024-11-18 16:16:52.996699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.569 [2024-11-18 16:16:52.997026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:52.997112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:52.997137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.569 [2024-11-18 16:16:52.997153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.569 [2024-11-18 16:16:52.997312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.569 [2024-11-18 16:16:52.997436] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.569 [2024-11-18 16:16:52.997454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.569 [2024-11-18 16:16:52.997466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.569 [2024-11-18 16:16:52.999183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.569 [2024-11-18 16:16:53.008753] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.569 [2024-11-18 16:16:53.009066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.009225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.009251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.569 [2024-11-18 16:16:53.009267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.569 [2024-11-18 16:16:53.009425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.569 [2024-11-18 16:16:53.009593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.569 [2024-11-18 16:16:53.009636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.569 [2024-11-18 16:16:53.009649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.569 [2024-11-18 16:16:53.011433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.569 [2024-11-18 16:16:53.020636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.569 [2024-11-18 16:16:53.020953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.021082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.021109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.569 [2024-11-18 16:16:53.021125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.569 [2024-11-18 16:16:53.021312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.569 [2024-11-18 16:16:53.021480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.569 [2024-11-18 16:16:53.021500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.569 [2024-11-18 16:16:53.021512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.569 [2024-11-18 16:16:53.023221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.569 [2024-11-18 16:16:53.032720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.569 [2024-11-18 16:16:53.033021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.033180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.033205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.569 [2024-11-18 16:16:53.033221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.569 [2024-11-18 16:16:53.033383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.569 [2024-11-18 16:16:53.033536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.569 [2024-11-18 16:16:53.033555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.569 [2024-11-18 16:16:53.033567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.569 [2024-11-18 16:16:53.035426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.569 [2024-11-18 16:16:53.044778] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.569 [2024-11-18 16:16:53.045124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.045254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.045279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.569 [2024-11-18 16:16:53.045294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.569 [2024-11-18 16:16:53.045465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.569 [2024-11-18 16:16:53.045705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.569 [2024-11-18 16:16:53.045739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.569 [2024-11-18 16:16:53.045753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.569 [2024-11-18 16:16:53.047578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.569 [2024-11-18 16:16:53.056659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.569 [2024-11-18 16:16:53.056981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.057130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.057155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.569 [2024-11-18 16:16:53.057171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.569 [2024-11-18 16:16:53.057332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.569 [2024-11-18 16:16:53.057500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.569 [2024-11-18 16:16:53.057518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.569 [2024-11-18 16:16:53.057531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.569 [2024-11-18 16:16:53.059385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.569 [2024-11-18 16:16:53.068677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.569 [2024-11-18 16:16:53.069027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.069140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.069166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.569 [2024-11-18 16:16:53.069183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.569 [2024-11-18 16:16:53.069361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.569 [2024-11-18 16:16:53.069536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.569 [2024-11-18 16:16:53.069556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.569 [2024-11-18 16:16:53.069569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.569 [2024-11-18 16:16:53.071751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.569 [2024-11-18 16:16:53.080819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.569 [2024-11-18 16:16:53.081165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.081299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.569 [2024-11-18 16:16:53.081323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.569 [2024-11-18 16:16:53.081339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.569 [2024-11-18 16:16:53.081495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.569 [2024-11-18 16:16:53.081692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.569 [2024-11-18 16:16:53.081713] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.569 [2024-11-18 16:16:53.081727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.569 [2024-11-18 16:16:53.083653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.569 [2024-11-18 16:16:53.092927] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.570 [2024-11-18 16:16:53.093264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.093364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.093388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.570 [2024-11-18 16:16:53.093403] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.570 [2024-11-18 16:16:53.093542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.570 [2024-11-18 16:16:53.093718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.570 [2024-11-18 16:16:53.093738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.570 [2024-11-18 16:16:53.093751] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.570 [2024-11-18 16:16:53.095632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.570 [2024-11-18 16:16:53.104919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.570 [2024-11-18 16:16:53.105222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.105406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.105432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.570 [2024-11-18 16:16:53.105447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.570 [2024-11-18 16:16:53.105678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.570 [2024-11-18 16:16:53.105833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.570 [2024-11-18 16:16:53.105852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.570 [2024-11-18 16:16:53.105864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.570 [2024-11-18 16:16:53.107643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.570 [2024-11-18 16:16:53.116949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.570 [2024-11-18 16:16:53.117226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.117362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.117387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.570 [2024-11-18 16:16:53.117403] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.570 [2024-11-18 16:16:53.117559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.570 [2024-11-18 16:16:53.117784] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.570 [2024-11-18 16:16:53.117806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.570 [2024-11-18 16:16:53.117819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.570 [2024-11-18 16:16:53.119707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.570 [2024-11-18 16:16:53.129017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.570 [2024-11-18 16:16:53.129323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.129452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.129482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.570 [2024-11-18 16:16:53.129499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.570 [2024-11-18 16:16:53.129640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.570 [2024-11-18 16:16:53.129844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.570 [2024-11-18 16:16:53.129863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.570 [2024-11-18 16:16:53.129875] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.570 [2024-11-18 16:16:53.131708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.570 [2024-11-18 16:16:53.141009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.570 [2024-11-18 16:16:53.141358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.141478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.141503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.570 [2024-11-18 16:16:53.141519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.570 [2024-11-18 16:16:53.141711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.570 [2024-11-18 16:16:53.141856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.570 [2024-11-18 16:16:53.141876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.570 [2024-11-18 16:16:53.141903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.570 [2024-11-18 16:16:53.143752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.570 [2024-11-18 16:16:53.153124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.570 [2024-11-18 16:16:53.153449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.153618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.570 [2024-11-18 16:16:53.153644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.570 [2024-11-18 16:16:53.153660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.570 [2024-11-18 16:16:53.153792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.570 [2024-11-18 16:16:53.153969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.570 [2024-11-18 16:16:53.154002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.570 [2024-11-18 16:16:53.154014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.570 [2024-11-18 16:16:53.156104] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.830 [2024-11-18 16:16:53.165231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.830 [2024-11-18 16:16:53.165555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-18 16:16:53.165668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-18 16:16:53.165694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.830 [2024-11-18 16:16:53.165716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.830 [2024-11-18 16:16:53.165862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.830 [2024-11-18 16:16:53.166005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.830 [2024-11-18 16:16:53.166024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.830 [2024-11-18 16:16:53.166035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.830 [2024-11-18 16:16:53.167959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.830 [2024-11-18 16:16:53.177389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.830 [2024-11-18 16:16:53.177670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-18 16:16:53.177820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.830 [2024-11-18 16:16:53.177845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.830 [2024-11-18 16:16:53.177861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.830 [2024-11-18 16:16:53.178084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.830 [2024-11-18 16:16:53.178234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.830 [2024-11-18 16:16:53.178253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.831 [2024-11-18 16:16:53.178264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.831 [2024-11-18 16:16:53.180178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.831 [2024-11-18 16:16:53.189297] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.831 [2024-11-18 16:16:53.189635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.189757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.189783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.831 [2024-11-18 16:16:53.189799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.831 [2024-11-18 16:16:53.190015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.831 [2024-11-18 16:16:53.190122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.831 [2024-11-18 16:16:53.190141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.831 [2024-11-18 16:16:53.190152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.831 [2024-11-18 16:16:53.192156] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.831 [2024-11-18 16:16:53.201335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.831 [2024-11-18 16:16:53.201552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.201718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.201743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.831 [2024-11-18 16:16:53.201759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.831 [2024-11-18 16:16:53.201924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.831 [2024-11-18 16:16:53.202083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.831 [2024-11-18 16:16:53.202102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.831 [2024-11-18 16:16:53.202113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.831 [2024-11-18 16:16:53.204026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.831 [2024-11-18 16:16:53.213382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.831 [2024-11-18 16:16:53.213718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.213887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.213913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.831 [2024-11-18 16:16:53.213929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.831 [2024-11-18 16:16:53.214132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.831 [2024-11-18 16:16:53.214239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.831 [2024-11-18 16:16:53.214257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.831 [2024-11-18 16:16:53.214269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.831 [2024-11-18 16:16:53.216246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.831 [2024-11-18 16:16:53.225381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.831 [2024-11-18 16:16:53.225766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.225879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.225905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.831 [2024-11-18 16:16:53.225921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.831 [2024-11-18 16:16:53.226115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.831 [2024-11-18 16:16:53.226252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.831 [2024-11-18 16:16:53.226271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.831 [2024-11-18 16:16:53.226282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.831 [2024-11-18 16:16:53.228283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.831 [2024-11-18 16:16:53.237322] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.831 [2024-11-18 16:16:53.237615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.237742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.237769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.831 [2024-11-18 16:16:53.237786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.831 [2024-11-18 16:16:53.237976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.831 [2024-11-18 16:16:53.238134] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.831 [2024-11-18 16:16:53.238153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.831 [2024-11-18 16:16:53.238165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.831 [2024-11-18 16:16:53.240037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.831 [2024-11-18 16:16:53.249267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.831 [2024-11-18 16:16:53.249560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.249689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.249715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.831 [2024-11-18 16:16:53.249732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.831 [2024-11-18 16:16:53.249896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.831 [2024-11-18 16:16:53.250069] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.831 [2024-11-18 16:16:53.250087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.831 [2024-11-18 16:16:53.250099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.831 [2024-11-18 16:16:53.252132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.831 [2024-11-18 16:16:53.261417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.831 [2024-11-18 16:16:53.261704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.261830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.261855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.831 [2024-11-18 16:16:53.261871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.831 [2024-11-18 16:16:53.262043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.831 [2024-11-18 16:16:53.262214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.831 [2024-11-18 16:16:53.262233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.831 [2024-11-18 16:16:53.262246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.831 [2024-11-18 16:16:53.264042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.831 [2024-11-18 16:16:53.273325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.831 [2024-11-18 16:16:53.273647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.273787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.273812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.831 [2024-11-18 16:16:53.273828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.831 [2024-11-18 16:16:53.273974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.831 [2024-11-18 16:16:53.274161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.831 [2024-11-18 16:16:53.274184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.831 [2024-11-18 16:16:53.274196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.831 [2024-11-18 16:16:53.276066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.831 [2024-11-18 16:16:53.285323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.831 [2024-11-18 16:16:53.285635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.285760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.831 [2024-11-18 16:16:53.285785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.831 [2024-11-18 16:16:53.285800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.831 [2024-11-18 16:16:53.285961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.831 [2024-11-18 16:16:53.286163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.831 [2024-11-18 16:16:53.286182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.831 [2024-11-18 16:16:53.286194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.831 [2024-11-18 16:16:53.288006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.831 [2024-11-18 16:16:53.297230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.831 [2024-11-18 16:16:53.297569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.297707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.297733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.832 [2024-11-18 16:16:53.297749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.832 [2024-11-18 16:16:53.297848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.832 [2024-11-18 16:16:53.298053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.832 [2024-11-18 16:16:53.298072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.832 [2024-11-18 16:16:53.298084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.832 [2024-11-18 16:16:53.300022] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.832 [2024-11-18 16:16:53.309152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.832 [2024-11-18 16:16:53.309441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.309557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.309582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.832 [2024-11-18 16:16:53.309598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.832 [2024-11-18 16:16:53.309723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.832 [2024-11-18 16:16:53.309903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.832 [2024-11-18 16:16:53.309923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.832 [2024-11-18 16:16:53.309955] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.832 [2024-11-18 16:16:53.311735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.832 [2024-11-18 16:16:53.321078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.832 [2024-11-18 16:16:53.321387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.321536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.321560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.832 [2024-11-18 16:16:53.321576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.832 [2024-11-18 16:16:53.321766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.832 [2024-11-18 16:16:53.321970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.832 [2024-11-18 16:16:53.322005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.832 [2024-11-18 16:16:53.322019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.832 [2024-11-18 16:16:53.324280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.832 [2024-11-18 16:16:53.333127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.832 [2024-11-18 16:16:53.333436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.333612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.333638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.832 [2024-11-18 16:16:53.333654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.832 [2024-11-18 16:16:53.333818] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.832 [2024-11-18 16:16:53.333994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.832 [2024-11-18 16:16:53.334013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.832 [2024-11-18 16:16:53.334025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.832 [2024-11-18 16:16:53.335921] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.832 [2024-11-18 16:16:53.344917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.832 [2024-11-18 16:16:53.345239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.345364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.345389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.832 [2024-11-18 16:16:53.345405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.832 [2024-11-18 16:16:53.345583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.832 [2024-11-18 16:16:53.345753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.832 [2024-11-18 16:16:53.345774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.832 [2024-11-18 16:16:53.345787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.832 [2024-11-18 16:16:53.347717] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.832 [2024-11-18 16:16:53.356804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.832 [2024-11-18 16:16:53.357145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.357225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.357250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.832 [2024-11-18 16:16:53.357265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.832 [2024-11-18 16:16:53.357439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.832 [2024-11-18 16:16:53.357634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.832 [2024-11-18 16:16:53.357678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.832 [2024-11-18 16:16:53.357694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.832 [2024-11-18 16:16:53.359703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.832 [2024-11-18 16:16:53.368737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.832 [2024-11-18 16:16:53.369002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.369124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.369149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.832 [2024-11-18 16:16:53.369165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.832 [2024-11-18 16:16:53.369322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.832 [2024-11-18 16:16:53.369490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.832 [2024-11-18 16:16:53.369509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.832 [2024-11-18 16:16:53.369521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.832 [2024-11-18 16:16:53.371430] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.832 [2024-11-18 16:16:53.380816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.832 [2024-11-18 16:16:53.381160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.381295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.381320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.832 [2024-11-18 16:16:53.381339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.832 [2024-11-18 16:16:53.381486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.832 [2024-11-18 16:16:53.381621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.832 [2024-11-18 16:16:53.381657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.832 [2024-11-18 16:16:53.381670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.832 [2024-11-18 16:16:53.383568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.832 [2024-11-18 16:16:53.393108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.832 [2024-11-18 16:16:53.393393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.393564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.393589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.832 [2024-11-18 16:16:53.393605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.832 [2024-11-18 16:16:53.393764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.832 [2024-11-18 16:16:53.393942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.832 [2024-11-18 16:16:53.393976] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.832 [2024-11-18 16:16:53.393987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.832 [2024-11-18 16:16:53.396014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.832 [2024-11-18 16:16:53.405282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.832 [2024-11-18 16:16:53.405569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.405756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.832 [2024-11-18 16:16:53.405782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.832 [2024-11-18 16:16:53.405799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.832 [2024-11-18 16:16:53.405947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.833 [2024-11-18 16:16:53.406136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.833 [2024-11-18 16:16:53.406155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.833 [2024-11-18 16:16:53.406166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:29.833 [2024-11-18 16:16:53.407960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:29.833 [2024-11-18 16:16:53.417508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:29.833 [2024-11-18 16:16:53.417838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-18 16:16:53.417947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.833 [2024-11-18 16:16:53.417972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:29.833 [2024-11-18 16:16:53.418003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:29.833 [2024-11-18 16:16:53.418147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:29.833 [2024-11-18 16:16:53.418310] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:29.833 [2024-11-18 16:16:53.418330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:29.833 [2024-11-18 16:16:53.418343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.093 [2024-11-18 16:16:53.420539] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.093 [2024-11-18 16:16:53.429920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.093 [2024-11-18 16:16:53.430212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.430348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.430373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.093 [2024-11-18 16:16:53.430388] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.093 [2024-11-18 16:16:53.430532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.093 [2024-11-18 16:16:53.430730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.093 [2024-11-18 16:16:53.430751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.093 [2024-11-18 16:16:53.430764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.093 [2024-11-18 16:16:53.433043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.093 [2024-11-18 16:16:53.442343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.093 [2024-11-18 16:16:53.442645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.442744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.442770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.093 [2024-11-18 16:16:53.442786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.093 [2024-11-18 16:16:53.442903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.093 [2024-11-18 16:16:53.443099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.093 [2024-11-18 16:16:53.443120] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.093 [2024-11-18 16:16:53.443133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.093 [2024-11-18 16:16:53.445333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.093 [2024-11-18 16:16:53.454820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.093 [2024-11-18 16:16:53.455167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.455286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.455311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.093 [2024-11-18 16:16:53.455327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.093 [2024-11-18 16:16:53.455459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.093 [2024-11-18 16:16:53.455637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.093 [2024-11-18 16:16:53.455659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.093 [2024-11-18 16:16:53.455673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.093 [2024-11-18 16:16:53.457755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.093 [2024-11-18 16:16:53.467365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.093 [2024-11-18 16:16:53.467621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.467725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.467751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.093 [2024-11-18 16:16:53.467773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.093 [2024-11-18 16:16:53.467906] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.093 [2024-11-18 16:16:53.468116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.093 [2024-11-18 16:16:53.468137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.093 [2024-11-18 16:16:53.468150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.093 [2024-11-18 16:16:53.470206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.093 [2024-11-18 16:16:53.479521] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.093 [2024-11-18 16:16:53.479803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.479904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.479930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.093 [2024-11-18 16:16:53.479946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.093 [2024-11-18 16:16:53.480140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.093 [2024-11-18 16:16:53.480337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.093 [2024-11-18 16:16:53.480355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.093 [2024-11-18 16:16:53.480367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.093 [2024-11-18 16:16:53.482266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.093 [2024-11-18 16:16:53.491772] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.093 [2024-11-18 16:16:53.492133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.492239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.492264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.093 [2024-11-18 16:16:53.492280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.093 [2024-11-18 16:16:53.492470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.093 [2024-11-18 16:16:53.492639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.093 [2024-11-18 16:16:53.492661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.093 [2024-11-18 16:16:53.492675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.093 [2024-11-18 16:16:53.494455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.093 [2024-11-18 16:16:53.503902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.093 [2024-11-18 16:16:53.504130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.504313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.093 [2024-11-18 16:16:53.504338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.093 [2024-11-18 16:16:53.504353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.093 [2024-11-18 16:16:53.504533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.093 [2024-11-18 16:16:53.504721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.093 [2024-11-18 16:16:53.504744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.093 [2024-11-18 16:16:53.504758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.094 [2024-11-18 16:16:53.506598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.094 [2024-11-18 16:16:53.515822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.094 [2024-11-18 16:16:53.516190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.516285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.516311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.094 [2024-11-18 16:16:53.516327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.094 [2024-11-18 16:16:53.516514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.094 [2024-11-18 16:16:53.516713] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.094 [2024-11-18 16:16:53.516734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.094 [2024-11-18 16:16:53.516747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.094 [2024-11-18 16:16:53.518682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.094 [2024-11-18 16:16:53.527868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.094 [2024-11-18 16:16:53.528166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.528306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.528332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.094 [2024-11-18 16:16:53.528348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.094 [2024-11-18 16:16:53.528480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.094 [2024-11-18 16:16:53.528638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.094 [2024-11-18 16:16:53.528659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.094 [2024-11-18 16:16:53.528686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.094 [2024-11-18 16:16:53.530589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.094 [2024-11-18 16:16:53.539967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.094 [2024-11-18 16:16:53.540302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.540453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.540478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.094 [2024-11-18 16:16:53.540494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.094 [2024-11-18 16:16:53.540711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.094 [2024-11-18 16:16:53.540920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.094 [2024-11-18 16:16:53.540941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.094 [2024-11-18 16:16:53.540953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.094 [2024-11-18 16:16:53.542782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.094 [2024-11-18 16:16:53.551864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.094 [2024-11-18 16:16:53.552154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.552291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.552316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.094 [2024-11-18 16:16:53.552332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.094 [2024-11-18 16:16:53.552509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.094 [2024-11-18 16:16:53.552692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.094 [2024-11-18 16:16:53.552712] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.094 [2024-11-18 16:16:53.552726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.094 [2024-11-18 16:16:53.554640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.094 [2024-11-18 16:16:53.564086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.094 [2024-11-18 16:16:53.564392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.564509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.564534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.094 [2024-11-18 16:16:53.564550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.094 [2024-11-18 16:16:53.564740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.094 [2024-11-18 16:16:53.564889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.094 [2024-11-18 16:16:53.564923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.094 [2024-11-18 16:16:53.564937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.094 [2024-11-18 16:16:53.566920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.094 [2024-11-18 16:16:53.576099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.094 [2024-11-18 16:16:53.576455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.576555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.576581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.094 [2024-11-18 16:16:53.576597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.094 [2024-11-18 16:16:53.576755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.094 [2024-11-18 16:16:53.576874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.094 [2024-11-18 16:16:53.576915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.094 [2024-11-18 16:16:53.576929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.094 [2024-11-18 16:16:53.579229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.094 [2024-11-18 16:16:53.588167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.094 [2024-11-18 16:16:53.588448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.588573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.588600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.094 [2024-11-18 16:16:53.588624] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.094 [2024-11-18 16:16:53.588742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.094 [2024-11-18 16:16:53.588922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.094 [2024-11-18 16:16:53.588940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.094 [2024-11-18 16:16:53.588953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.094 [2024-11-18 16:16:53.590879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.094 [2024-11-18 16:16:53.600170] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.094 [2024-11-18 16:16:53.600479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.600596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.600630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.094 [2024-11-18 16:16:53.600647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.094 [2024-11-18 16:16:53.600843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.094 [2024-11-18 16:16:53.600968] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.094 [2024-11-18 16:16:53.600986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.094 [2024-11-18 16:16:53.600998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.094 [2024-11-18 16:16:53.602929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.094 [2024-11-18 16:16:53.612159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.094 [2024-11-18 16:16:53.612445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.612621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.094 [2024-11-18 16:16:53.612646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.094 [2024-11-18 16:16:53.612662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.094 [2024-11-18 16:16:53.612810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.094 [2024-11-18 16:16:53.613011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.094 [2024-11-18 16:16:53.613030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.094 [2024-11-18 16:16:53.613047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.094 [2024-11-18 16:16:53.614837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.094 [2024-11-18 16:16:53.624050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.094 [2024-11-18 16:16:53.624355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.095 [2024-11-18 16:16:53.624482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.095 [2024-11-18 16:16:53.624509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.095 [2024-11-18 16:16:53.624525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.095 [2024-11-18 16:16:53.624714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.095 [2024-11-18 16:16:53.624875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.095 [2024-11-18 16:16:53.624897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.095 [2024-11-18 16:16:53.624924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.095 [2024-11-18 16:16:53.626763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.095 [2024-11-18 16:16:53.636116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.095 [2024-11-18 16:16:53.636436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.095 [2024-11-18 16:16:53.636587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.095 [2024-11-18 16:16:53.636622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.095 [2024-11-18 16:16:53.636640] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.095 [2024-11-18 16:16:53.636788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.095 [2024-11-18 16:16:53.636963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.095 [2024-11-18 16:16:53.636982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.095 [2024-11-18 16:16:53.636994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.095 [2024-11-18 16:16:53.638983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.095 [2024-11-18 16:16:53.648222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.095 [2024-11-18 16:16:53.648561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.095 [2024-11-18 16:16:53.648691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.095 [2024-11-18 16:16:53.648718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.095 [2024-11-18 16:16:53.648734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.095 [2024-11-18 16:16:53.648912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.095 [2024-11-18 16:16:53.649053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.095 [2024-11-18 16:16:53.649073] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.095 [2024-11-18 16:16:53.649085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.095 [2024-11-18 16:16:53.651070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.095 [2024-11-18 16:16:53.660210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.095 [2024-11-18 16:16:53.660519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.095 [2024-11-18 16:16:53.660691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.095 [2024-11-18 16:16:53.660718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.095 [2024-11-18 16:16:53.660734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.095 [2024-11-18 16:16:53.660848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.095 [2024-11-18 16:16:53.660976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.095 [2024-11-18 16:16:53.660995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.095 [2024-11-18 16:16:53.661007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.095 [2024-11-18 16:16:53.662773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.095 [2024-11-18 16:16:53.671992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.095 [2024-11-18 16:16:53.672307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.095 [2024-11-18 16:16:53.672457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.095 [2024-11-18 16:16:53.672482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.095 [2024-11-18 16:16:53.672498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.095 [2024-11-18 16:16:53.672702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.095 [2024-11-18 16:16:53.672860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.095 [2024-11-18 16:16:53.672879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.095 [2024-11-18 16:16:53.672892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.095 [2024-11-18 16:16:53.674684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.355 [2024-11-18 16:16:53.684243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.355 [2024-11-18 16:16:53.684586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.684763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.684790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.355 [2024-11-18 16:16:53.684806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.355 [2024-11-18 16:16:53.684955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.355 [2024-11-18 16:16:53.685098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.355 [2024-11-18 16:16:53.685117] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.355 [2024-11-18 16:16:53.685128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.355 [2024-11-18 16:16:53.687218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.355 [2024-11-18 16:16:53.696206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.355 [2024-11-18 16:16:53.696503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.696632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.696658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.355 [2024-11-18 16:16:53.696674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.355 [2024-11-18 16:16:53.696836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.355 [2024-11-18 16:16:53.697034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.355 [2024-11-18 16:16:53.697053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.355 [2024-11-18 16:16:53.697065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.355 [2024-11-18 16:16:53.699112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.355 [2024-11-18 16:16:53.708151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.355 [2024-11-18 16:16:53.708425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.708540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.708565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.355 [2024-11-18 16:16:53.708580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.355 [2024-11-18 16:16:53.708799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.355 [2024-11-18 16:16:53.708956] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.355 [2024-11-18 16:16:53.708990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.355 [2024-11-18 16:16:53.709003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.355 [2024-11-18 16:16:53.710842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.355 [2024-11-18 16:16:53.720465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.355 [2024-11-18 16:16:53.720812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.720930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.720955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.355 [2024-11-18 16:16:53.720971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.355 [2024-11-18 16:16:53.721071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.355 [2024-11-18 16:16:53.721278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.355 [2024-11-18 16:16:53.721297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.355 [2024-11-18 16:16:53.721309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.355 [2024-11-18 16:16:53.723178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.355 [2024-11-18 16:16:53.732505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.355 [2024-11-18 16:16:53.732777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.732908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.732934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.355 [2024-11-18 16:16:53.732950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.355 [2024-11-18 16:16:53.733155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.355 [2024-11-18 16:16:53.733307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.355 [2024-11-18 16:16:53.733326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.355 [2024-11-18 16:16:53.733338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.355 [2024-11-18 16:16:53.735095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.355 [2024-11-18 16:16:53.744478] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.355 [2024-11-18 16:16:53.744805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.744917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.744944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.355 [2024-11-18 16:16:53.744976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.355 [2024-11-18 16:16:53.745133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.355 [2024-11-18 16:16:53.745341] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.355 [2024-11-18 16:16:53.745361] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.355 [2024-11-18 16:16:53.745373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.355 [2024-11-18 16:16:53.747242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.355 [2024-11-18 16:16:53.756495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.355 [2024-11-18 16:16:53.756852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.756964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.355 [2024-11-18 16:16:53.756990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.355 [2024-11-18 16:16:53.757006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.356 [2024-11-18 16:16:53.757184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.356 [2024-11-18 16:16:53.757386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.356 [2024-11-18 16:16:53.757405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.356 [2024-11-18 16:16:53.757418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.356 [2024-11-18 16:16:53.759435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.356 [2024-11-18 16:16:53.768837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.356 [2024-11-18 16:16:53.769162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.769283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.769313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.356 [2024-11-18 16:16:53.769331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.356 [2024-11-18 16:16:53.769512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.356 [2024-11-18 16:16:53.769706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.356 [2024-11-18 16:16:53.769728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.356 [2024-11-18 16:16:53.769741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.356 [2024-11-18 16:16:53.771777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.356 [2024-11-18 16:16:53.780946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.356 [2024-11-18 16:16:53.781284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.781459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.781484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.356 [2024-11-18 16:16:53.781515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.356 [2024-11-18 16:16:53.781731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.356 [2024-11-18 16:16:53.781906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.356 [2024-11-18 16:16:53.781939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.356 [2024-11-18 16:16:53.781952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.356 [2024-11-18 16:16:53.784009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.356 [2024-11-18 16:16:53.793035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.356 [2024-11-18 16:16:53.793314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.793486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.793512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.356 [2024-11-18 16:16:53.793528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.356 [2024-11-18 16:16:53.793706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.356 [2024-11-18 16:16:53.793848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.356 [2024-11-18 16:16:53.793871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.356 [2024-11-18 16:16:53.793898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.356 [2024-11-18 16:16:53.795603] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.356 [2024-11-18 16:16:53.805009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.356 [2024-11-18 16:16:53.805315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.805465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.805490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.356 [2024-11-18 16:16:53.805511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.356 [2024-11-18 16:16:53.805718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.356 [2024-11-18 16:16:53.805849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.356 [2024-11-18 16:16:53.805869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.356 [2024-11-18 16:16:53.805883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.356 [2024-11-18 16:16:53.807725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.356 [2024-11-18 16:16:53.817175] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.356 [2024-11-18 16:16:53.817472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.817603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.817638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.356 [2024-11-18 16:16:53.817654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.356 [2024-11-18 16:16:53.817786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.356 [2024-11-18 16:16:53.817981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.356 [2024-11-18 16:16:53.818000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.356 [2024-11-18 16:16:53.818013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.356 [2024-11-18 16:16:53.819846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.356 [2024-11-18 16:16:53.829308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.356 [2024-11-18 16:16:53.829642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.829757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.829782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.356 [2024-11-18 16:16:53.829798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.356 [2024-11-18 16:16:53.829897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.356 [2024-11-18 16:16:53.830001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.356 [2024-11-18 16:16:53.830036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.356 [2024-11-18 16:16:53.830049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.356 [2024-11-18 16:16:53.832256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.356 [2024-11-18 16:16:53.841528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.356 [2024-11-18 16:16:53.841888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.842035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.842061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.356 [2024-11-18 16:16:53.842077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.356 [2024-11-18 16:16:53.842273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.356 [2024-11-18 16:16:53.842411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.356 [2024-11-18 16:16:53.842429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.356 [2024-11-18 16:16:53.842441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.356 [2024-11-18 16:16:53.844483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.356 [2024-11-18 16:16:53.853616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.356 [2024-11-18 16:16:53.854003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.854130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.854156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.356 [2024-11-18 16:16:53.854187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.356 [2024-11-18 16:16:53.854359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.356 [2024-11-18 16:16:53.854512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.356 [2024-11-18 16:16:53.854530] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.356 [2024-11-18 16:16:53.854542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.356 [2024-11-18 16:16:53.856407] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.356 [2024-11-18 16:16:53.865629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.356 [2024-11-18 16:16:53.865960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.866130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.356 [2024-11-18 16:16:53.866155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.356 [2024-11-18 16:16:53.866171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.356 [2024-11-18 16:16:53.866302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.357 [2024-11-18 16:16:53.866469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.357 [2024-11-18 16:16:53.866487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.357 [2024-11-18 16:16:53.866499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.357 [2024-11-18 16:16:53.868554] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.357 [2024-11-18 16:16:53.877522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.357 [2024-11-18 16:16:53.877840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.877953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.877993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.357 [2024-11-18 16:16:53.878009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.357 [2024-11-18 16:16:53.878168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.357 [2024-11-18 16:16:53.878326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.357 [2024-11-18 16:16:53.878345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.357 [2024-11-18 16:16:53.878357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.357 [2024-11-18 16:16:53.880172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.357 [2024-11-18 16:16:53.889578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.357 [2024-11-18 16:16:53.889928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.890082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.890108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.357 [2024-11-18 16:16:53.890124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.357 [2024-11-18 16:16:53.890284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.357 [2024-11-18 16:16:53.890467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.357 [2024-11-18 16:16:53.890486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.357 [2024-11-18 16:16:53.890498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.357 [2024-11-18 16:16:53.892227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.357 [2024-11-18 16:16:53.901518] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.357 [2024-11-18 16:16:53.901851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.901991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.902017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.357 [2024-11-18 16:16:53.902032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.357 [2024-11-18 16:16:53.902162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.357 [2024-11-18 16:16:53.902352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.357 [2024-11-18 16:16:53.902371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.357 [2024-11-18 16:16:53.902383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.357 [2024-11-18 16:16:53.904457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.357 [2024-11-18 16:16:53.913564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.357 [2024-11-18 16:16:53.913871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.914044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.914069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.357 [2024-11-18 16:16:53.914085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.357 [2024-11-18 16:16:53.914276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.357 [2024-11-18 16:16:53.914428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.357 [2024-11-18 16:16:53.914451] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.357 [2024-11-18 16:16:53.914464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.357 [2024-11-18 16:16:53.916347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.357 [2024-11-18 16:16:53.925565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.357 [2024-11-18 16:16:53.925892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.926064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.926090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.357 [2024-11-18 16:16:53.926105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.357 [2024-11-18 16:16:53.926296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.357 [2024-11-18 16:16:53.926420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.357 [2024-11-18 16:16:53.926439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.357 [2024-11-18 16:16:53.926451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.357 [2024-11-18 16:16:53.928314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.357 [2024-11-18 16:16:53.937684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.357 [2024-11-18 16:16:53.938049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.938201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.357 [2024-11-18 16:16:53.938227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.357 [2024-11-18 16:16:53.938243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.357 [2024-11-18 16:16:53.938421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.357 [2024-11-18 16:16:53.938544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.357 [2024-11-18 16:16:53.938563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.357 [2024-11-18 16:16:53.938574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.357 [2024-11-18 16:16:53.940612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.617 [2024-11-18 16:16:53.950034] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.617 [2024-11-18 16:16:53.950299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.617 [2024-11-18 16:16:53.950416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.617 [2024-11-18 16:16:53.950442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.617 [2024-11-18 16:16:53.950458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.617 [2024-11-18 16:16:53.950662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.617 [2024-11-18 16:16:53.950822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.617 [2024-11-18 16:16:53.950842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.617 [2024-11-18 16:16:53.950858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.617 [2024-11-18 16:16:53.952652] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.617 [2024-11-18 16:16:53.961957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.617 [2024-11-18 16:16:53.962251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.617 [2024-11-18 16:16:53.962377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.617 [2024-11-18 16:16:53.962403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.617 [2024-11-18 16:16:53.962419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.617 [2024-11-18 16:16:53.962622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.617 [2024-11-18 16:16:53.962750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.617 [2024-11-18 16:16:53.962770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.617 [2024-11-18 16:16:53.962782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.617 [2024-11-18 16:16:53.964586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.617 [2024-11-18 16:16:53.974246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.617 [2024-11-18 16:16:53.974522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.617 [2024-11-18 16:16:53.974684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.617 [2024-11-18 16:16:53.974711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.617 [2024-11-18 16:16:53.974727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.617 [2024-11-18 16:16:53.974906] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.617 [2024-11-18 16:16:53.975073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.617 [2024-11-18 16:16:53.975092] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.617 [2024-11-18 16:16:53.975104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.617 [2024-11-18 16:16:53.976932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.617 [2024-11-18 16:16:53.986429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.617 [2024-11-18 16:16:53.986771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.617 [2024-11-18 16:16:53.986868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.617 [2024-11-18 16:16:53.986894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.617 [2024-11-18 16:16:53.986910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.617 [2024-11-18 16:16:53.987072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.617 [2024-11-18 16:16:53.987224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.617 [2024-11-18 16:16:53.987244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.618 [2024-11-18 16:16:53.987256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.618 [2024-11-18 16:16:53.989113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.618 [2024-11-18 16:16:53.998601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.618 [2024-11-18 16:16:53.998893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:53.999055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:53.999095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.618 [2024-11-18 16:16:53.999111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.618 [2024-11-18 16:16:53.999271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.618 [2024-11-18 16:16:53.999441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.618 [2024-11-18 16:16:53.999460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.618 [2024-11-18 16:16:53.999472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.618 [2024-11-18 16:16:54.001295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.618 [2024-11-18 16:16:54.010688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.618 [2024-11-18 16:16:54.011013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.011129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.011170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.618 [2024-11-18 16:16:54.011185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.618 [2024-11-18 16:16:54.011357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.618 [2024-11-18 16:16:54.011538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.618 [2024-11-18 16:16:54.011558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.618 [2024-11-18 16:16:54.011570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.618 [2024-11-18 16:16:54.013635] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.618 [2024-11-18 16:16:54.022713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.618 [2024-11-18 16:16:54.022996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.023168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.023194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.618 [2024-11-18 16:16:54.023210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.618 [2024-11-18 16:16:54.023384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.618 [2024-11-18 16:16:54.023551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.618 [2024-11-18 16:16:54.023570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.618 [2024-11-18 16:16:54.023582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.618 [2024-11-18 16:16:54.025503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.618 [2024-11-18 16:16:54.034890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.618 [2024-11-18 16:16:54.035178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.035286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.035312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.618 [2024-11-18 16:16:54.035328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.618 [2024-11-18 16:16:54.035473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.618 [2024-11-18 16:16:54.035701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.618 [2024-11-18 16:16:54.035722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.618 [2024-11-18 16:16:54.035735] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.618 [2024-11-18 16:16:54.037598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.618 [2024-11-18 16:16:54.046844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.618 [2024-11-18 16:16:54.047163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.047333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.047358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.618 [2024-11-18 16:16:54.047374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.618 [2024-11-18 16:16:54.047519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.618 [2024-11-18 16:16:54.047742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.618 [2024-11-18 16:16:54.047763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.618 [2024-11-18 16:16:54.047775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.618 [2024-11-18 16:16:54.049594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.618 [2024-11-18 16:16:54.058669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.618 [2024-11-18 16:16:54.058944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.059114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.059139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.618 [2024-11-18 16:16:54.059155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.618 [2024-11-18 16:16:54.059347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.618 [2024-11-18 16:16:54.059541] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.618 [2024-11-18 16:16:54.059560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.618 [2024-11-18 16:16:54.059572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.618 [2024-11-18 16:16:54.061412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.618 [2024-11-18 16:16:54.070832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.618 [2024-11-18 16:16:54.071158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.071279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.071305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.618 [2024-11-18 16:16:54.071321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.618 [2024-11-18 16:16:54.071501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.618 [2024-11-18 16:16:54.071665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.618 [2024-11-18 16:16:54.071700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.618 [2024-11-18 16:16:54.071714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.618 [2024-11-18 16:16:54.073703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.618 [2024-11-18 16:16:54.082967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.618 [2024-11-18 16:16:54.083308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.083430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.083455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.618 [2024-11-18 16:16:54.083471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.618 [2024-11-18 16:16:54.083570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.618 [2024-11-18 16:16:54.083731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.618 [2024-11-18 16:16:54.083754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.618 [2024-11-18 16:16:54.083768] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.618 [2024-11-18 16:16:54.086126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.618 [2024-11-18 16:16:54.095276] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.618 [2024-11-18 16:16:54.095583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.095722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.618 [2024-11-18 16:16:54.095750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.618 [2024-11-18 16:16:54.095766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.618 [2024-11-18 16:16:54.095897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.618 [2024-11-18 16:16:54.096082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.618 [2024-11-18 16:16:54.096100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.618 [2024-11-18 16:16:54.096113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.618 [2024-11-18 16:16:54.098115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.618 [2024-11-18 16:16:54.107426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.619 [2024-11-18 16:16:54.107736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.107876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.107902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.619 [2024-11-18 16:16:54.107923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.619 [2024-11-18 16:16:54.108071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.619 [2024-11-18 16:16:54.108225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.619 [2024-11-18 16:16:54.108243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.619 [2024-11-18 16:16:54.108255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.619 [2024-11-18 16:16:54.110263] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.619 [2024-11-18 16:16:54.119348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.619 [2024-11-18 16:16:54.119590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.119738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.119764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.619 [2024-11-18 16:16:54.119779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.619 [2024-11-18 16:16:54.119983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.619 [2024-11-18 16:16:54.120149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.619 [2024-11-18 16:16:54.120168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.619 [2024-11-18 16:16:54.120180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.619 [2024-11-18 16:16:54.121924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.619 [2024-11-18 16:16:54.131331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.619 [2024-11-18 16:16:54.131622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.131712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.131739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.619 [2024-11-18 16:16:54.131755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.619 [2024-11-18 16:16:54.131851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.619 [2024-11-18 16:16:54.132010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.619 [2024-11-18 16:16:54.132044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.619 [2024-11-18 16:16:54.132056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.619 [2024-11-18 16:16:54.133842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.619 [2024-11-18 16:16:54.143448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.619 [2024-11-18 16:16:54.143788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.143972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.143997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.619 [2024-11-18 16:16:54.144013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.619 [2024-11-18 16:16:54.144192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.619 [2024-11-18 16:16:54.144376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.619 [2024-11-18 16:16:54.144395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.619 [2024-11-18 16:16:54.144407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.619 [2024-11-18 16:16:54.146217] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.619 [2024-11-18 16:16:54.155448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.619 [2024-11-18 16:16:54.155728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.155876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.155903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.619 [2024-11-18 16:16:54.155919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.619 [2024-11-18 16:16:54.156125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.619 [2024-11-18 16:16:54.156262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.619 [2024-11-18 16:16:54.156282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.619 [2024-11-18 16:16:54.156294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.619 [2024-11-18 16:16:54.158266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.619 [2024-11-18 16:16:54.167500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.619 [2024-11-18 16:16:54.167771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.167912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.167938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.619 [2024-11-18 16:16:54.167953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.619 [2024-11-18 16:16:54.168094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.619 [2024-11-18 16:16:54.168263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.619 [2024-11-18 16:16:54.168282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.619 [2024-11-18 16:16:54.168294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.619 [2024-11-18 16:16:54.170194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.619 [2024-11-18 16:16:54.179563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.619 [2024-11-18 16:16:54.179857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.180036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.180061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.619 [2024-11-18 16:16:54.180076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.619 [2024-11-18 16:16:54.180234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.619 [2024-11-18 16:16:54.180438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.619 [2024-11-18 16:16:54.180457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.619 [2024-11-18 16:16:54.180469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.619 [2024-11-18 16:16:54.182383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.619 [2024-11-18 16:16:54.191575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.619 [2024-11-18 16:16:54.191874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.191999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.192024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.619 [2024-11-18 16:16:54.192040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.619 [2024-11-18 16:16:54.192217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.619 [2024-11-18 16:16:54.192401] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.619 [2024-11-18 16:16:54.192420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.619 [2024-11-18 16:16:54.192432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.619 [2024-11-18 16:16:54.194278] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.619 [2024-11-18 16:16:54.203951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.619 [2024-11-18 16:16:54.204246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.204362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.619 [2024-11-18 16:16:54.204400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.619 [2024-11-18 16:16:54.204416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.619 [2024-11-18 16:16:54.204645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.619 [2024-11-18 16:16:54.204811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.619 [2024-11-18 16:16:54.204832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.619 [2024-11-18 16:16:54.204845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.880 [2024-11-18 16:16:54.207049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.880 [2024-11-18 16:16:54.216215] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.880 [2024-11-18 16:16:54.216509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.880 [2024-11-18 16:16:54.216659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.880 [2024-11-18 16:16:54.216685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.880 [2024-11-18 16:16:54.216701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.880 [2024-11-18 16:16:54.216866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.880 [2024-11-18 16:16:54.217039] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.880 [2024-11-18 16:16:54.217063] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.880 [2024-11-18 16:16:54.217075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.880 [2024-11-18 16:16:54.219034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.880 [2024-11-18 16:16:54.228303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.880 [2024-11-18 16:16:54.228624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.880 [2024-11-18 16:16:54.228776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.880 [2024-11-18 16:16:54.228802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.880 [2024-11-18 16:16:54.228818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.880 [2024-11-18 16:16:54.228950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.880 [2024-11-18 16:16:54.229123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.880 [2024-11-18 16:16:54.229158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.880 [2024-11-18 16:16:54.229169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.880 [2024-11-18 16:16:54.231001] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.880 [2024-11-18 16:16:54.240474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.880 [2024-11-18 16:16:54.240799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.880 [2024-11-18 16:16:54.240929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.880 [2024-11-18 16:16:54.240954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.880 [2024-11-18 16:16:54.240970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.880 [2024-11-18 16:16:54.241147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.880 [2024-11-18 16:16:54.241344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.880 [2024-11-18 16:16:54.241362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.880 [2024-11-18 16:16:54.241374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.880 [2024-11-18 16:16:54.243291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.880 [2024-11-18 16:16:54.252492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.880 [2024-11-18 16:16:54.252836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.880 [2024-11-18 16:16:54.252976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.880 [2024-11-18 16:16:54.253002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.880 [2024-11-18 16:16:54.253018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.880 [2024-11-18 16:16:54.253164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.880 [2024-11-18 16:16:54.253362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.880 [2024-11-18 16:16:54.253381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.880 [2024-11-18 16:16:54.253397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.880 [2024-11-18 16:16:54.255199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.880 [2024-11-18 16:16:54.264482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.880 [2024-11-18 16:16:54.264785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.880 [2024-11-18 16:16:54.264904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.880 [2024-11-18 16:16:54.264929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.880 [2024-11-18 16:16:54.264946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.880 [2024-11-18 16:16:54.265093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.880 [2024-11-18 16:16:54.265290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.880 [2024-11-18 16:16:54.265309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.880 [2024-11-18 16:16:54.265321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.881 [2024-11-18 16:16:54.267377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.881 [2024-11-18 16:16:54.276475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.881 [2024-11-18 16:16:54.276695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.276866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.276892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.881 [2024-11-18 16:16:54.276908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.881 [2024-11-18 16:16:54.277084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.881 [2024-11-18 16:16:54.277236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.881 [2024-11-18 16:16:54.277255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.881 [2024-11-18 16:16:54.277267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.881 [2024-11-18 16:16:54.279117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.881 [2024-11-18 16:16:54.288420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.881 [2024-11-18 16:16:54.288635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.288750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.288790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.881 [2024-11-18 16:16:54.288805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.881 [2024-11-18 16:16:54.288979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.881 [2024-11-18 16:16:54.289119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.881 [2024-11-18 16:16:54.289138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.881 [2024-11-18 16:16:54.289149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.881 [2024-11-18 16:16:54.290991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.881 [2024-11-18 16:16:54.300466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.881 [2024-11-18 16:16:54.300810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.300927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.300953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.881 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1712810 Killed "${NVMF_APP[@]}" "$@" 00:30:30.881 [2024-11-18 16:16:54.300969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.881 [2024-11-18 16:16:54.301152] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.881 [2024-11-18 16:16:54.301277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.881 [2024-11-18 16:16:54.301296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.881 16:16:54 -- host/bdevperf.sh@36 -- # tgt_init 00:30:30.881 [2024-11-18 16:16:54.301308] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.881 16:16:54 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:30.881 16:16:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:30.881 16:16:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:30.881 16:16:54 -- common/autotest_common.sh@10 -- # set +x 00:30:30.881 [2024-11-18 16:16:54.303443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.881 16:16:54 -- nvmf/common.sh@469 -- # nvmfpid=1713894 00:30:30.881 16:16:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:30.881 16:16:54 -- nvmf/common.sh@470 -- # waitforlisten 1713894 00:30:30.881 16:16:54 -- common/autotest_common.sh@829 -- # '[' -z 1713894 ']' 00:30:30.881 16:16:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:30.881 16:16:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:30.881 16:16:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:30.881 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:30.881 16:16:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:30.881 16:16:54 -- common/autotest_common.sh@10 -- # set +x 00:30:30.881 [2024-11-18 16:16:54.312685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.881 [2024-11-18 16:16:54.313093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.313234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.313259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.881 [2024-11-18 16:16:54.313275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.881 [2024-11-18 16:16:54.313424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.881 [2024-11-18 16:16:54.313640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.881 [2024-11-18 16:16:54.313662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.881 [2024-11-18 16:16:54.313676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.881 [2024-11-18 16:16:54.315545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.881 [2024-11-18 16:16:54.325021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.881 [2024-11-18 16:16:54.325326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.325434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.325460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.881 [2024-11-18 16:16:54.325476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.881 [2024-11-18 16:16:54.325650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.881 [2024-11-18 16:16:54.325780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.881 [2024-11-18 16:16:54.325800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.881 [2024-11-18 16:16:54.325813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.881 [2024-11-18 16:16:54.328027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.881 [2024-11-18 16:16:54.337125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.881 [2024-11-18 16:16:54.337447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.337538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.337564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.881 [2024-11-18 16:16:54.337580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.881 [2024-11-18 16:16:54.337722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.881 [2024-11-18 16:16:54.337875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.881 [2024-11-18 16:16:54.337896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.881 [2024-11-18 16:16:54.337925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.881 [2024-11-18 16:16:54.340248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.881 [2024-11-18 16:16:54.348638] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:30.881 [2024-11-18 16:16:54.348710] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:30.881 [2024-11-18 16:16:54.349193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.881 [2024-11-18 16:16:54.349521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.349671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.349698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.881 [2024-11-18 16:16:54.349714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.881 [2024-11-18 16:16:54.349862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.881 [2024-11-18 16:16:54.350066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.881 [2024-11-18 16:16:54.350086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.881 [2024-11-18 16:16:54.350099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.881 [2024-11-18 16:16:54.351997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.881 [2024-11-18 16:16:54.361213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.881 [2024-11-18 16:16:54.361525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.361653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.881 [2024-11-18 16:16:54.361679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.881 [2024-11-18 16:16:54.361695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.881 [2024-11-18 16:16:54.361844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.881 [2024-11-18 16:16:54.361991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.881 [2024-11-18 16:16:54.362011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.882 [2024-11-18 16:16:54.362024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.882 [2024-11-18 16:16:54.364014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.882 [2024-11-18 16:16:54.373384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.882 [2024-11-18 16:16:54.373685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.373808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.373834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.882 [2024-11-18 16:16:54.373851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.882 [2024-11-18 16:16:54.373982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.882 [2024-11-18 16:16:54.374156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.882 [2024-11-18 16:16:54.374175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.882 [2024-11-18 16:16:54.374187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.882 [2024-11-18 16:16:54.376166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.882 EAL: No free 2048 kB hugepages reported on node 1 00:30:30.882 [2024-11-18 16:16:54.385535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.882 [2024-11-18 16:16:54.385825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.385932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.385959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.882 [2024-11-18 16:16:54.385975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.882 [2024-11-18 16:16:54.386108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.882 [2024-11-18 16:16:54.386286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.882 [2024-11-18 16:16:54.386306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.882 [2024-11-18 16:16:54.386319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.882 [2024-11-18 16:16:54.388387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.882 [2024-11-18 16:16:54.397849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.882 [2024-11-18 16:16:54.398216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.398339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.398366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.882 [2024-11-18 16:16:54.398383] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.882 [2024-11-18 16:16:54.398516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.882 [2024-11-18 16:16:54.398684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.882 [2024-11-18 16:16:54.398705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.882 [2024-11-18 16:16:54.398718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.882 [2024-11-18 16:16:54.400663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.882 [2024-11-18 16:16:54.409873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.882 [2024-11-18 16:16:54.410145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.410253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.410279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.882 [2024-11-18 16:16:54.410295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.882 [2024-11-18 16:16:54.410428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.882 [2024-11-18 16:16:54.410662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.882 [2024-11-18 16:16:54.410683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.882 [2024-11-18 16:16:54.410696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.882 [2024-11-18 16:16:54.412791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.882 [2024-11-18 16:16:54.414430] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:30.882 [2024-11-18 16:16:54.422128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.882 [2024-11-18 16:16:54.422528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.422668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.422696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.882 [2024-11-18 16:16:54.422715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.882 [2024-11-18 16:16:54.422936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.882 [2024-11-18 16:16:54.423087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.882 [2024-11-18 16:16:54.423108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.882 [2024-11-18 16:16:54.423124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.882 [2024-11-18 16:16:54.425035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.882 [2024-11-18 16:16:54.434536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.882 [2024-11-18 16:16:54.434934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.435034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.435061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.882 [2024-11-18 16:16:54.435080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.882 [2024-11-18 16:16:54.435250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.882 [2024-11-18 16:16:54.435416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.882 [2024-11-18 16:16:54.435436] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.882 [2024-11-18 16:16:54.435452] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.882 [2024-11-18 16:16:54.437424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.882 [2024-11-18 16:16:54.446745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.882 [2024-11-18 16:16:54.447106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.447262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.447288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.882 [2024-11-18 16:16:54.447304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.882 [2024-11-18 16:16:54.447437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.882 [2024-11-18 16:16:54.447602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.882 [2024-11-18 16:16:54.447649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.882 [2024-11-18 16:16:54.447663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.882 [2024-11-18 16:16:54.449859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:30.882 [2024-11-18 16:16:54.458995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:30.882 [2024-11-18 16:16:54.459357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.459483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.882 [2024-11-18 16:16:54.459508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:30.882 [2024-11-18 16:16:54.459525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:30.882 [2024-11-18 16:16:54.459673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:30.882 [2024-11-18 16:16:54.459824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:30.882 [2024-11-18 16:16:54.459845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:30.882 [2024-11-18 16:16:54.459859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.882 [2024-11-18 16:16:54.461776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.143 [2024-11-18 16:16:54.471492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.143 [2024-11-18 16:16:54.471903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.143 [2024-11-18 16:16:54.472078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.143 [2024-11-18 16:16:54.472105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.143 [2024-11-18 16:16:54.472124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.143 [2024-11-18 16:16:54.472232] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.143 [2024-11-18 16:16:54.472446] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.143 [2024-11-18 16:16:54.472467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.143 [2024-11-18 16:16:54.472483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.143 [2024-11-18 16:16:54.474712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.143 [2024-11-18 16:16:54.483791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.143 [2024-11-18 16:16:54.484083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.143 [2024-11-18 16:16:54.484218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.143 [2024-11-18 16:16:54.484244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.143 [2024-11-18 16:16:54.484261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.143 [2024-11-18 16:16:54.484439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.143 [2024-11-18 16:16:54.484599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.143 [2024-11-18 16:16:54.484643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.143 [2024-11-18 16:16:54.484658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.143 [2024-11-18 16:16:54.486749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.143 [2024-11-18 16:16:54.495950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.143 [2024-11-18 16:16:54.496212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.143 [2024-11-18 16:16:54.496344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.143 [2024-11-18 16:16:54.496369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.143 [2024-11-18 16:16:54.496386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.143 [2024-11-18 16:16:54.496552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.143 [2024-11-18 16:16:54.496682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.143 [2024-11-18 16:16:54.496705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.143 [2024-11-18 16:16:54.496719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.143 [2024-11-18 16:16:54.498755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.143 [2024-11-18 16:16:54.502011] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:31.143 [2024-11-18 16:16:54.502148] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:31.143 [2024-11-18 16:16:54.502167] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:31.143 [2024-11-18 16:16:54.502189] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:31.143 [2024-11-18 16:16:54.502250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:31.143 [2024-11-18 16:16:54.502302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:31.143 [2024-11-18 16:16:54.502306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:31.143 [2024-11-18 16:16:54.508143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.143 [2024-11-18 16:16:54.508482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.143 [2024-11-18 16:16:54.508623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.143 [2024-11-18 16:16:54.508652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.143 [2024-11-18 16:16:54.508670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.143 [2024-11-18 16:16:54.508826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.143 [2024-11-18 16:16:54.508965] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.143 [2024-11-18 16:16:54.508988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.144 [2024-11-18 16:16:54.509004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.144 [2024-11-18 16:16:54.511153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.144 [2024-11-18 16:16:54.520623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.144 [2024-11-18 16:16:54.521061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.521207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.521233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.144 [2024-11-18 16:16:54.521254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.144 [2024-11-18 16:16:54.521379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.144 [2024-11-18 16:16:54.521541] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.144 [2024-11-18 16:16:54.521564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.144 [2024-11-18 16:16:54.521582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.144 [2024-11-18 16:16:54.523679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.144 [2024-11-18 16:16:54.533006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.144 [2024-11-18 16:16:54.533453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.533554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.533579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.144 [2024-11-18 16:16:54.533618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.144 [2024-11-18 16:16:54.533809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.144 [2024-11-18 16:16:54.533967] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.144 [2024-11-18 16:16:54.533990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.144 [2024-11-18 16:16:54.534017] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.144 [2024-11-18 16:16:54.536168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.144 [2024-11-18 16:16:54.545490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.144 [2024-11-18 16:16:54.545972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.546094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.546121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.144 [2024-11-18 16:16:54.546141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.144 [2024-11-18 16:16:54.546282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.144 [2024-11-18 16:16:54.546441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.144 [2024-11-18 16:16:54.546464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.144 [2024-11-18 16:16:54.546482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.144 [2024-11-18 16:16:54.548528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.144 [2024-11-18 16:16:54.557815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.144 [2024-11-18 16:16:54.558197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.558360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.558387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.144 [2024-11-18 16:16:54.558406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.144 [2024-11-18 16:16:54.558576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.144 [2024-11-18 16:16:54.558709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.144 [2024-11-18 16:16:54.558733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.144 [2024-11-18 16:16:54.558750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.144 [2024-11-18 16:16:54.560726] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.144 [2024-11-18 16:16:54.570264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.144 [2024-11-18 16:16:54.570759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.570945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.570972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.144 [2024-11-18 16:16:54.570993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.144 [2024-11-18 16:16:54.571136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.144 [2024-11-18 16:16:54.571295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.144 [2024-11-18 16:16:54.571326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.144 [2024-11-18 16:16:54.571344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.144 [2024-11-18 16:16:54.573451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.144 [2024-11-18 16:16:54.582577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.144 [2024-11-18 16:16:54.583058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.583230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.583256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.144 [2024-11-18 16:16:54.583276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.144 [2024-11-18 16:16:54.583432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.144 [2024-11-18 16:16:54.583632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.144 [2024-11-18 16:16:54.583655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.144 [2024-11-18 16:16:54.583672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.144 [2024-11-18 16:16:54.585641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.144 [2024-11-18 16:16:54.595011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.144 [2024-11-18 16:16:54.595251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.595363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.595390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.144 [2024-11-18 16:16:54.595406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.144 [2024-11-18 16:16:54.595555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.144 [2024-11-18 16:16:54.595751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.144 [2024-11-18 16:16:54.595773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.144 [2024-11-18 16:16:54.595787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.144 [2024-11-18 16:16:54.597710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.144 [2024-11-18 16:16:54.607401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.144 [2024-11-18 16:16:54.607694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.607823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.607849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.144 [2024-11-18 16:16:54.607865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.144 [2024-11-18 16:16:54.607998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.144 [2024-11-18 16:16:54.608133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.144 [2024-11-18 16:16:54.608154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.144 [2024-11-18 16:16:54.608167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.144 [2024-11-18 16:16:54.610195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.144 [2024-11-18 16:16:54.619786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.144 [2024-11-18 16:16:54.620086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.620170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.620196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.144 [2024-11-18 16:16:54.620212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.144 [2024-11-18 16:16:54.620344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.144 [2024-11-18 16:16:54.620542] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.144 [2024-11-18 16:16:54.620563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.144 [2024-11-18 16:16:54.620576] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.144 [2024-11-18 16:16:54.622666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.144 [2024-11-18 16:16:54.632237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.144 [2024-11-18 16:16:54.632459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.144 [2024-11-18 16:16:54.632621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.632647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.145 [2024-11-18 16:16:54.632663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.145 [2024-11-18 16:16:54.632827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.145 [2024-11-18 16:16:54.633007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.145 [2024-11-18 16:16:54.633028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.145 [2024-11-18 16:16:54.633041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.145 [2024-11-18 16:16:54.635180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.145 [2024-11-18 16:16:54.644406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.145 [2024-11-18 16:16:54.644714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.644813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.644838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.145 [2024-11-18 16:16:54.644854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.145 [2024-11-18 16:16:54.644987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.145 [2024-11-18 16:16:54.645184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.145 [2024-11-18 16:16:54.645205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.145 [2024-11-18 16:16:54.645218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.145 [2024-11-18 16:16:54.647333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.145 [2024-11-18 16:16:54.656654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.145 [2024-11-18 16:16:54.657023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.657149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.657174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.145 [2024-11-18 16:16:54.657190] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.145 [2024-11-18 16:16:54.657338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.145 [2024-11-18 16:16:54.657455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.145 [2024-11-18 16:16:54.657476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.145 [2024-11-18 16:16:54.657489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.145 [2024-11-18 16:16:54.659668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.145 [2024-11-18 16:16:54.669008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.145 [2024-11-18 16:16:54.669280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.669399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.669427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.145 [2024-11-18 16:16:54.669443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.145 [2024-11-18 16:16:54.669591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.145 [2024-11-18 16:16:54.669734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.145 [2024-11-18 16:16:54.669756] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.145 [2024-11-18 16:16:54.669770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.145 [2024-11-18 16:16:54.671773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.145 [2024-11-18 16:16:54.681267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.145 [2024-11-18 16:16:54.681549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.681661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.681688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.145 [2024-11-18 16:16:54.681704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.145 [2024-11-18 16:16:54.681901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.145 [2024-11-18 16:16:54.682065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.145 [2024-11-18 16:16:54.682086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.145 [2024-11-18 16:16:54.682099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.145 [2024-11-18 16:16:54.684177] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.145 [2024-11-18 16:16:54.693516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.145 [2024-11-18 16:16:54.693798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.693911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.693942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.145 [2024-11-18 16:16:54.693958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.145 [2024-11-18 16:16:54.694090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.145 [2024-11-18 16:16:54.694272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.145 [2024-11-18 16:16:54.694293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.145 [2024-11-18 16:16:54.694306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.145 [2024-11-18 16:16:54.696505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.145 [2024-11-18 16:16:54.705930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.145 [2024-11-18 16:16:54.706212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.706334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.706359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.145 [2024-11-18 16:16:54.706375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.145 [2024-11-18 16:16:54.706523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.145 [2024-11-18 16:16:54.706635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.145 [2024-11-18 16:16:54.706657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.145 [2024-11-18 16:16:54.706670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.145 [2024-11-18 16:16:54.708581] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.145 [2024-11-18 16:16:54.718100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.145 [2024-11-18 16:16:54.718359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.718512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.718538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.145 [2024-11-18 16:16:54.718554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.145 [2024-11-18 16:16:54.718791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.145 [2024-11-18 16:16:54.718945] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.145 [2024-11-18 16:16:54.718967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.145 [2024-11-18 16:16:54.718996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.145 [2024-11-18 16:16:54.721083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.145 [2024-11-18 16:16:54.730382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.145 [2024-11-18 16:16:54.730681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.730792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.145 [2024-11-18 16:16:54.730817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.145 [2024-11-18 16:16:54.730839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.145 [2024-11-18 16:16:54.731004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.405 [2024-11-18 16:16:54.731188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.405 [2024-11-18 16:16:54.731209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.405 [2024-11-18 16:16:54.731223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.405 [2024-11-18 16:16:54.733275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.405 [2024-11-18 16:16:54.742592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.405 [2024-11-18 16:16:54.742881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.742995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.743021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.405 [2024-11-18 16:16:54.743038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.405 [2024-11-18 16:16:54.743186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.405 [2024-11-18 16:16:54.743336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.405 [2024-11-18 16:16:54.743357] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.405 [2024-11-18 16:16:54.743370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.405 [2024-11-18 16:16:54.745369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.405 [2024-11-18 16:16:54.754979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.405 [2024-11-18 16:16:54.755291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.755406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.755432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.405 [2024-11-18 16:16:54.755448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.405 [2024-11-18 16:16:54.755564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.405 [2024-11-18 16:16:54.755755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.405 [2024-11-18 16:16:54.755777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.405 [2024-11-18 16:16:54.755791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.405 [2024-11-18 16:16:54.757804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.405 [2024-11-18 16:16:54.767240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.405 [2024-11-18 16:16:54.767559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.767649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.767675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.405 [2024-11-18 16:16:54.767690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.405 [2024-11-18 16:16:54.767860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.405 [2024-11-18 16:16:54.768057] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.405 [2024-11-18 16:16:54.768077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.405 [2024-11-18 16:16:54.768091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.405 [2024-11-18 16:16:54.770295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.405 [2024-11-18 16:16:54.779496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.405 [2024-11-18 16:16:54.779807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.779904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.779929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.405 [2024-11-18 16:16:54.779944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.405 [2024-11-18 16:16:54.780108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.405 [2024-11-18 16:16:54.780242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.405 [2024-11-18 16:16:54.780262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.405 [2024-11-18 16:16:54.780276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.405 [2024-11-18 16:16:54.782163] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.405 [2024-11-18 16:16:54.791868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.405 [2024-11-18 16:16:54.792174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.792291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.792317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.405 [2024-11-18 16:16:54.792333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.405 [2024-11-18 16:16:54.792466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.405 [2024-11-18 16:16:54.792690] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.405 [2024-11-18 16:16:54.792712] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.405 [2024-11-18 16:16:54.792725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.405 [2024-11-18 16:16:54.794678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.405 [2024-11-18 16:16:54.804287] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.405 [2024-11-18 16:16:54.804623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.804743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.405 [2024-11-18 16:16:54.804768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.405 [2024-11-18 16:16:54.804785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.405 [2024-11-18 16:16:54.804949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.405 [2024-11-18 16:16:54.805120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.406 [2024-11-18 16:16:54.805141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.406 [2024-11-18 16:16:54.805154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.406 [2024-11-18 16:16:54.807210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.406 [2024-11-18 16:16:54.816672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.406 [2024-11-18 16:16:54.816940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.817056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.817081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.406 [2024-11-18 16:16:54.817097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.406 [2024-11-18 16:16:54.817230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.406 [2024-11-18 16:16:54.817410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.406 [2024-11-18 16:16:54.817431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.406 [2024-11-18 16:16:54.817444] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.406 [2024-11-18 16:16:54.819372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.406 [2024-11-18 16:16:54.829052] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.406 [2024-11-18 16:16:54.829370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.829458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.829483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.406 [2024-11-18 16:16:54.829500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.406 [2024-11-18 16:16:54.829639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.406 [2024-11-18 16:16:54.829808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.406 [2024-11-18 16:16:54.829829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.406 [2024-11-18 16:16:54.829842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.406 [2024-11-18 16:16:54.832059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.406 [2024-11-18 16:16:54.841309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.406 [2024-11-18 16:16:54.841617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.841742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.841767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.406 [2024-11-18 16:16:54.841782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.406 [2024-11-18 16:16:54.841979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.406 [2024-11-18 16:16:54.842111] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.406 [2024-11-18 16:16:54.842136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.406 [2024-11-18 16:16:54.842150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.406 [2024-11-18 16:16:54.844428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.406 [2024-11-18 16:16:54.853489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.406 [2024-11-18 16:16:54.853743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.853837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.853862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.406 [2024-11-18 16:16:54.853878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.406 [2024-11-18 16:16:54.853977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.406 [2024-11-18 16:16:54.854113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.406 [2024-11-18 16:16:54.854134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.406 [2024-11-18 16:16:54.854148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.406 [2024-11-18 16:16:54.856397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.406 [2024-11-18 16:16:54.865888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.406 [2024-11-18 16:16:54.866210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.866300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.866326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.406 [2024-11-18 16:16:54.866342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.406 [2024-11-18 16:16:54.866457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.406 [2024-11-18 16:16:54.866699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.406 [2024-11-18 16:16:54.866721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.406 [2024-11-18 16:16:54.866735] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.406 [2024-11-18 16:16:54.868708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.406 [2024-11-18 16:16:54.878045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.406 [2024-11-18 16:16:54.878295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.878404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.878430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.406 [2024-11-18 16:16:54.878446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.406 [2024-11-18 16:16:54.878618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.406 [2024-11-18 16:16:54.878722] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.406 [2024-11-18 16:16:54.878743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.406 [2024-11-18 16:16:54.878762] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.406 [2024-11-18 16:16:54.880813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.406 [2024-11-18 16:16:54.890282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.406 [2024-11-18 16:16:54.890560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.890658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.890685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.406 [2024-11-18 16:16:54.890701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.406 [2024-11-18 16:16:54.890898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.406 [2024-11-18 16:16:54.891061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.406 [2024-11-18 16:16:54.891082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.406 [2024-11-18 16:16:54.891096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.406 [2024-11-18 16:16:54.893167] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.406 [2024-11-18 16:16:54.902402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.406 [2024-11-18 16:16:54.902713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.902830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.902855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.406 [2024-11-18 16:16:54.902871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.406 [2024-11-18 16:16:54.903019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.406 [2024-11-18 16:16:54.903199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.406 [2024-11-18 16:16:54.903220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.406 [2024-11-18 16:16:54.903233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.406 [2024-11-18 16:16:54.905291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.406 [2024-11-18 16:16:54.914704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.406 [2024-11-18 16:16:54.915075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.915198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.406 [2024-11-18 16:16:54.915224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.406 [2024-11-18 16:16:54.915240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.406 [2024-11-18 16:16:54.915388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.406 [2024-11-18 16:16:54.915523] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.406 [2024-11-18 16:16:54.915544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.406 [2024-11-18 16:16:54.915558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.406 [2024-11-18 16:16:54.917639] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.407 [2024-11-18 16:16:54.926820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.407 [2024-11-18 16:16:54.927129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.927212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.927238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.407 [2024-11-18 16:16:54.927254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.407 [2024-11-18 16:16:54.927354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.407 [2024-11-18 16:16:54.927522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.407 [2024-11-18 16:16:54.927543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.407 [2024-11-18 16:16:54.927556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.407 [2024-11-18 16:16:54.929692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.407 [2024-11-18 16:16:54.939073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.407 [2024-11-18 16:16:54.939362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.939477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.939503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.407 [2024-11-18 16:16:54.939520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.407 [2024-11-18 16:16:54.939709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.407 [2024-11-18 16:16:54.939862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.407 [2024-11-18 16:16:54.939883] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.407 [2024-11-18 16:16:54.939896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.407 [2024-11-18 16:16:54.942054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.407 [2024-11-18 16:16:54.951291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.407 [2024-11-18 16:16:54.951582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.951736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.951763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.407 [2024-11-18 16:16:54.951779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.407 [2024-11-18 16:16:54.951944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.407 [2024-11-18 16:16:54.952093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.407 [2024-11-18 16:16:54.952113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.407 [2024-11-18 16:16:54.952126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.407 [2024-11-18 16:16:54.954281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.407 [2024-11-18 16:16:54.963407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.407 [2024-11-18 16:16:54.963702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.963797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.963823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.407 [2024-11-18 16:16:54.963839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.407 [2024-11-18 16:16:54.964004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.407 [2024-11-18 16:16:54.964153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.407 [2024-11-18 16:16:54.964174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.407 [2024-11-18 16:16:54.964187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.407 [2024-11-18 16:16:54.966246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.407 [2024-11-18 16:16:54.975815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.407 [2024-11-18 16:16:54.976121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.976209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.976234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.407 [2024-11-18 16:16:54.976249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.407 [2024-11-18 16:16:54.976446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.407 [2024-11-18 16:16:54.976619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.407 [2024-11-18 16:16:54.976641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.407 [2024-11-18 16:16:54.976655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.407 [2024-11-18 16:16:54.978428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.407 [2024-11-18 16:16:54.988169] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.407 [2024-11-18 16:16:54.988431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.988571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.407 [2024-11-18 16:16:54.988596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.407 [2024-11-18 16:16:54.988619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.407 [2024-11-18 16:16:54.988785] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.407 [2024-11-18 16:16:54.988954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.407 [2024-11-18 16:16:54.988975] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.407 [2024-11-18 16:16:54.988988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.407 [2024-11-18 16:16:54.991083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.666 [2024-11-18 16:16:55.000560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.666 [2024-11-18 16:16:55.000824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.666 [2024-11-18 16:16:55.000939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.666 [2024-11-18 16:16:55.000965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.667 [2024-11-18 16:16:55.000981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.667 [2024-11-18 16:16:55.001097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.667 [2024-11-18 16:16:55.001296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.667 [2024-11-18 16:16:55.001317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.667 [2024-11-18 16:16:55.001331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.667 [2024-11-18 16:16:55.003451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.667 [2024-11-18 16:16:55.012981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.667 [2024-11-18 16:16:55.013290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.013429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.013454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.667 [2024-11-18 16:16:55.013470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.667 [2024-11-18 16:16:55.013644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.667 [2024-11-18 16:16:55.013813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.667 [2024-11-18 16:16:55.013835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.667 [2024-11-18 16:16:55.013848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.667 [2024-11-18 16:16:55.016058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.667 [2024-11-18 16:16:55.025200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.667 [2024-11-18 16:16:55.025442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.025557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.025582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.667 [2024-11-18 16:16:55.025599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.667 [2024-11-18 16:16:55.025707] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.667 [2024-11-18 16:16:55.025827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.667 [2024-11-18 16:16:55.025848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.667 [2024-11-18 16:16:55.025862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.667 [2024-11-18 16:16:55.027891] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.667 [2024-11-18 16:16:55.037567] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.667 [2024-11-18 16:16:55.037891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.038008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.038034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.667 [2024-11-18 16:16:55.038055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.667 [2024-11-18 16:16:55.038188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.667 [2024-11-18 16:16:55.038338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.667 [2024-11-18 16:16:55.038359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.667 [2024-11-18 16:16:55.038372] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.667 [2024-11-18 16:16:55.040226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.667 [2024-11-18 16:16:55.049884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.667 [2024-11-18 16:16:55.050164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.050278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.050304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.667 [2024-11-18 16:16:55.050320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.667 [2024-11-18 16:16:55.050468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.667 [2024-11-18 16:16:55.050643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.667 [2024-11-18 16:16:55.050665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.667 [2024-11-18 16:16:55.050679] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.667 [2024-11-18 16:16:55.052770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.667 [2024-11-18 16:16:55.061975] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.667 [2024-11-18 16:16:55.062257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.062375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.062400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.667 [2024-11-18 16:16:55.062416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.667 [2024-11-18 16:16:55.062531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.667 [2024-11-18 16:16:55.062720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.667 [2024-11-18 16:16:55.062742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.667 [2024-11-18 16:16:55.062756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.667 [2024-11-18 16:16:55.064799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.667 [2024-11-18 16:16:55.074326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.667 [2024-11-18 16:16:55.074625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.074774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.074800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.667 [2024-11-18 16:16:55.074816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.667 [2024-11-18 16:16:55.075002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.667 [2024-11-18 16:16:55.075166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.667 [2024-11-18 16:16:55.075187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.667 [2024-11-18 16:16:55.075200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.667 [2024-11-18 16:16:55.077323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.667 [2024-11-18 16:16:55.086756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.667 [2024-11-18 16:16:55.087034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.087125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.087151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.667 [2024-11-18 16:16:55.087167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.667 [2024-11-18 16:16:55.087347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.667 [2024-11-18 16:16:55.087481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.667 [2024-11-18 16:16:55.087501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.667 [2024-11-18 16:16:55.087514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.667 [2024-11-18 16:16:55.089581] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.667 [2024-11-18 16:16:55.099192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.667 [2024-11-18 16:16:55.099514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.099642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.099668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.667 [2024-11-18 16:16:55.099684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.667 [2024-11-18 16:16:55.099849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.667 [2024-11-18 16:16:55.099967] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.667 [2024-11-18 16:16:55.099988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.667 [2024-11-18 16:16:55.100002] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.667 [2024-11-18 16:16:55.101993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.667 [2024-11-18 16:16:55.111469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.667 [2024-11-18 16:16:55.111771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.111864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.667 [2024-11-18 16:16:55.111889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.667 [2024-11-18 16:16:55.111904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.667 [2024-11-18 16:16:55.112068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.668 [2024-11-18 16:16:55.112255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.668 [2024-11-18 16:16:55.112277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.668 [2024-11-18 16:16:55.112291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.668 [2024-11-18 16:16:55.114384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.668 [2024-11-18 16:16:55.123745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.668 [2024-11-18 16:16:55.124076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.124162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.124187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.668 [2024-11-18 16:16:55.124204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.668 [2024-11-18 16:16:55.124352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.668 [2024-11-18 16:16:55.124471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.668 [2024-11-18 16:16:55.124492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.668 [2024-11-18 16:16:55.124506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.668 [2024-11-18 16:16:55.126719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.668 [2024-11-18 16:16:55.135883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.668 [2024-11-18 16:16:55.136198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.136339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.136365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.668 [2024-11-18 16:16:55.136381] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.668 [2024-11-18 16:16:55.136562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.668 [2024-11-18 16:16:55.136768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.668 [2024-11-18 16:16:55.136791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.668 [2024-11-18 16:16:55.136804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.668 [2024-11-18 16:16:55.138995] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.668 [2024-11-18 16:16:55.148201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.668 [2024-11-18 16:16:55.148539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.148654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.148680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.668 [2024-11-18 16:16:55.148697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.668 [2024-11-18 16:16:55.148813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.668 [2024-11-18 16:16:55.148995] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.668 [2024-11-18 16:16:55.149024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.668 [2024-11-18 16:16:55.149038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.668 [2024-11-18 16:16:55.151040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.668 [2024-11-18 16:16:55.160598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.668 [2024-11-18 16:16:55.160895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.161043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.161069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.668 [2024-11-18 16:16:55.161085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.668 [2024-11-18 16:16:55.161250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.668 [2024-11-18 16:16:55.161432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.668 [2024-11-18 16:16:55.161453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.668 [2024-11-18 16:16:55.161466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.668 [2024-11-18 16:16:55.163598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.668 [2024-11-18 16:16:55.172878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.668 [2024-11-18 16:16:55.173166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.173320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.173346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.668 [2024-11-18 16:16:55.173362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.668 [2024-11-18 16:16:55.173527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.668 [2024-11-18 16:16:55.173703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.668 [2024-11-18 16:16:55.173726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.668 [2024-11-18 16:16:55.173739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.668 [2024-11-18 16:16:55.175602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.668 [2024-11-18 16:16:55.185036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.668 [2024-11-18 16:16:55.185372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.185461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.185487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.668 [2024-11-18 16:16:55.185503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.668 [2024-11-18 16:16:55.185629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.668 [2024-11-18 16:16:55.185783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.668 [2024-11-18 16:16:55.185804] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.668 [2024-11-18 16:16:55.185823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.668 [2024-11-18 16:16:55.188041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.668 [2024-11-18 16:16:55.197516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.668 [2024-11-18 16:16:55.197814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.197903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.197929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.668 [2024-11-18 16:16:55.197945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.668 [2024-11-18 16:16:55.198077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.668 [2024-11-18 16:16:55.198243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.668 [2024-11-18 16:16:55.198265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.668 [2024-11-18 16:16:55.198277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.668 [2024-11-18 16:16:55.200330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.668 [2024-11-18 16:16:55.209979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.668 [2024-11-18 16:16:55.210267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.210388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.210414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.668 [2024-11-18 16:16:55.210431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.668 [2024-11-18 16:16:55.210597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.668 [2024-11-18 16:16:55.210760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.668 [2024-11-18 16:16:55.210782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.668 [2024-11-18 16:16:55.210796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.668 [2024-11-18 16:16:55.212963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.668 [2024-11-18 16:16:55.222326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.668 [2024-11-18 16:16:55.222564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.222670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.668 [2024-11-18 16:16:55.222696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.668 [2024-11-18 16:16:55.222713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.668 [2024-11-18 16:16:55.222894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.668 [2024-11-18 16:16:55.223076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.668 [2024-11-18 16:16:55.223097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.668 [2024-11-18 16:16:55.223110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.669 [2024-11-18 16:16:55.225033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.669 [2024-11-18 16:16:55.234601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.669 [2024-11-18 16:16:55.234897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.669 [2024-11-18 16:16:55.235040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.669 [2024-11-18 16:16:55.235066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.669 [2024-11-18 16:16:55.235083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.669 [2024-11-18 16:16:55.235216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.669 [2024-11-18 16:16:55.235398] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.669 [2024-11-18 16:16:55.235419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.669 [2024-11-18 16:16:55.235432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.669 [2024-11-18 16:16:55.237454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.669 [2024-11-18 16:16:55.246888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.669 [2024-11-18 16:16:55.247183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.669 [2024-11-18 16:16:55.247296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.669 [2024-11-18 16:16:55.247321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.669 [2024-11-18 16:16:55.247337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.669 [2024-11-18 16:16:55.247485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.669 [2024-11-18 16:16:55.247663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.669 [2024-11-18 16:16:55.247685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.669 [2024-11-18 16:16:55.247698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.669 [2024-11-18 16:16:55.249808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.928 [2024-11-18 16:16:55.259315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.928 [2024-11-18 16:16:55.259593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.928 [2024-11-18 16:16:55.259685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.928 [2024-11-18 16:16:55.259711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.928 [2024-11-18 16:16:55.259727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.928 [2024-11-18 16:16:55.259876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.928 [2024-11-18 16:16:55.260028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.928 [2024-11-18 16:16:55.260050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.928 [2024-11-18 16:16:55.260063] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.928 [2024-11-18 16:16:55.262166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.928 [2024-11-18 16:16:55.271605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.928 [2024-11-18 16:16:55.271885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.928 [2024-11-18 16:16:55.272028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.928 [2024-11-18 16:16:55.272054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.928 [2024-11-18 16:16:55.272070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.928 [2024-11-18 16:16:55.272234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.928 [2024-11-18 16:16:55.272384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.928 [2024-11-18 16:16:55.272405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.928 [2024-11-18 16:16:55.272417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.928 [2024-11-18 16:16:55.274524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.928 [2024-11-18 16:16:55.283965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.928 [2024-11-18 16:16:55.284244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.928 [2024-11-18 16:16:55.284359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.928 [2024-11-18 16:16:55.284385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.928 [2024-11-18 16:16:55.284401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.928 [2024-11-18 16:16:55.284550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.928 [2024-11-18 16:16:55.284694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.928 [2024-11-18 16:16:55.284717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.928 [2024-11-18 16:16:55.284731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.928 [2024-11-18 16:16:55.286903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.928 [2024-11-18 16:16:55.296397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.928 [2024-11-18 16:16:55.296701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.928 [2024-11-18 16:16:55.296840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.928 [2024-11-18 16:16:55.296866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.928 [2024-11-18 16:16:55.296882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.928 [2024-11-18 16:16:55.297030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.928 [2024-11-18 16:16:55.297183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.929 [2024-11-18 16:16:55.297204] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.929 [2024-11-18 16:16:55.297217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.929 [2024-11-18 16:16:55.299413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.929 [2024-11-18 16:16:55.308631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.929 [2024-11-18 16:16:55.308871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.308986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.309012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.929 [2024-11-18 16:16:55.309028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.929 [2024-11-18 16:16:55.309192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.929 [2024-11-18 16:16:55.309344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.929 [2024-11-18 16:16:55.309366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.929 [2024-11-18 16:16:55.309379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.929 [2024-11-18 16:16:55.311464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.929 16:16:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:31.929 16:16:55 -- common/autotest_common.sh@862 -- # return 0 00:30:31.929 16:16:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:31.929 16:16:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:31.929 16:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:31.929 [2024-11-18 16:16:55.320840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.929 [2024-11-18 16:16:55.321167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.321284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.321309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.929 [2024-11-18 16:16:55.321325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.929 [2024-11-18 16:16:55.321473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.929 [2024-11-18 16:16:55.321663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.929 [2024-11-18 16:16:55.321686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.929 [2024-11-18 16:16:55.321699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.929 [2024-11-18 16:16:55.323840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.929 [2024-11-18 16:16:55.333070] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.929 [2024-11-18 16:16:55.333344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.333436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.333461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.929 [2024-11-18 16:16:55.333476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.929 [2024-11-18 16:16:55.333634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.929 [2024-11-18 16:16:55.333820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.929 [2024-11-18 16:16:55.333842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.929 [2024-11-18 16:16:55.333856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.929 [2024-11-18 16:16:55.336059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.929 16:16:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:31.929 16:16:55 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:31.929 16:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.929 16:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:31.929 [2024-11-18 16:16:55.345127] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:31.929 [2024-11-18 16:16:55.345545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.929 [2024-11-18 16:16:55.345825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.345920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.345946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.929 [2024-11-18 16:16:55.345962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.929 [2024-11-18 16:16:55.346127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.929 [2024-11-18 16:16:55.346292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.929 [2024-11-18 16:16:55.346312] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.929 [2024-11-18 16:16:55.346325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.929 [2024-11-18 16:16:55.348334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.929 16:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.929 16:16:55 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:31.929 16:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.929 16:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:31.929 [2024-11-18 16:16:55.357810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.929 [2024-11-18 16:16:55.358122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.358248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.358273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.929 [2024-11-18 16:16:55.358289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.929 [2024-11-18 16:16:55.358453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.929 [2024-11-18 16:16:55.358660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.929 [2024-11-18 16:16:55.358682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.929 [2024-11-18 16:16:55.358696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.929 [2024-11-18 16:16:55.360701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.929 [2024-11-18 16:16:55.370194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.929 [2024-11-18 16:16:55.370489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.370616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.370642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.929 [2024-11-18 16:16:55.370658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.929 [2024-11-18 16:16:55.370774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.929 [2024-11-18 16:16:55.371007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.929 [2024-11-18 16:16:55.371028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.929 [2024-11-18 16:16:55.371055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.929 [2024-11-18 16:16:55.373092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.929 [2024-11-18 16:16:55.382369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.929 [2024-11-18 16:16:55.382725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.382820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.929 [2024-11-18 16:16:55.382847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.929 [2024-11-18 16:16:55.382866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.929 [2024-11-18 16:16:55.383023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.930 [2024-11-18 16:16:55.383176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.930 [2024-11-18 16:16:55.383198] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.930 [2024-11-18 16:16:55.383214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.930 [2024-11-18 16:16:55.385438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.930 [2024-11-18 16:16:55.394699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.930 [2024-11-18 16:16:55.395182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.930 [2024-11-18 16:16:55.395315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.930 [2024-11-18 16:16:55.395341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.930 [2024-11-18 16:16:55.395361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.930 [2024-11-18 16:16:55.395534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.930 [2024-11-18 16:16:55.395762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.930 [2024-11-18 16:16:55.395786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.930 [2024-11-18 16:16:55.395803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.930 Malloc0 00:30:31.930 16:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.930 16:16:55 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:31.930 16:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.930 16:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:31.930 [2024-11-18 16:16:55.398156] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.930 16:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.930 16:16:55 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:31.930 16:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.930 16:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:31.930 [2024-11-18 16:16:55.407106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.930 [2024-11-18 16:16:55.407373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.930 [2024-11-18 16:16:55.407524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.930 [2024-11-18 16:16:55.407549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd78870 with addr=10.0.0.2, port=4420 00:30:31.930 [2024-11-18 16:16:55.407576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd78870 is same with the state(5) to be set 00:30:31.930 [2024-11-18 16:16:55.407717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd78870 (9): Bad file descriptor 00:30:31.930 [2024-11-18 16:16:55.407870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:31.930 [2024-11-18 16:16:55.407892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:31.930 [2024-11-18 16:16:55.407906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:31.930 [2024-11-18 16:16:55.410197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:31.930 16:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.930 16:16:55 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:31.930 16:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.930 16:16:55 -- common/autotest_common.sh@10 -- # set +x 00:30:31.930 [2024-11-18 16:16:55.416089] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:31.930 [2024-11-18 16:16:55.419647] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:31.930 16:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.930 16:16:55 -- host/bdevperf.sh@38 -- # wait 1713204 00:30:31.930 [2024-11-18 16:16:55.451896] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:41.895 00:30:41.895 Latency(us) 00:30:41.895 [2024-11-18T15:17:05.486Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:41.895 [2024-11-18T15:17:05.486Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:41.895 Verification LBA range: start 0x0 length 0x4000 00:30:41.895 Nvme1n1 : 15.01 9357.13 36.55 17116.21 0.00 4821.06 685.70 20194.80 00:30:41.895 [2024-11-18T15:17:05.486Z] =================================================================================================================== 00:30:41.895 [2024-11-18T15:17:05.486Z] Total : 9357.13 36.55 17116.21 0.00 4821.06 685.70 20194.80 00:30:41.895 16:17:04 -- host/bdevperf.sh@39 -- # sync 00:30:41.895 16:17:04 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:41.895 16:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:41.895 16:17:04 -- common/autotest_common.sh@10 -- # set +x 00:30:41.895 16:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:41.895 16:17:04 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:41.895 16:17:04 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:41.895 16:17:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:41.895 16:17:04 -- nvmf/common.sh@116 -- # sync 00:30:41.895 16:17:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:41.895 16:17:04 -- nvmf/common.sh@119 -- # set +e 00:30:41.895 16:17:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:41.895 16:17:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:41.896 rmmod nvme_tcp 00:30:41.896 rmmod nvme_fabrics 00:30:41.896 rmmod nvme_keyring 00:30:41.896 16:17:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:41.896 16:17:04 -- nvmf/common.sh@123 -- # set -e 00:30:41.896 16:17:04 -- nvmf/common.sh@124 -- # return 0 00:30:41.896 16:17:04 -- nvmf/common.sh@477 -- # '[' -n 1713894 ']' 00:30:41.896 16:17:04 -- nvmf/common.sh@478 -- # killprocess 1713894 00:30:41.896 16:17:04 -- common/autotest_common.sh@936 -- # '[' -z 1713894 ']' 00:30:41.896 16:17:04 -- common/autotest_common.sh@940 -- # kill -0 1713894 00:30:41.896 16:17:04 -- common/autotest_common.sh@941 -- # uname 00:30:41.896 16:17:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:41.896 16:17:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1713894 00:30:41.896 16:17:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:41.896 16:17:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:41.896 16:17:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1713894' 00:30:41.896 killing process with pid 1713894 00:30:41.896 16:17:04 -- common/autotest_common.sh@955 -- # kill 1713894 00:30:41.896 16:17:04 -- common/autotest_common.sh@960 -- # wait 1713894 00:30:41.896 16:17:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:41.896 16:17:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:41.896 16:17:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:41.896 16:17:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:41.896 16:17:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:41.896 16:17:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:41.896 16:17:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:41.896 16:17:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:42.831 16:17:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:42.831 00:30:42.831 real 0m23.328s 00:30:42.831 user 1m3.162s 00:30:42.831 sys 0m4.142s 00:30:42.831 16:17:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:42.831 16:17:06 -- common/autotest_common.sh@10 -- # set +x 00:30:42.831 ************************************ 00:30:42.831 END TEST nvmf_bdevperf 00:30:42.831 ************************************ 00:30:43.090 16:17:06 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:43.090 16:17:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:43.090 16:17:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:43.090 16:17:06 -- common/autotest_common.sh@10 -- # set +x 00:30:43.090 ************************************ 00:30:43.090 START TEST nvmf_target_disconnect 00:30:43.090 ************************************ 00:30:43.090 16:17:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:43.090 * Looking for test storage... 00:30:43.090 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:43.090 16:17:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:43.090 16:17:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:43.090 16:17:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:43.090 16:17:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:43.090 16:17:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:43.090 16:17:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:43.090 16:17:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:43.090 16:17:06 -- scripts/common.sh@335 -- # IFS=.-: 00:30:43.090 16:17:06 -- scripts/common.sh@335 -- # read -ra ver1 00:30:43.090 16:17:06 -- scripts/common.sh@336 -- # IFS=.-: 00:30:43.090 16:17:06 -- scripts/common.sh@336 -- # read -ra ver2 00:30:43.090 16:17:06 -- scripts/common.sh@337 -- # local 'op=<' 00:30:43.090 16:17:06 -- scripts/common.sh@339 -- # ver1_l=2 00:30:43.090 16:17:06 -- scripts/common.sh@340 -- # ver2_l=1 00:30:43.090 16:17:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:43.090 16:17:06 -- scripts/common.sh@343 -- # case "$op" in 00:30:43.090 16:17:06 -- scripts/common.sh@344 -- # : 1 00:30:43.090 16:17:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:43.090 16:17:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:43.090 16:17:06 -- scripts/common.sh@364 -- # decimal 1 00:30:43.090 16:17:06 -- scripts/common.sh@352 -- # local d=1 00:30:43.090 16:17:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:43.090 16:17:06 -- scripts/common.sh@354 -- # echo 1 00:30:43.090 16:17:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:43.090 16:17:06 -- scripts/common.sh@365 -- # decimal 2 00:30:43.090 16:17:06 -- scripts/common.sh@352 -- # local d=2 00:30:43.090 16:17:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:43.090 16:17:06 -- scripts/common.sh@354 -- # echo 2 00:30:43.090 16:17:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:43.090 16:17:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:43.090 16:17:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:43.090 16:17:06 -- scripts/common.sh@367 -- # return 0 00:30:43.090 16:17:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:43.090 16:17:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:43.090 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:43.090 --rc genhtml_branch_coverage=1 00:30:43.090 --rc genhtml_function_coverage=1 00:30:43.090 --rc genhtml_legend=1 00:30:43.090 --rc geninfo_all_blocks=1 00:30:43.090 --rc geninfo_unexecuted_blocks=1 00:30:43.090 00:30:43.090 ' 00:30:43.090 16:17:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:43.090 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:43.090 --rc genhtml_branch_coverage=1 00:30:43.090 --rc genhtml_function_coverage=1 00:30:43.090 --rc genhtml_legend=1 00:30:43.090 --rc geninfo_all_blocks=1 00:30:43.090 --rc geninfo_unexecuted_blocks=1 00:30:43.090 00:30:43.090 ' 00:30:43.090 16:17:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:43.090 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:43.090 --rc genhtml_branch_coverage=1 00:30:43.090 --rc genhtml_function_coverage=1 00:30:43.090 --rc genhtml_legend=1 00:30:43.090 --rc geninfo_all_blocks=1 00:30:43.090 --rc geninfo_unexecuted_blocks=1 00:30:43.090 00:30:43.090 ' 00:30:43.090 16:17:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:43.090 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:43.090 --rc genhtml_branch_coverage=1 00:30:43.090 --rc genhtml_function_coverage=1 00:30:43.090 --rc genhtml_legend=1 00:30:43.090 --rc geninfo_all_blocks=1 00:30:43.090 --rc geninfo_unexecuted_blocks=1 00:30:43.090 00:30:43.090 ' 00:30:43.090 16:17:06 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:43.090 16:17:06 -- nvmf/common.sh@7 -- # uname -s 00:30:43.090 16:17:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:43.090 16:17:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:43.090 16:17:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:43.090 16:17:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:43.090 16:17:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:43.090 16:17:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:43.090 16:17:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:43.090 16:17:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:43.090 16:17:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:43.090 16:17:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:43.090 16:17:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:43.090 16:17:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:43.090 16:17:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:43.090 16:17:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:43.090 16:17:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:43.090 16:17:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:43.090 16:17:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:43.090 16:17:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:43.090 16:17:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:43.090 16:17:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:43.090 16:17:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:43.090 16:17:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:43.090 16:17:06 -- paths/export.sh@5 -- # export PATH 00:30:43.091 16:17:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:43.091 16:17:06 -- nvmf/common.sh@46 -- # : 0 00:30:43.091 16:17:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:43.091 16:17:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:43.091 16:17:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:43.091 16:17:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:43.091 16:17:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:43.091 16:17:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:43.091 16:17:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:43.091 16:17:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:43.091 16:17:06 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:43.091 16:17:06 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:43.091 16:17:06 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:43.091 16:17:06 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:43.091 16:17:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:43.091 16:17:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:43.091 16:17:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:43.091 16:17:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:43.091 16:17:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:43.091 16:17:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:43.091 16:17:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:43.091 16:17:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:43.091 16:17:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:43.091 16:17:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:43.091 16:17:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:43.091 16:17:06 -- common/autotest_common.sh@10 -- # set +x 00:30:45.621 16:17:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:45.621 16:17:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:45.621 16:17:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:45.621 16:17:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:45.621 16:17:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:45.621 16:17:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:45.621 16:17:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:45.621 16:17:08 -- nvmf/common.sh@294 -- # net_devs=() 00:30:45.621 16:17:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:45.621 16:17:08 -- nvmf/common.sh@295 -- # e810=() 00:30:45.621 16:17:08 -- nvmf/common.sh@295 -- # local -ga e810 00:30:45.621 16:17:08 -- nvmf/common.sh@296 -- # x722=() 00:30:45.621 16:17:08 -- nvmf/common.sh@296 -- # local -ga x722 00:30:45.621 16:17:08 -- nvmf/common.sh@297 -- # mlx=() 00:30:45.621 16:17:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:45.621 16:17:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:45.621 16:17:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:45.621 16:17:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:45.621 16:17:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:45.621 16:17:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:45.621 16:17:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:45.621 16:17:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:45.621 16:17:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:45.621 16:17:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:45.621 16:17:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:45.621 16:17:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:45.621 16:17:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:45.621 16:17:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:45.621 16:17:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:45.621 16:17:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:45.621 16:17:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:45.621 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:45.621 16:17:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:45.621 16:17:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:45.621 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:45.621 16:17:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:45.621 16:17:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:45.621 16:17:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:45.621 16:17:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:45.621 16:17:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:45.621 16:17:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:45.621 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:45.621 16:17:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:45.621 16:17:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:45.621 16:17:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:45.621 16:17:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:45.621 16:17:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:45.621 16:17:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:45.621 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:45.621 16:17:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:45.621 16:17:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:45.621 16:17:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:45.621 16:17:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:45.621 16:17:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:45.621 16:17:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:45.621 16:17:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:45.621 16:17:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:45.621 16:17:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:45.621 16:17:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:45.621 16:17:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:45.621 16:17:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:45.621 16:17:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:45.621 16:17:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:45.621 16:17:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:45.621 16:17:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:45.621 16:17:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:45.621 16:17:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:45.621 16:17:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:45.621 16:17:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:45.621 16:17:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:45.621 16:17:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:45.621 16:17:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:45.621 16:17:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:45.621 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:45.621 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.311 ms 00:30:45.621 00:30:45.621 --- 10.0.0.2 ping statistics --- 00:30:45.621 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:45.621 rtt min/avg/max/mdev = 0.311/0.311/0.311/0.000 ms 00:30:45.621 16:17:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:45.621 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:45.621 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.133 ms 00:30:45.621 00:30:45.621 --- 10.0.0.1 ping statistics --- 00:30:45.621 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:45.621 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:30:45.621 16:17:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:45.621 16:17:08 -- nvmf/common.sh@410 -- # return 0 00:30:45.621 16:17:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:45.621 16:17:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:45.621 16:17:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:45.621 16:17:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:45.621 16:17:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:45.621 16:17:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:45.621 16:17:08 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:45.621 16:17:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:45.621 16:17:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:45.621 16:17:08 -- common/autotest_common.sh@10 -- # set +x 00:30:45.621 ************************************ 00:30:45.621 START TEST nvmf_target_disconnect_tc1 00:30:45.621 ************************************ 00:30:45.621 16:17:08 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:45.621 16:17:08 -- host/target_disconnect.sh@32 -- # set +e 00:30:45.621 16:17:08 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:45.621 EAL: No free 2048 kB hugepages reported on node 1 00:30:45.621 [2024-11-18 16:17:08.996473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:45.621 [2024-11-18 16:17:08.996677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:45.621 [2024-11-18 16:17:08.996710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x558df0 with addr=10.0.0.2, port=4420 00:30:45.621 [2024-11-18 16:17:08.996751] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:45.621 [2024-11-18 16:17:08.996775] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:45.621 [2024-11-18 16:17:08.996790] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:45.621 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:45.621 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:45.621 Initializing NVMe Controllers 00:30:45.621 16:17:09 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:45.622 16:17:09 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:45.622 16:17:09 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:45.622 16:17:09 -- common/autotest_common.sh@1142 -- # return 0 00:30:45.622 16:17:09 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:45.622 16:17:09 -- host/target_disconnect.sh@41 -- # set -e 00:30:45.622 00:30:45.622 real 0m0.091s 00:30:45.622 user 0m0.042s 00:30:45.622 sys 0m0.048s 00:30:45.622 16:17:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:45.622 16:17:09 -- common/autotest_common.sh@10 -- # set +x 00:30:45.622 ************************************ 00:30:45.622 END TEST nvmf_target_disconnect_tc1 00:30:45.622 ************************************ 00:30:45.622 16:17:09 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:45.622 16:17:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:45.622 16:17:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:45.622 16:17:09 -- common/autotest_common.sh@10 -- # set +x 00:30:45.622 ************************************ 00:30:45.622 START TEST nvmf_target_disconnect_tc2 00:30:45.622 ************************************ 00:30:45.622 16:17:09 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:45.622 16:17:09 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:45.622 16:17:09 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:45.622 16:17:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:45.622 16:17:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:45.622 16:17:09 -- common/autotest_common.sh@10 -- # set +x 00:30:45.622 16:17:09 -- nvmf/common.sh@469 -- # nvmfpid=1717108 00:30:45.622 16:17:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:45.622 16:17:09 -- nvmf/common.sh@470 -- # waitforlisten 1717108 00:30:45.622 16:17:09 -- common/autotest_common.sh@829 -- # '[' -z 1717108 ']' 00:30:45.622 16:17:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:45.622 16:17:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:45.622 16:17:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:45.622 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:45.622 16:17:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:45.622 16:17:09 -- common/autotest_common.sh@10 -- # set +x 00:30:45.622 [2024-11-18 16:17:09.077847] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:45.622 [2024-11-18 16:17:09.077947] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:45.622 EAL: No free 2048 kB hugepages reported on node 1 00:30:45.622 [2024-11-18 16:17:09.144359] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:45.879 [2024-11-18 16:17:09.236705] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:45.879 [2024-11-18 16:17:09.236853] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:45.879 [2024-11-18 16:17:09.236870] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:45.879 [2024-11-18 16:17:09.236883] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:45.879 [2024-11-18 16:17:09.236971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:45.879 [2024-11-18 16:17:09.237035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:45.879 [2024-11-18 16:17:09.237086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:45.879 [2024-11-18 16:17:09.237089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:46.811 16:17:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:46.811 16:17:10 -- common/autotest_common.sh@862 -- # return 0 00:30:46.811 16:17:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:46.811 16:17:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:46.811 16:17:10 -- common/autotest_common.sh@10 -- # set +x 00:30:46.811 16:17:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:46.811 16:17:10 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:46.811 16:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:46.811 16:17:10 -- common/autotest_common.sh@10 -- # set +x 00:30:46.811 Malloc0 00:30:46.811 16:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:46.812 16:17:10 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:46.812 16:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:46.812 16:17:10 -- common/autotest_common.sh@10 -- # set +x 00:30:46.812 [2024-11-18 16:17:10.099857] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:46.812 16:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:46.812 16:17:10 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:46.812 16:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:46.812 16:17:10 -- common/autotest_common.sh@10 -- # set +x 00:30:46.812 16:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:46.812 16:17:10 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:46.812 16:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:46.812 16:17:10 -- common/autotest_common.sh@10 -- # set +x 00:30:46.812 16:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:46.812 16:17:10 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:46.812 16:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:46.812 16:17:10 -- common/autotest_common.sh@10 -- # set +x 00:30:46.812 [2024-11-18 16:17:10.128145] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:46.812 16:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:46.812 16:17:10 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:46.812 16:17:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:46.812 16:17:10 -- common/autotest_common.sh@10 -- # set +x 00:30:46.812 16:17:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:46.812 16:17:10 -- host/target_disconnect.sh@50 -- # reconnectpid=1717268 00:30:46.812 16:17:10 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:46.812 16:17:10 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:46.812 EAL: No free 2048 kB hugepages reported on node 1 00:30:48.728 16:17:12 -- host/target_disconnect.sh@53 -- # kill -9 1717108 00:30:48.728 16:17:12 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 [2024-11-18 16:17:12.151829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Write completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 [2024-11-18 16:17:12.152153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.728 Read completed with error (sct=0, sc=8) 00:30:48.728 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Write completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Write completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Write completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Write completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Write completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Write completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 [2024-11-18 16:17:12.152474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Write completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Write completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Write completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 Read completed with error (sct=0, sc=8) 00:30:48.729 starting I/O failed 00:30:48.729 [2024-11-18 16:17:12.152847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.729 [2024-11-18 16:17:12.153041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.153162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.153193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.153323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.153439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.153465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.153546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.153663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.153690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.153796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.153877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.153908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.154033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.154143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.154168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.154265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.154385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.154409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.154529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.154621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.154647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.154738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.154825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.154850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.154986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.155074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.155101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.155219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.155382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.155409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.155576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.155666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.155692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.155777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.155861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.155886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.155970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.156113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.156140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.156259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.156347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.156375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.156467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.156639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.729 [2024-11-18 16:17:12.156665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.729 qpair failed and we were unable to recover it. 00:30:48.729 [2024-11-18 16:17:12.156752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.156836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.156861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.156945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.157065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.157092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.157207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.157346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.157370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.157543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.157651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.157694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.157780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.157864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.157890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.157990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.158137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.158162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.158281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.158402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.158430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.158525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.158633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.158677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.158806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.158885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.158909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.159026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.159142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.159167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.159263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.159360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.159388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.159578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.159721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.159748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.159840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.159968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.159993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.160140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.160261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.160289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.160438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.160566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.160613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.160703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.160843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.160868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.160957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.161046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.161071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.161236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.161324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.161351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.161483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.161570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.161597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.161716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.161796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.161822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.161905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.162023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.162049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.162128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.162270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.162298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.162430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.162562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.162587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.162689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.162819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.162844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.162984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.163069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.163112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.163230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.163346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.163371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.163482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.163560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.163585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.163709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.163815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.163845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.730 qpair failed and we were unable to recover it. 00:30:48.730 [2024-11-18 16:17:12.163935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.730 [2024-11-18 16:17:12.164036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.164062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.164179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.164261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.164286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.164411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.164552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.164577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.164670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.164779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.164804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.164914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.165004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.165028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.165122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.165266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.165290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.165408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.165480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.165505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.165587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.165726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.165751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.165860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.165982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.166008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.166099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.166208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.166233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.166315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.166464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.166490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.166632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.166740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.166770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.166902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.166987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.167015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.167129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.167267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.167292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.167376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.167462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.167488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.167578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.167676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.167702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.167822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.167964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.167989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.168127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.168239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.168266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.168357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.168435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.168460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.168571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.168663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.168689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.168765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.168871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.168897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.169027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.169164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.169188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.169294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.169379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.169405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.169511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.169592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.169624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.169770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.169857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.169881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.170003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.170118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.170142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.170260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.170340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.170365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.170477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.170591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.170641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.731 qpair failed and we were unable to recover it. 00:30:48.731 [2024-11-18 16:17:12.170772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.170878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.731 [2024-11-18 16:17:12.170903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.170999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.171085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.171112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.171197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.171289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.171316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.171461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.171571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.171596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.171748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.171875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.171905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.171998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.172106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.172132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.172251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.172336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.172361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.172454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.172548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.172574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.172682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.172807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.172833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.172950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.173062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.173087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.173184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.173305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.173333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.173513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.173630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.173656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.173773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.173883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.173908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.174016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.174098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.174123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.174241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.174353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.174378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.174461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.174567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.174591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.174713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.174798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.174823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.174908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.175009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.175034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.175121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.175206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.175230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.175346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.175489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.175515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.175629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.175783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.175823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.175946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.176036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.176061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.176154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.176274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.176299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.176421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.176508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.176533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.176622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.176766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.176791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.176910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.176996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.732 [2024-11-18 16:17:12.177020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.732 qpair failed and we were unable to recover it. 00:30:48.732 [2024-11-18 16:17:12.177101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.177181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.177206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.177297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.177405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.177435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.177531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.177629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.177655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.177771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.177885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.177910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.177996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.178133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.178158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.178266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.178381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.178406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.178488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.178599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.178630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.178745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.178822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.178847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.178965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.179076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.179100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.179227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.179313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.179341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.179466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.179542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.179567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.179718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.179835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.179867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.180010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.180089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.180113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.180246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.180357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.180382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.180463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.180571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.180596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.180746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.180855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.180880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.180961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.181100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.181125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.181205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.181318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.181342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.181422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.181538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.181563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.181680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.181800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.181825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.181938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.182017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.182042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.182125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.182199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.182228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.182318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.182398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.182423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.182532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.182642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.182668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.182783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.182891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.182915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.182999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.183082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.733 [2024-11-18 16:17:12.183106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.733 qpair failed and we were unable to recover it. 00:30:48.733 [2024-11-18 16:17:12.183193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.183316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.183341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.183433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.183545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.183570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.183686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.183769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.183794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.183911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.183989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.184014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.184126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.184241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.184266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.184353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.184468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.184498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.184584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.184710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.184736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.184884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.184975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.185001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.185086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.185164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.185190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.185296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.185433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.185458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.185601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.185802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.185828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.185950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.186055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.186080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.186215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.186317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.186341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.186419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.186575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.186626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.186770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.186880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.186905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.186991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.187078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.187104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.187248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.187328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.187372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.187489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.187640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.187666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.187798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.187940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.187965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.188073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.188162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.188187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.188341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.188485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.188510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.188589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.188691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.188717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.188831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.188911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.188937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.189031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.189135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.189159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.189272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.189347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.189372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.189502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.189630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.189659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.189774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.189890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.189915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.190027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.190124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.190151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.734 qpair failed and we were unable to recover it. 00:30:48.734 [2024-11-18 16:17:12.190268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.734 [2024-11-18 16:17:12.190351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.190378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.190517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.190620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.190645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.190726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.190815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.190839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.190936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.191042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.191067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.191181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.191296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.191321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.191439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.191521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.191547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.191639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.191784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.191810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.191925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.192011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.192038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.192130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.192216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.192242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.192364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.192452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.192477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.192587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.192713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.192739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.192861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.192985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.193009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.193116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.193256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.193280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.193366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.193508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.193533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.193618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.193701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.193726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.193837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.193944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.193969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.194074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.194182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.194207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.194293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.194412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.194437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.194557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.194643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.194670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.194822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.194941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.194966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.195103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.195234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.195278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.195401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.195484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.195510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.195633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.195724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.195750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.195866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.195983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.196026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.196148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.196298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.196327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.196466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.196552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.196578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.196699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.196774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.196799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.196911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.196989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.197013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.735 [2024-11-18 16:17:12.197124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.197239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.735 [2024-11-18 16:17:12.197263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.735 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.197353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.197438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.197462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.197552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.197658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.197684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.197796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.197876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.197901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.198063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.198162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.198187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.198297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.198381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.198405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.198485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.198567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.198593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.198725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.198839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.198864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.199014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.199123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.199147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.199267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.199375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.199400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.199515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.199600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.199643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.199731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.199897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.199923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.200044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.200153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.200179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.200312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.200432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.200460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.200588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.200718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.200744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.200857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.201001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.201027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.201139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.201313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.201338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.201444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.201560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.201585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.201697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.201813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.201839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.201962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.202069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.202097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.202235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.202365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.202389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.202477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.202583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.202616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.202707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.202814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.202839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.202929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.203011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.203036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.203180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.203258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.203283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.203399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.203561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.203585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.203783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.203918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.203947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.204072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.204212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.204238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.204337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.204424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.204449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.736 qpair failed and we were unable to recover it. 00:30:48.736 [2024-11-18 16:17:12.204587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.736 [2024-11-18 16:17:12.204694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.204718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.204812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.204903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.204930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.205075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.205192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.205217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.205342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.205472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.205500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.205637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.205775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.205800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.205885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.205994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.206018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.206130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.206235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.206260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.206346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.206435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.206459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.206538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.206630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.206657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.206778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.206862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.206888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.206980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.207123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.207149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.207264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.207386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.207411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.207525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.207630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.207656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.207733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.207848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.207873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.207980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.208106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.208133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.208256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.208339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.208381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.208467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.208580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.208613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.208705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.208820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.208844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.208954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.209033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.209058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.209166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.209280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.209305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.209399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.209514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.209539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.209648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.209770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.209800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.209920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.210011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.210035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.210115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.210202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.210227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.210338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.210443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.737 [2024-11-18 16:17:12.210468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.737 qpair failed and we were unable to recover it. 00:30:48.737 [2024-11-18 16:17:12.210582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.210668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.210693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.210805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.210889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.210914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.211002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.211084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.211109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.211223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.211309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.211334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.211428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.211511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.211536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.211643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.211760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.211785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.211864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.211980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.212005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.212129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.212209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.212234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.212359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.212456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.212483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.212592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.212686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.212711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.212798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.212883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.212908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.213050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.213165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.213190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.213304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.213446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.213471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.213587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.213709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.213734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.213816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.213935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.213959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.214069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.214192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.214217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.214296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.214411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.214435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.214559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.214688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.214713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.214857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.215008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.215050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.215203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.215364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.215389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.215505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.215628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.215657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.215785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.215905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.215930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.216072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.216152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.216177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.216255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.216337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.216362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.216456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.216575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.216600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.216718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.216809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.216834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.216954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.217061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.217085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.217208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.217320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.217345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.738 qpair failed and we were unable to recover it. 00:30:48.738 [2024-11-18 16:17:12.217423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.217565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.738 [2024-11-18 16:17:12.217592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.217692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.217858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.217883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.217992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.218105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.218130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.218271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.218418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.218443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.218528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.218625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.218650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.218795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.218900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.218924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.219044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.219134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.219163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.219315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.219430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.219458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.219568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.219745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.219771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.219889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.220004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.220029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.220111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.220224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.220251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.220334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.220422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.220447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.220566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.220658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.220685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.220806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.220926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.220955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.221078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.221192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.221218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.221329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.221463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.221488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.221574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.221719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.221745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.221825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.221942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.221966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.222055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.222160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.222185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.222270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.222378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.222407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.222486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.222569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.222594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.222715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.222803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.222828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.222944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.223037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.223064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.223228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.223322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.223347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.223428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.223538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.223563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.223678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.223755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.223780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.223899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.224004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.224028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.224149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.224262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.224287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.224368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.224482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.224507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.739 qpair failed and we were unable to recover it. 00:30:48.739 [2024-11-18 16:17:12.224624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.739 [2024-11-18 16:17:12.224713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.224739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.224856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.224940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.224964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.225053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.225174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.225199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.225296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.225379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.225405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.225503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.225651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.225677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.225794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.225924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.225952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.226058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.226137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.226162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.226271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.226382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.226406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.226515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.226655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.226683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.226822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.226949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.226973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.227064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.227203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.227230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.227387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.227477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.227504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.227613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.227757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.227782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.227913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.228004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.228031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.228122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.228261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.228288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.228405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.228514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.228539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.228663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.228782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.228806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.228951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.229061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.229086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.229200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.229314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.229340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.229471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.229628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.229657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.229797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.229888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.229913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.230036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.230115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.230140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.230224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.230308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.230332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.230423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.230530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.230554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.230676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.230781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.230805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.230903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.231035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.231059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.231176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.231261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.231304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.231465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.231620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.231646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.231778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.231913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.740 [2024-11-18 16:17:12.231937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.740 qpair failed and we were unable to recover it. 00:30:48.740 [2024-11-18 16:17:12.232054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.232208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.232232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.232317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.232394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.232419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.232512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.232593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.232625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.232765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.232868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.232895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.233029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.233120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.233145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.233287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.233447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.233475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.233618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.233739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.233763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.233905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.234011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.234036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.234141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.234228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.234254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.234376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.234509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.234536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.234673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.234759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.234783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.234900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.235059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.235086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.235202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.235302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.235335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.235479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.235599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.235629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.235806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.235921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.235946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.236030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.236144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.236170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.236262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.236344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.236368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.236479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.236597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.236627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.236746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.236845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.236869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.236986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.237073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.237097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.237234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.237323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.237350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.237502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.237602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.237634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.237766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.237882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.237911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.238073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.238191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.238233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.238361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.238440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.238464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.238556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.238687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.238712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.238823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.238940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.238965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.239081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.239197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.239222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.741 qpair failed and we were unable to recover it. 00:30:48.741 [2024-11-18 16:17:12.239364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.239470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.741 [2024-11-18 16:17:12.239495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.239637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.239739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.239767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.239856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.239979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.240006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.240133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.240247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.240271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.240357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.240450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.240475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.240561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.240668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.240694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.240816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.240922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.240947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.241105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.241221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.241248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.241372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.241531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.241571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.241745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.241887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.241928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.242018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.242139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.242166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.242268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.242359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.242398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.242537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.242687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.242729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.242833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.242980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.243008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.243105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.243204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.243232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.243372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.243492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.243517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.243624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.243746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.243773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.243926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.244025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.244052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.244155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.244261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.244286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.244401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.244544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.244571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.244683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.244764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.244789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.244905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.244989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.245013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.245133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.245247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.245287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.245405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.245532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.245559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.245698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.245785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.245810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.742 qpair failed and we were unable to recover it. 00:30:48.742 [2024-11-18 16:17:12.245908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.246016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.742 [2024-11-18 16:17:12.246044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.246140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.246269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.246296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.246421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.246531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.246556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.246676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.246781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.246806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.246935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.247112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.247138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.247250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.247362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.247386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.247498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.247576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.247601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.247708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.247813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.247838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.247918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.248035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.248059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.248143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.248245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.248273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.248451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.248597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.248629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.248714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.248829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.248854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.248933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.249008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.249032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.249150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.249231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.249255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.249337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.249415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.249440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.249526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.249622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.249647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.249781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.249873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.249900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.250037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.250150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.250174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.250338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.250464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.250491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.250622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.250750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.250777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.250915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.251024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.251053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.251154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.251314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.251342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.251427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.251530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.251558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.251660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.251778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.251803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.251894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.251979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.252003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.252087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.252169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.252193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.252308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.252398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.252423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.252565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.252642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.252666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.252779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.252885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.743 [2024-11-18 16:17:12.252909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.743 qpair failed and we were unable to recover it. 00:30:48.743 [2024-11-18 16:17:12.252987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.253065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.253090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.253255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.253370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.253397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.253531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.253685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.253713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.253848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.253948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.253972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.254083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.254193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.254233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.254356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.254487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.254516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.254674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.254792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.254817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.254905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.254983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.255007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.255122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.255223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.255251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.255398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.255513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.255538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.255691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.255807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.255831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.255969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.256056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.256082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.256200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.256316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.256340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.256483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.256618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.256664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.256785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.256925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.256949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.257029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.257104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.257129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.257214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.257291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.257315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.257412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.257528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.257555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.257689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.257799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.257823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.257909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.258047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.258087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.258240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.258393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.258420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.258560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.258644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.258670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.258800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.258960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.258984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.259090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.259165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.259206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.259317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.259429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.259453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.259538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.259636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.259661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.259802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.259905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.259933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.260056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.260133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.260157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.744 [2024-11-18 16:17:12.260276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.260390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.744 [2024-11-18 16:17:12.260416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.744 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.260535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.260681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.260709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.260850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.260967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.260991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.261088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.261175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.261202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.261284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.261393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.261420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.261555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.261670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.261695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.261832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.261938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.261962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.262052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.262141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.262167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.262309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.262390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.262414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.262502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.262592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.262695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.262796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.262945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.262972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.263108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.263219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.263243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.263359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.263474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.263514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.263665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.263759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.263787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.263924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.264001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.264029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.264121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.264234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.264259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.264375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.264498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.264526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.264666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.264759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.264784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.264892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.265000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.265024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.265114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.265262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.265285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.265395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.265484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.265508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.265651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.265785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.265812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.265968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.266117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.266145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.266263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.266380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.266405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.266497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.266620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.266648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.266775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.266894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.266921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.267037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.267148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.267173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.267291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.267367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.267392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.267506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.267648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.267677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.745 qpair failed and we were unable to recover it. 00:30:48.745 [2024-11-18 16:17:12.267787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.745 [2024-11-18 16:17:12.267898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.267922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.268062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.268180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.268208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.268326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.268418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.268447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.268557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.268671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.268696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.268781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.268922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.268949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.269073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.269201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.269227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.269370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.269512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.269536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.269663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.269787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.269814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.269899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.270046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.270072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.270205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.270295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.270320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.270438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.270572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.270626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.270719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.270851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.270879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.271024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.271134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.271158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.271249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.271330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.271354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.271499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.271675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.271700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.271818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.271932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.271957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.272095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.272235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.272260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.272379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.272509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.272536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.272643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.272784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.272808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.272935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.273065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.273093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.273217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.273348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.273375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.273502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.273577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.273601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.273711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.273837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.273864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.273958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.274089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.274116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.274255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.274364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.274389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.746 qpair failed and we were unable to recover it. 00:30:48.746 [2024-11-18 16:17:12.274515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.274612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.746 [2024-11-18 16:17:12.274640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.274728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.274863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.274888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.274973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.275052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.275077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.275191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.275323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.275349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.275467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.275556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.275583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.275706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.275821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.275846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.276009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.276132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.276160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.276259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.276368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.276392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.276467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.276558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.276583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.276726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.276880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.276907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.277021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.277117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.277146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.277289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.277399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.277428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.277529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.277655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.277684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.277808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.277939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.277967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.278075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.278164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.278189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.278301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.278408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.278448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.278561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.278688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.278715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.278886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.278971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.278995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.279071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.279191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.279215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.279323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.279451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.279478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.279642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.279731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.279756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.279866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.279954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.279981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.280102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.280228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.280255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.280395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.280512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.280538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.280675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.280811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.280835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.280949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.281103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.281129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.281259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.281340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.281365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.281483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.281597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.281628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.747 [2024-11-18 16:17:12.281807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.281921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.747 [2024-11-18 16:17:12.281946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.747 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.282036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.282112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.282136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.282242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.282373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.282399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.282535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.282642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.282671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.282794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.282876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.282900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.283030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.283124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.283150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.283249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.283367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.283393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.283493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.283619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.283645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.283752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.283890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.283914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.284001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.284138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.284162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.284248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.284354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.284377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.284490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.284628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.284655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.284779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.284895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.284922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.285047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.285134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.285157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.285259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.285385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.285412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.285537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.285705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.285733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.285869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.285975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.285998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.286102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.286231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.286258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.286411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.286541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.286568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.286688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.286811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.286835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.286976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.287101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.287128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.287247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.287339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.287365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.287490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.287626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.287652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.287809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.287931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.287956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.288045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.288137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.288160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.288251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.288359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.288382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.288496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.288603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.288633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.288750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.288870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.288897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.289053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.289166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.289189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.748 qpair failed and we were unable to recover it. 00:30:48.748 [2024-11-18 16:17:12.289294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.748 [2024-11-18 16:17:12.289417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.289444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.289567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.289715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.289739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.289857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.289935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.289959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.290096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.290210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.290236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.290366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.290457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.290484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.290581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.290669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.290697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.290789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.290958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.290986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.291121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.291234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.291258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.291351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.291458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.291482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.291560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.291704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.291729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.291815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.291923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.291947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.292054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.292135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.292159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.292293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.292434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.292459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.292554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.292671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.292713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.292841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.292959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.292983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.293112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.293236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.293267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.293391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.293475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.293502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.293641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.293731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.293755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.293887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.294003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.294029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.294154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.294283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.294309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.294436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.294527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.294555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.294743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.294896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.294923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.295041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.295135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.295159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.295267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.295353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.295376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.295464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.295569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.295593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.295791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.295918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.295946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.296072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.296182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.296206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.296322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.296464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.296492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.296624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.296752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.749 [2024-11-18 16:17:12.296780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.749 qpair failed and we were unable to recover it. 00:30:48.749 [2024-11-18 16:17:12.296911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.297053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.297077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.297181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.297262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.297288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.297406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.297537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.297562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.297673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.297756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.297781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.297895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.297979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.298003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.298152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.298318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.298342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.298430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.298505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.298530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.298658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.298794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.298821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.298916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.299030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.299054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.299138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.299274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.299299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.299387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.299471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.299495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.299633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.299716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.299741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.299897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.300011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.300036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.300151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.300264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.300287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.300368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.300480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.300504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.300620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.300757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.300781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.300862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.301026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.301052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.301176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.301299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.301324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:48.750 qpair failed and we were unable to recover it. 00:30:48.750 [2024-11-18 16:17:12.301408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:48.750 [2024-11-18 16:17:12.301495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.301519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.034 [2024-11-18 16:17:12.301618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.301756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.301783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.034 [2024-11-18 16:17:12.301936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.302049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.302074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.034 [2024-11-18 16:17:12.302157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.302265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.302288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.034 [2024-11-18 16:17:12.302379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.302468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.302510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.034 [2024-11-18 16:17:12.302631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.302752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.302776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.034 [2024-11-18 16:17:12.302893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.302974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.302999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.034 [2024-11-18 16:17:12.303119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.303234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.303258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.034 [2024-11-18 16:17:12.303341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.303456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.303480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.034 [2024-11-18 16:17:12.303596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.303719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.303743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.034 [2024-11-18 16:17:12.303830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.303921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.303945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.034 [2024-11-18 16:17:12.304089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.304229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.034 [2024-11-18 16:17:12.304253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.034 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.304345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.304456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.304481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.304656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.304768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.304792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.304875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.305017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.305042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.305128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.305244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.305269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.305368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.305483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.305508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.305598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.305716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.305741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.305823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.305907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.305931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.306043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.306126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.306154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.306264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.306386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.306411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.306530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.306653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.306680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.306815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.306937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.306964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.307097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.307222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.307250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.307387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.307499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.307524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.307658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.307782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.307810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.307942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.308066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.308093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.308225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.308301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.308325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.308437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.308520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.308544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.308682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.308818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.308845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.308987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.309105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.309130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.309282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.309401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.309427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.309559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.309647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.309675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.309835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.309950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.309974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.310111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.310207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.310234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.310361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.310460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.310488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.310602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.310717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.310742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.310863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.310986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.311011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.311136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.311224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.311252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.311394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.311535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.311560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.035 qpair failed and we were unable to recover it. 00:30:49.035 [2024-11-18 16:17:12.311692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.035 [2024-11-18 16:17:12.311821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.311848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.311977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.312101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.312129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.312246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.312334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.312358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.312468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.312555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.312580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.312739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.312859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.312884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.313024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.313117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.313143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.313304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.313434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.313461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.313588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.313742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.313770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.313875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.313992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.314017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.314141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.314223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.314250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.314346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.314429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.314456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.314559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.314651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.314676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.314798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.314933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.314960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.315082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.315180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.315207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.315373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.315452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.315478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.315653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.315737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.315765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.315890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.315983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.316011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.316152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.316288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.316312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.316449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.316571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.316598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.316693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.316813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.316840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.317000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.317140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.317165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.317302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.317425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.317452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.317569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.317722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.317749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.317866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.318009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.318034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.318161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.318251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.318281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.318431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.318581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.318614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.318720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.318842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.318867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.318963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.319117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.319144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.036 [2024-11-18 16:17:12.319230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.319311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.036 [2024-11-18 16:17:12.319339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.036 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.319463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.319602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.319652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.319786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.319903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.319936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.320062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.320150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.320177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.320337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.320446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.320471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.320568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.320679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.320706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.320833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.320935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.320963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.321068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.321179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.321203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.321368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.321461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.321487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.321619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.321755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.321778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.321898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.322011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.322035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.322174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.322286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.322310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.322428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.322533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.322557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.322682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.322762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.322786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.322901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.323006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.323034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.323167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.323288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.323316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.323478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.323595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.323627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.323768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.323921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.323948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.324062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.324157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.324184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.324348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.324460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.324485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.324605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.324737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.324765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.324859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.324959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.324987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.325107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.325191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.325215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.325310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.325420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.325447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.325587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.325713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.325737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.325855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.325968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.325993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.326093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.326179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.326206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.326334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.326486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.326513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.326674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.326766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.326791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.037 qpair failed and we were unable to recover it. 00:30:49.037 [2024-11-18 16:17:12.326904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.037 [2024-11-18 16:17:12.326980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.327004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.327111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.327225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.327249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.327358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.327476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.327500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.327620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.327723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.327749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.327904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.328058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.328085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.328191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.328332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.328356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.328489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.328620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.328648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.328802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.328921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.328948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.329086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.329172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.329196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.329358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.329509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.329535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.329660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.329788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.329815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.329916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.330035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.330059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.330150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.330289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.330316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.330442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.330571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.330597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.330735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.330879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.330903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.331025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.331113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.331140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.331257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.331378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.331404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.331538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.331636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.331662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.331795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.331945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.331973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.332121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.332275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.332301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.332406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.332542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.332566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.332702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.332817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.332843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.332937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.333062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.333090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.333231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.333368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.333392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.333540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.333662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.333692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.333784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.333861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.333885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.334025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.334131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.334155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.334335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.334448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.334473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.334570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.334705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.038 [2024-11-18 16:17:12.334730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.038 qpair failed and we were unable to recover it. 00:30:49.038 [2024-11-18 16:17:12.334841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.334956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.334982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.335162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.335275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.335299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.335413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.335596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.335645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.335762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.335882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.335906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.335993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.336102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.336127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.336219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.336356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.336388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.336529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.336647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.336673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.336769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.336883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.336923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.337021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.337120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.337146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.337276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.337362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.337386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.337501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.337643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.337668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.337747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.337862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.337887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.337974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.338111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.338135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.338252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.338349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.338377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.338502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.338585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.338617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.338710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.338812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.338837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.338962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.339071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.339098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.339198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.339344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.339370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.339504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.339618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.339644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.339743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.339827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.339853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.339957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.340078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.340104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.340235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.340349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.340374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.039 qpair failed and we were unable to recover it. 00:30:49.039 [2024-11-18 16:17:12.340495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.340575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.039 [2024-11-18 16:17:12.340599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.340697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.340782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.340806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.340885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.341000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.341025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.341156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.341242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.341269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.341397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.341505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.341529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.341619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.341757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.341782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.341925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.342021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.342048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.342163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.342258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.342302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.342409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.342505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.342530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.342646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.342758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.342783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.342874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.343019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.343044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.343167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.343251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.343277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.343384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.343467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.343492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.343626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.343706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.343731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.343812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.343906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.343931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.344046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.344161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.344185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.344317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.344468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.344494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.344638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.344751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.344775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.344872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.344991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.345018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.345145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.345236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.345262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.345367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.345478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.345502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.345638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.345734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.345760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.345889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.346046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.346070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.346164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.346277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.346301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.346383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.346460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.346485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.346566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.346690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.346714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.346829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.346932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.346956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.347061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.347182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.347210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.347326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.347424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.347450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.040 qpair failed and we were unable to recover it. 00:30:49.040 [2024-11-18 16:17:12.347539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.040 [2024-11-18 16:17:12.347647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.347671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.347790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.347879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.347902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.348007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.348131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.348157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.348316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.348438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.348462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.348590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.348714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.348741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.348863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.348952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.348985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.349149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.349258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.349282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.349412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.349531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.349559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.349715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.349834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.349862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.349975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.350086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.350111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.350244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.350359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.350386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.350537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.350713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.350737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.350829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.350929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.350953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.351066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.351206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.351230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.351313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.351419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.351443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.351525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.351629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.351654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.351793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.351919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.351946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.352062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.352214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.352240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.352348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.352421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.352445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.352563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.352654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.352678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.352851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.352966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.352992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.353134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.353277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.353301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.353382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.353518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.353547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.353672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.353759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.353786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.353919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.354025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.354049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.354187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.354348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.354372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.354517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.354652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.354679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.354823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.354939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.354963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.041 [2024-11-18 16:17:12.355078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.355179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.041 [2024-11-18 16:17:12.355207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.041 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.355372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.355488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.355513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.355621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.355734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.355758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.355876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.355998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.356042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.356147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.356292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.356319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.356426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.356538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.356562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.356651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.356814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.356842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.356998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.357126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.357153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.357288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.357397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.357422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.357529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.357670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.357699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.357826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.357956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.357980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.358068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.358179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.358203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.358301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.358409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.358448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.358538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.358629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.358657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.358767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.358877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.358901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.359045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.359128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.359156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.359271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.359384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.359411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.359548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.359657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.359682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.359819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.359916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.359943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.360092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.360215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.360242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.360402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.360517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.360541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.360643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.360737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.360764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.360892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.361013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.361039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.361149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.361264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.361289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.361398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.361502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.361525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.361612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.361745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.361773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.361909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.362048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.362072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.362236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.362359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.362385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.362507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.362659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.362694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.042 qpair failed and we were unable to recover it. 00:30:49.042 [2024-11-18 16:17:12.362861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.042 [2024-11-18 16:17:12.362969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.362994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.363131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.363256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.363284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.363412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.363501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.363528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.363668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.363747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.363771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.363882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.363978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.364006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.364128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.364212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.364239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.364401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.364508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.364533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.364640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.364746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.364771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.364929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.365053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.365083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.365223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.365340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.365365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.365511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.365634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.365676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.365792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.365872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.365911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.366042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.366122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.366146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.366267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.366355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.366380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.366475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.366580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.366604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.366727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.366816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.366840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.366958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.367034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.367058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.367150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.367257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.367281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.367421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.367561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.367585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.367753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.367862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.367893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.368066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.368188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.368216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.368315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.368436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.368461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.368577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.368720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.368750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.368874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.368998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.369027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.369158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.369298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.369323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.043 [2024-11-18 16:17:12.369459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.369574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.043 [2024-11-18 16:17:12.369602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.043 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.369732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.369828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.369857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.370014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.370132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.370157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.370266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.370388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.370416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.370543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.370683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.370709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.370799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.370908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.370933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.371017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.371156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.371181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.371270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.371377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.371405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.371569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.371716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.371742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.371900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.372042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.372067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.372148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.372293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.372321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.372461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.372582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.372614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.372756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.372890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.372917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.373043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.373134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.373163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.373286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.373400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.373425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.373554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.373672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.373701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.373796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.373905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.373933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.374077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.374224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.374249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.374338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.374450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.374479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.374614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.374739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.374767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.374913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.375024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.375050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.375158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.375240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.375265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.375377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.375528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.375556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.375683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.375801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.375825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.375948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.376073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.376101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.376260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.376387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.376415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.376578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.376680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.376706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.376814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.376926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.376968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.377068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.377223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.377251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.044 qpair failed and we were unable to recover it. 00:30:49.044 [2024-11-18 16:17:12.377389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.044 [2024-11-18 16:17:12.377526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.377551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.377670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.377828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.377856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.377987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.378102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.378127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.378239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.378329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.378355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.378515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.378645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.378676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.378802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.378892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.378920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.379041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.379154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.379180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.379264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.379406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.379434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.379594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.379730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.379758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.379890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.380007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.380031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.380112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.380244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.380271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.380399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.380555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.380582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.380704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.380814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.380840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.380952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.381068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.381094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.381221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.381351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.381379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.381509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.381600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.381632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.381773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.381885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.381913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.382040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.382130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.382158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.382319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.382400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.382425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.382527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.382650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.382678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.382765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.382916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.382943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.383082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.383197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.383223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.383370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.383521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.383549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.383641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.383735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.383763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.383862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.383999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.384024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.384130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.384259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.384287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.384388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.384515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.384545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.384679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.384775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.384801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.045 [2024-11-18 16:17:12.384912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.385073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.045 [2024-11-18 16:17:12.385101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.045 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.385229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.385358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.385387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.385497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.385643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.385684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.385774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.385869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.385896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.386032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.386155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.386183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.386309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.386398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.386422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.386537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.386679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.386705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.386817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.386902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.386929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.387069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.387187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.387213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.387320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.387408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.387438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.387590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.387746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.387774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.387917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.388034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.388059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.388147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.388252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.388278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.388423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.388556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.388585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.388752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.388831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.388855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.388991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.389144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.389172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.389307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.389422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.389447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.389560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.389665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.389693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.389805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.389905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.389938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.390066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.390223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.390251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.390414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.390526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.390551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.390678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.390820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.390845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.390992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.391145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.391173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.391338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.391463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.391488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.391640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.391790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.391819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.391951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.392030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.392055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.392195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.392279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.392304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.392459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.392578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.392612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.392715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.392838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.046 [2024-11-18 16:17:12.392872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.046 qpair failed and we were unable to recover it. 00:30:49.046 [2024-11-18 16:17:12.393038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.393152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.393177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.393313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.393440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.393468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.393599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.393733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.393758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.393903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.394017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.394044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.394207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.394376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.394404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.394556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.394687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.394716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.394834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.394921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.394946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.395080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.395197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.395224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.395349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.395471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.395499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.395638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.395747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.395777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.395879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.396005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.396033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.396129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.396282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.396310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.396437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.396525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.396551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.396633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.396752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.396781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.396906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.397022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.397050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.397195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.397310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.397336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.397443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.397612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.397638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.397718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.397828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.397853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.397995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.398136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.398161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.398296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.398417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.398450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.398603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.398696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.398723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.398828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.398958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.398983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.399089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.399204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.399230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.399345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.399508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.399536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.399663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.399756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.399782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.399864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.400003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.400028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.400138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.400226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.400268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.400373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.400517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.047 [2024-11-18 16:17:12.400543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.047 qpair failed and we were unable to recover it. 00:30:49.047 [2024-11-18 16:17:12.400652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.400817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.400845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.400932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.401054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.401082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.401193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.401336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.401361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.401474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.401562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.401589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.401685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.401824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.401849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.401958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.402066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.402091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.402223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.402310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.402339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.402465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.402620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.402649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.402819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.402896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.402922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.403058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.403155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.403203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.403306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.403470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.403498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.403636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.403759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.403785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.403943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.404111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.404138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.404262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.404414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.404442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.404629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.404750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.404776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.404912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.405029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.405055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.405134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.405297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.405338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.405470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.405596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.405628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.405754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.405886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.405914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.406039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.406165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.406195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.406348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.406461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.406486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.406635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.406759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.406787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.406929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.407054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.407082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.407198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.407323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.407348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.407444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.407524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.407552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.048 qpair failed and we were unable to recover it. 00:30:49.048 [2024-11-18 16:17:12.407737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.048 [2024-11-18 16:17:12.407855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.407897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.408023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.408137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.408163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.408268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.408411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.408441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.408567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.408687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.408716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.408849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.408975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.409002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.409106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.409234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.409263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.409369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.409522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.409570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.409731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.409818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.409857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.409988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.410080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.410108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.410249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.410345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.410376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.410516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.410595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.410628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.410722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.410873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.410901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.411061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.411188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.411216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.411330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.411421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.411447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.411540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.411661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.411692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.411793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.411917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.411946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.412081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.412195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.412221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.412344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.412471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.412500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.412592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.412740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.412769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.412886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.413000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.413026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.413162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.413264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.413293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.413438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.413554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.413583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.413695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.413778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.413803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.413888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.414020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.414048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.414189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.414278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.414307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.414400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.414502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.414531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.414674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.414793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.414818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.414920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.415099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.415125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.049 [2024-11-18 16:17:12.415269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.415420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.049 [2024-11-18 16:17:12.415469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.049 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.415561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.415669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.415696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.415784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.415875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.415901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.415997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.416110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.416135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.416248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.416329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.416354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.416447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.416544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.416569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.416695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.416812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.416838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.416929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.417038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.417064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.417181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.417282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.417307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.417433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.417515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.417541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.417637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.417731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.417759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.417846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.418000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.418025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.418149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.418246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.418271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.418363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.418473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.418498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.418591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.418691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.418718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.418831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.418985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.419026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.419148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.419273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.419302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.419459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.419565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.419590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.419725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.419872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.419896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.420069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.420170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.420199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.420338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.420475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.420502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.420633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.420750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.420790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.420880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.420970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.420996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.421075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.421206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.421236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.421355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.421445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.421473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.421564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.421730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.421756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.421847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.422005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.422034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.422166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.422319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.422348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.422475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.422596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.422632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.050 qpair failed and we were unable to recover it. 00:30:49.050 [2024-11-18 16:17:12.422732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.050 [2024-11-18 16:17:12.422834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.422861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.422957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.423093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.423135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.423265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.423363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.423404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.423498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.423670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.423697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.423784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.423873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.423898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.423982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.424137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.424179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.424273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.424398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.424443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.424579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.424680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.424706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.424787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.424899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.424924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.425003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.425123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.425151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.425265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.425400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.425453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.425568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.425740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.425767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.425922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.426048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.426076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.426188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.426321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.426351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.426489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.426626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.426670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.426790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.426893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.426920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.427036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.427116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.427151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.427286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.427419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.427465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.427593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.427730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.427767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.427881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.427996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.428021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.428099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.428185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.428211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.428305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.428417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.428454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.428542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.428658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.428685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.428804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.428913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.428942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.429062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.429158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.429187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.429288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.429438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.429467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.429599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.429708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.429734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.429902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.430004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.430032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.051 [2024-11-18 16:17:12.430156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.430294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.051 [2024-11-18 16:17:12.430322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.051 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.430415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.430527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.430556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.430706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.430830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.430856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.430989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.431080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.431105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.431266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.431391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.431419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.431516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.431665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.431706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.431823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.431951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.431977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.432141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.432265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.432294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.432392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.432512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.432540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.432697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.432793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.432819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.432928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.433051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.433080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.433166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.433328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.433371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.433459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.433613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.433645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.433761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.433852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.433893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.434030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.434118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.434146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.434248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.434347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.434376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.434473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.434561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.434590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.434710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.434823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.434848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.435004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.435099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.435124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.435256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.435381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.435410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.435499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.435624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.435668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.435790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.435879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.435905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.436027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.436140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.436205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.436312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.436429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.436457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.436584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.436686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.436712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.436786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.436878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.436924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.437046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.437185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.437213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.437347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.437477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.437503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.052 qpair failed and we were unable to recover it. 00:30:49.052 [2024-11-18 16:17:12.437629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.437780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.052 [2024-11-18 16:17:12.437808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.437909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.437999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.438027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.438129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.438242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.438269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.438405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.438518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.438549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.438660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.438762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.438795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.438911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.439068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.439094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.439201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.439295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.439324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.439456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.439596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.439632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.439785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.439873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.439900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.440050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.440187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.440216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.440320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.440418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.440447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.440637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.440722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.440746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.440860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.440986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.441029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.441151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.441275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.441304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.441447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.441533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.441563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.441710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.441843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.441873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.441972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.442073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.442118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.442224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.442324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.442350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.442449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.442571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.442598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.442777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.442884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.442912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.443036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.443165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.443194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.443310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.443401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.443428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.443521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.443637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.443663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.443752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.443889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.443918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.444043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.444168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.444193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.444310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.444450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.053 [2024-11-18 16:17:12.444475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.053 qpair failed and we were unable to recover it. 00:30:49.053 [2024-11-18 16:17:12.444565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.444711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.444740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.444859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.444949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.444977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.445064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.445164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.445191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.445303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.445418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.445443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.445528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.445623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.445650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.445776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.445875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.445905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.446059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.446183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.446211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.446372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.446490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.446534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.446639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.446735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.446779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.446906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.447016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.447046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.447172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.447315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.447343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.447460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.447604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.447637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.447778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.447911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.447940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.448036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.448156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.448184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.448291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.448381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.448407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.448495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.448588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.448660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.448803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.448901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.448931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.449082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.449202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.449230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.449358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.449502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.449528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.449678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.449791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.449816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.449969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.450065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.450106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.450248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.450356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.450381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.450499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.450656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.450685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.450795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.450878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.450903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.450986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.451115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.451144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.451246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.451393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.451434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.451559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.451649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.451675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.451764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.451881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.451906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.054 qpair failed and we were unable to recover it. 00:30:49.054 [2024-11-18 16:17:12.452045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.054 [2024-11-18 16:17:12.452148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.452192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.452326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.452464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.452492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.452621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.452715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.452742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.452908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.452994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.453019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.453138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.453226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.453254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.453375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.453516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.453545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.453685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.453828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.453854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.453966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.454077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.454114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.454256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.454382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.454410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.454508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.454603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.454639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.454777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.454871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.454898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.455051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.455169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.455196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.455352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.455482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.455510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.455650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.455749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.455777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.455873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.455974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.456004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.456139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.456280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.456305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.456457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.456630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.456660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.456789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.456945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.456973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.457102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.457235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.457264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.457372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.457514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.457539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.457650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.457736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.457772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.457914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.458013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.458042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.458184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.458334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.458362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.458500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.458633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.458660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.458765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.458920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.055 [2024-11-18 16:17:12.458949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.055 qpair failed and we were unable to recover it. 00:30:49.055 [2024-11-18 16:17:12.459091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.459173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.459199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.459282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.459423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.459468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.459649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.459765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.459790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.459935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.460057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.460095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.460209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.460333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.460379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.460499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.460603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.460651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.460769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.460886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.460911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.461001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.461107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.461151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.461242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.461331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.461359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.461481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.461580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.461613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.461747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.461887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.461913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.462080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.462204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.462232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.462322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.462414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.462443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.462547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.462650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.462679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.462781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.462926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.462952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.463077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.463239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.463267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.463425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x160f980 is same with the state(5) to be set 00:30:49.056 [2024-11-18 16:17:12.463604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.463737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.463775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.463940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.464063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.464093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.464276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.464414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.464447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.464558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.464711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.464745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.464911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.465034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.465064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.465185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.465299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.465332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.465445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.465585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.465628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.465801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.465923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.465952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.466084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.466216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.466248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.466393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.466489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.466521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.466716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.466818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.466847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.056 [2024-11-18 16:17:12.467007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.467177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.056 [2024-11-18 16:17:12.467206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.056 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.467403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.467558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.467587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.467711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.467810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.467839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.467952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.468080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.468110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.468273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.468415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.468447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.468581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.468692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.468722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.468835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.468968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.469000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.469118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.469268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.469297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.469413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.469512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.469541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.469737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.469826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.469856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.469982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.470096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.470129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.470265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.470389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.470419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.470568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.470683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.470715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.470840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.470972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.471004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.471161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.471288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.471317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.471442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.471553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.471585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.471772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.471910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.471943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.472050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.472136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.472162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.472278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.472395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.472422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.472564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.472722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.472756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.472886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.472981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.473010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.057 [2024-11-18 16:17:12.473170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.473304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.057 [2024-11-18 16:17:12.473355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.057 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.473470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.473591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.473635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.473789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.473892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.473922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.474109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.474218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.474250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.474405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.474543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.474576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.474724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.474851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.474880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.475011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.475157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.475189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.475364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.475485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.475515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.475660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.475753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.475783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.475892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.476038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.476070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.476261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.476356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.476389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.476528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.476645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.476675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.476800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.476945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.476978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.477151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.477256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.477288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.477424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.477549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.477578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.477746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.477881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.477913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.478046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.478149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.478181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.478330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.478420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.478449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.478621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.478749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.478781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.478932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.479065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.479097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.479254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.479388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.479417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.479578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.479725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.479758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.479888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.480052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.480085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.480202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.480288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.480315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.480452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.480559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.480590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.480707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.480833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.480863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.481005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.481100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.481126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.481259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.481387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.481416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.481533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.481697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.058 [2024-11-18 16:17:12.481730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.058 qpair failed and we were unable to recover it. 00:30:49.058 [2024-11-18 16:17:12.481877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.481994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.482019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.482132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.482269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.482297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.482420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.482511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.482541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.482662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.482774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.482799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.482936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.483053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.483082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.483203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.483298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.483327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.483458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.483568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.483592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.483710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.483848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.483873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.483999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.484125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.484153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.484308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.484396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.484421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.484526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.484632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.484662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.484750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.484843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.484870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.485031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.485108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.485132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.485309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.485424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.485448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.485550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.485647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.485676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.485786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.485876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.485900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.485993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.486101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.486126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.486239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.486350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.486376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.486464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.486548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.486574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.486662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.486757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.486784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.486913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.487010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.487041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.487152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.487258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.487283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.487372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.487454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.487496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.487658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.487740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.487764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.487881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.487989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.059 [2024-11-18 16:17:12.488013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.059 qpair failed and we were unable to recover it. 00:30:49.059 [2024-11-18 16:17:12.488130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.488230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.488254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.488338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.488478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.488506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.488646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.488728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.488754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.488891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.489025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.489052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.489206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.489308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.489335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.489441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.489581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.489605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.489724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.489862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.489887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.490015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.490108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.490136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.490246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.490354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.490378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.490507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.490595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.490628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.490726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.490853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.490880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.491014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.491107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.491132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.491220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.491304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.491329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.491411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.491499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.491524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.491635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.491762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.491787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.491887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.492011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.492039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.492142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.492253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.492278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.492390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.492468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.492493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.492620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.492741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.492769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.492857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.492975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.493017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.493098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.493179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.493203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.493285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.493440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.493464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.493571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.493718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.493745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.493856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.493969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.493994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.494084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.494187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.494221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.494311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.494433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.494461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.494574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.494664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.494690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.060 qpair failed and we were unable to recover it. 00:30:49.060 [2024-11-18 16:17:12.494773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.494881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.060 [2024-11-18 16:17:12.494910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.495004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.495127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.495156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.495295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.495385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.495411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.495548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.495651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.495680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.495806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.495931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.495958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.496068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.496159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.496184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.496273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.496366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.496391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.496491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.496633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.496663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.496745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.496833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.496858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.496945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.497058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.497084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.497189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.497311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.497339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.497473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.497563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.497588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.497685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.497814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.497838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.497923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.498055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.498083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.498180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.498310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.498335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.498441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.498522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.498549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.498640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.498768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.498796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.498899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.499009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.499038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.499125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.499209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.499235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.499327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.499424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.499451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.499581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.499733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.499758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.499897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.499980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.500008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.500115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.500210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.500238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.500366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.500484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.500508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.500631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.500714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.500738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.500855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.500927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.500952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.501067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.501145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.501170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.501310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.501441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.501473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.061 qpair failed and we were unable to recover it. 00:30:49.061 [2024-11-18 16:17:12.501572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.501671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.061 [2024-11-18 16:17:12.501701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.501849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.501926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.501951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.502072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.502216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.502241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.502325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.502411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.502437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.502583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.502677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.502702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.502806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.502924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.502965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.503081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.503170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.503213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.503319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.503430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.503454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.503552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.503695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.503723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.503844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.503974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.503999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.504086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.504201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.504226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.504306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.504386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.504410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.504544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.504703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.504733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.504858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.504995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.505020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.505128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.505279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.505307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.505405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.505521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.505549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.505663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.505761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.505786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.505872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.505977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.506006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.506110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.506206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.506235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.506403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.506511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.506535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.506641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.506746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.506772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.506882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.507015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.062 [2024-11-18 16:17:12.507056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.062 qpair failed and we were unable to recover it. 00:30:49.062 [2024-11-18 16:17:12.507151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.507263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.507288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.507374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.507461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.507486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.507582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.507703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.507728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.507818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.507968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.507993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.508074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.508213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.508240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.508332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.508424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.508451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.508619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.508738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.508762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.508903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.508993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.509021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.509148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.509273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.509300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.509407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.509488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.509512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.509600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.509756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.509780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.509872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.509957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.509982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.510063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.510142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.510167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.510252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.510416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.510443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.510536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.510623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.510651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.510781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.510867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.510891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.510986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.511096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.511123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.511239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.511358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.511385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.511499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.511579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.511604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.511719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.511832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.511860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.511963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.512059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.512086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.512192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.512277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.512302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.512412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.512496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.512521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.512605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.512690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.512714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.512829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.512909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.512933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.513017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.513153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.513181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.513339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.513490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.513517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.513640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.513729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.513754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.063 qpair failed and we were unable to recover it. 00:30:49.063 [2024-11-18 16:17:12.513869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.063 [2024-11-18 16:17:12.513965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.513993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.514118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.514263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.514291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.514418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.514530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.514555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.514668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.514755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.514780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.514868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.514972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.515000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.515116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.515234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.515258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.515403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.515498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.515525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.515664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.515764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.515793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.515897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.516017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.516041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.516130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.516248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.516276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.516410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.516533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.516560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.516667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.516755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.516781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.516866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.517035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.517064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.517186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.517270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.517297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.517435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.517526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.517551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.517686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.517781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.517810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.517940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.518032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.518061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.518201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.518343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.518368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.518536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.518661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.518690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.518785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.518872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.518900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.519037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.519153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.519178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.519262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.519342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.519367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.519476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.519600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.519633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.519736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.519826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.519851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.519950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.520054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.520079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.520168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.520264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.520292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.520404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.520522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.520547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.520646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.520736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.520761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.064 qpair failed and we were unable to recover it. 00:30:49.064 [2024-11-18 16:17:12.520870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.520972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.064 [2024-11-18 16:17:12.520999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.521097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.521185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.521210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.521291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.521426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.521451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.521539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.521620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.521645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.521762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.521849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.521875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.522004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.522158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.522183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.522316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.522439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.522466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.522569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.522661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.522688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.522763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.522863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.522892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.523025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.523154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.523182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.523286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.523382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.523406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.523518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.523595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.523627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.523743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.523835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.523876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.523989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.524075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.524100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.524179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.524316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.524344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.524444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.524577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.524601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.524717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.524822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.524846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.524924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.525050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.525078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.525196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.525319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.525347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.525500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.525584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.525622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.525702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.525813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.525838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.525984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.526089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.526117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.526250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.526345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.526372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.526475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.526612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.526638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.526718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.526803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.526829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.526943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.527058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.527083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.527190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.527288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.527316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.527402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.527488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.527515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.527644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.527752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.065 [2024-11-18 16:17:12.527777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.065 qpair failed and we were unable to recover it. 00:30:49.065 [2024-11-18 16:17:12.527859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.527948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.527973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.528054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.528155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.528183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.528312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.528455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.528479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.528584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.528687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.528715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.528820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.528969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.528996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.529129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.529212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.529237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.529324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.529433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.529458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.529557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.529674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.529703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.529814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.529924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.529952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.530042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.530165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.530192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.530317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.530409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.530438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.530550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.530636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.530661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.530755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.530841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.530866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.530940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.531027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.531057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.531145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.531256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.531282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.531419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.531539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.531568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.531676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.531795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.531822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.531928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.532032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.532057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.532189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.532315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.532343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.532492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.532598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.532660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.532743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.532851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.532876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.532953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.533036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.533060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.533178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.533306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.533333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.533447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.533561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.533590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.533684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.533793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.533820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.533946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.534035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.534062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.534176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.534259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.534283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.534421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.534554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.534578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.066 qpair failed and we were unable to recover it. 00:30:49.066 [2024-11-18 16:17:12.534703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.066 [2024-11-18 16:17:12.534838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.534865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.534968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.535056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.535081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.535163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.535273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.535314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.535403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.535537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.535562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.535685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.535801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.535826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.535980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.536060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.536090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.536206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.536302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.536327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.536440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.536525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.536551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.536717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.536807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.536835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.536949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.537079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.537108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.537223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.537326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.537351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.537491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.537619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.537649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.537737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.537838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.537868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.538006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.538090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.538115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.538228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.538349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.538376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.538467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.538560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.538604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.538720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.538836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.538860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.538966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.539088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.539116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.539214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.539364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.539391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.539525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.539622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.539648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.539784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.539911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.539938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.540095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.540223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.540251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.540390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.540467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.540491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.540572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.540720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.540749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.540877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.540970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.540998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.067 qpair failed and we were unable to recover it. 00:30:49.067 [2024-11-18 16:17:12.541107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.067 [2024-11-18 16:17:12.541186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.541210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.541330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.541470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.541498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.541594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.541744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.541769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.541890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.542002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.542027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.542167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.542273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.542301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.542399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.542492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.542519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.542633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.542711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.542736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.542850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.542929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.542954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.543044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.543181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.543210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.543323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.543412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.543437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.543554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.543690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.543718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.543819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.543980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.544007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.544110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.544196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.544221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.544309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.544473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.544500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.544625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.544722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.544749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.544851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.544946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.544971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.545062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.545164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.545191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.545328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.545414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.545439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.545548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.545630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.545656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.545767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.545852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.545877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.545955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.546058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.546085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.546243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.546355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.546379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.546518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.546602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.546638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.546741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.546826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.546851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.547003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.547123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.547148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.547237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.547348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.547374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.547468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.547570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.547598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.547719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.547810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.547835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.068 [2024-11-18 16:17:12.547928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.548100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.068 [2024-11-18 16:17:12.548128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.068 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.548276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.548399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.548428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.548538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.548631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.548657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.548819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.548949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.548991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.549098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.549212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.549255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.549358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.549439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.549464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.549550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.549698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.549727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.549847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.549971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.549999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.550121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.550212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.550237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.550324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.550424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.550449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.550561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.550636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.550662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.550744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.550832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.550859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.550978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.551140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.551168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.551270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.551362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.551390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.551505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.551596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.551628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.551717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.551855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.551883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.551980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.552074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.552102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.552206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.552292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.552319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.552460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.552588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.552631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.552721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.552804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.552831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.552968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.553078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.553104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.553202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.553298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.553326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.553452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.553579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.553616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.553765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.553855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.553881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.553983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.554075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.554103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.554225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.554380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.554408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.554551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.554639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.554665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.554768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.554890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.554918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.555015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.555105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.555133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.069 qpair failed and we were unable to recover it. 00:30:49.069 [2024-11-18 16:17:12.555241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.069 [2024-11-18 16:17:12.555320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.555346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.555441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.555542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.555569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.555695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.555829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.555857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.555980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.556066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.556091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.556204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.556290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.556334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.556429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.556543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.556571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.556682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.556801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.556825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.556988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.557073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.557101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.557196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.557296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.557325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.557439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.557533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.557557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.557644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.557731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.557755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.557835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.557936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.557964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.558101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.558187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.558211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.558299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.558418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.558443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.558553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.558645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.558672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.558782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.558864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.558889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.558997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.559086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.559110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.559212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.559317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.559344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.559443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.559528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.559553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.559664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.559776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.559802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.559900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.559993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.560020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.560125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.560198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.560223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.560335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.560445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.560472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.560556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.560680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.560705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.560786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.560899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.560924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.561013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.561097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.561121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.561238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.561359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.561386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.561520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.561602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.561633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.070 qpair failed and we were unable to recover it. 00:30:49.070 [2024-11-18 16:17:12.561761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.561857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.070 [2024-11-18 16:17:12.561885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.562003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.562125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.562152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.562255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.562365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.562390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.562468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.562575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.562602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.562697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.562792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.562820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.562919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.562991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.563016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.563105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.563240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.563282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.563395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.563481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.563506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.563591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.563690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.563715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.563806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.563917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.563942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.564029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.564161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.564185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.564293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.564375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.564400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.564481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.564565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.564589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.564695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.564781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.564806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.564890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.565008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.565033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.565116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.565254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.565282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.565435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.565562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.565591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.565746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.565870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.565895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.565985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.566066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.566091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.566195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.566330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.566356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.566474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.566564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.566591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.566690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.566851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.566879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.567008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.567181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.567207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.567322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.567475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.567517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.567672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.567765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.567790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.567872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.567990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.568018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.568120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.568214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.568239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.071 qpair failed and we were unable to recover it. 00:30:49.071 [2024-11-18 16:17:12.568351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.568430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.071 [2024-11-18 16:17:12.568455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.568556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.568676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.568704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.568807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.568919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.568943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.569027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.569133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.569161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.569261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.569351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.569378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.569480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.569618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.569644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.569731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.569820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.569861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.569955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.570076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.570103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.570271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.570387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.570412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.570529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.570657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.570691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.570781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.570906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.570935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.571077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.571162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.571187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.571327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.571460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.571485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.571570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.571666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.571692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.571770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.571851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.571876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.571983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.572120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.572147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.572285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.572364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.572389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.572500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.572588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.572644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.572759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.572861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.572890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.573017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.573140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.573173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.573350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.573423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.573448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.573578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.573741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.573769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.573868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.573964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.573992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.574134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.574219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.574244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.072 qpair failed and we were unable to recover it. 00:30:49.072 [2024-11-18 16:17:12.574391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.072 [2024-11-18 16:17:12.574478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.574505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.574641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.574763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.574790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.574900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.574980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.575004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.575133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.575249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.575277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.575378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.575501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.575528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.575660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.575744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.575774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.575864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.575973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.576000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.576126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.576248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.576275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.576404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.576486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.576511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.576620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.576740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.576768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.576869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.576987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.577029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.577135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.577218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.577243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.577348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.577461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.577489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.577587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.577695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.577723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.577827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.577905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.577929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.578087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.578222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.578251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.578335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.578415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.578440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.578561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.578676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.578702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.578782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.578929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.578956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.579082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.579204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.579232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.579338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.579449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.579475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.579601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.579732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.579760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.579894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.580020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.580049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.580158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.580269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.580293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.580425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.580522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.580550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.580642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.580734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.580761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.580894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.580980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.581005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.581134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.581226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.581250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.073 qpair failed and we were unable to recover it. 00:30:49.073 [2024-11-18 16:17:12.581371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.581502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.073 [2024-11-18 16:17:12.581529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.581647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.581752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.581777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.581866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.581963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.581990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.582091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.582226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.582254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.582386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.582470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.582495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.582601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.582735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.582763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.582871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.582993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.583020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.583123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.583240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.583265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.583396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.583523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.583550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.583696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.583784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.583812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.583915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.583994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.584019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.584105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.584234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.584262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.584361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.584508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.584536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.584674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.584829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.584854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.584983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.585110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.585151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.585294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.585375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.585400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.585489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.585631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.585657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.585760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.585891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.585918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.586009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.586103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.586131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.586229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.586317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.586341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.586453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.586591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.586625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.586747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.586836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.586865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.586961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.587078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.587102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.587184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.587270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.587295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.587435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.587524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.587549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.587662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.587742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.587767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.587857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.587957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.587982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.588072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.588222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.588247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.588336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.588425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.074 [2024-11-18 16:17:12.588451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.074 qpair failed and we were unable to recover it. 00:30:49.074 [2024-11-18 16:17:12.588573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.588737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.588766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.588917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.589041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.589070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.589232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.589345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.589370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.589514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.589662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.589688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.589777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.589865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.589907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.590045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.590155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.590181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.590319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.590441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.590470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.590559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.590697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.590727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.590841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.590947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.590972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.591060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.591168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.591195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.591294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.591408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.591435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.591568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.591681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.591706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.591814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.591925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.591953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.592040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.592138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.592166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.592277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.592410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.592435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.592567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.592721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.592749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.592845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.592999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.593027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.593195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.593285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.593310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.593453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.593614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.593643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.593738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.593867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.593894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.594006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.594118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.594142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.594227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.594336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.594361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.594491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.594587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.594622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.594729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.594843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.594868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.594963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.595040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.595066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.595145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.595224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.595250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.595335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.595418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.595443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.595525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.595614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.595640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.075 qpair failed and we were unable to recover it. 00:30:49.075 [2024-11-18 16:17:12.595752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.595866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.075 [2024-11-18 16:17:12.595894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.076 qpair failed and we were unable to recover it. 00:30:49.076 [2024-11-18 16:17:12.596005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.596105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.596129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.076 qpair failed and we were unable to recover it. 00:30:49.076 [2024-11-18 16:17:12.596218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.596309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.596335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.076 qpair failed and we were unable to recover it. 00:30:49.076 [2024-11-18 16:17:12.596429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.596519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.596543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.076 qpair failed and we were unable to recover it. 00:30:49.076 [2024-11-18 16:17:12.596643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.596740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.596765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.076 qpair failed and we were unable to recover it. 00:30:49.076 [2024-11-18 16:17:12.596852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.596945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.596971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.076 qpair failed and we were unable to recover it. 00:30:49.076 [2024-11-18 16:17:12.597086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.597172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.597200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.076 qpair failed and we were unable to recover it. 00:30:49.076 [2024-11-18 16:17:12.597331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.597425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.597451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.076 qpair failed and we were unable to recover it. 00:30:49.076 [2024-11-18 16:17:12.597560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.597697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.597722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.076 qpair failed and we were unable to recover it. 00:30:49.076 [2024-11-18 16:17:12.597810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.597897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.076 [2024-11-18 16:17:12.597922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.076 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.598002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.598090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.598115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.598221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.598319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.598346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.598434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.598522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.598548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.598716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.598809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.598833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.598953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.599029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.599053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.599171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.599258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.599282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.599401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.599483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.599506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.599630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.599721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.599746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.599830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.599941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.599966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.600050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.600135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.600159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.600304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.600421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.600445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.600554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.600650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.600677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.600769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.600851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.600874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.600965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.601044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.601068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.601179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.601266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.601289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.601378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.601496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.601520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.601615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.601755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.601780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.601887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.602000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.602024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.602112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.602226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.378 [2024-11-18 16:17:12.602250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.378 qpair failed and we were unable to recover it. 00:30:49.378 [2024-11-18 16:17:12.602748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.602838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.602862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.602979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.603061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.603085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.603199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.603317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.603346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.603524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.603613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.603638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.603781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.603870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.603913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.604024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.604138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.604164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.604250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.604357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.604384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.604509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.604597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.604631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.604729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.604866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.604890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.605016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.605135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.605162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.605254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.605337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.605363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.605494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.605636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.605661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.605741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.605846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.605870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.606034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.606121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.606148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.606305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.606394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.606418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.606510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.606603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.606636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.606718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.606832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.606856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.606943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.607052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.607076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.607186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.607293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.607319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.607422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.607597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.607629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.607744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.607883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.607908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.608032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.608168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.608194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.608344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.608474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.608500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.608634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.608747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.608771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.608855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.609000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.609026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.609166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.609277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.609301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.379 qpair failed and we were unable to recover it. 00:30:49.379 [2024-11-18 16:17:12.609417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.609530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.379 [2024-11-18 16:17:12.609554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.609670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.609802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.609826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.609940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.610058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.610081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.610189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.610277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.610302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.610436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.610573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.610597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.610707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.610815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.610839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.610932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.611070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.611094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.611186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.611316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.611344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.611471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.611602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.611634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.611794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.611884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.611908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.611991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.612068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.612092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.612200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.612278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.612302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.612454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.612563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.612587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.612696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.612814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.612839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.612954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.613076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.613103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.613239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.613356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.613381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.613480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.613559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.613586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.613698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.613788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.613814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.613931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.614024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.614049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.614131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.614257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.614285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.614410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.614545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.614569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.380 qpair failed and we were unable to recover it. 00:30:49.380 [2024-11-18 16:17:12.614689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.380 [2024-11-18 16:17:12.614768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.614792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.614877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.614978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.615006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.615123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.615213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.615240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.615347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.615460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.615485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.615622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.615714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.615741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.615846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.615940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.615968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.616105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.616213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.616242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.616346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.616428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.616455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.616578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.616738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.616767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.616929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.617018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.617042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.617177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.617317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.617341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.617433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.617520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.617543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.617632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.617707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.617731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.617871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.617950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.617975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.618066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.618171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.618195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.618304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.618409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.618433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.618505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.618618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.618647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.618763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.618854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.618895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.619001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.619098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.619122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.619250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.619338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.619365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.619513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.619630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.619657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.619797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.619904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.619928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.620059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.620189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.620216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.620309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.620430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.620475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.381 qpair failed and we were unable to recover it. 00:30:49.381 [2024-11-18 16:17:12.620570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.381 [2024-11-18 16:17:12.620678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.620704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.620828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.620904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.620928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.621013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.621120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.621144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.621239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.621348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.621373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.621536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.621628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.621656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.621771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.621870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.621897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.622011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.622100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.622124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.622228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.622351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.622378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.622529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.622688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.622716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.622830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.622939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.622963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.623045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.623151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.623178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.623306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.623402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.623429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.623535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.623625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.623649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.623741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.623828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.623854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.623995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.624085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.624112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.624218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.624307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.624332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.624417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.624528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.624551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.624710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.624798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.624824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.624932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.625046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.625070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.625198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.625285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.625312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.625398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.625529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.625557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.625670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.625755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.625779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.625862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.625937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.625961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.626071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.626158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.626183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.382 qpair failed and we were unable to recover it. 00:30:49.382 [2024-11-18 16:17:12.626302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.626384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.382 [2024-11-18 16:17:12.626408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.626504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.626602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.626637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.626783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.626918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.626946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.627052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.627139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.627164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.627291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.627442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.627469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.627560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.627693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.627721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.627859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.627968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.627993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.628094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.628221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.628248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.628349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.628434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.628461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.628564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.628662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.628688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.628773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.628887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.628913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.629023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.629115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.629142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.629279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.629364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.629388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.629466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.629550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.629575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.629667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.629748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.629773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.629889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.629986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.630010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.630144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.630298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.630327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.630459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.630549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.630577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.630710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.630801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.630825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.383 qpair failed and we were unable to recover it. 00:30:49.383 [2024-11-18 16:17:12.630935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.383 [2024-11-18 16:17:12.631063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.631096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.631199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.631356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.631383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.631485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.631598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.631630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.631761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.631856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.631883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.632007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.632116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.632140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.632225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.632331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.632356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.632446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.632554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.632579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.632761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.632865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.632891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.633000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.633109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.633134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.633217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.633333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.633357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.633437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.633551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.633577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.633676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.633785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.633810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.633925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.634013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.634037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.634175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.634277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.634305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.634437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.634520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.634544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.634638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.634723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.634747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.634833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.634939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.634967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.635109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.635188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.635213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.635341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.635465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.635492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.635589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.635701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.635728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.635840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.635926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.635950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.636034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.636156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.636181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.384 [2024-11-18 16:17:12.636290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.636374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.384 [2024-11-18 16:17:12.636398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.384 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.636508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.636594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.636625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.636734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.636821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.636845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.636950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.637036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.637061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.637146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.637220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.637245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.637322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.637426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.637450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.637566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.637669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.637696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.637783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.637898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.637923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.638015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.638098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.638122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.638214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.638302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.638326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.638412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.638494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.638519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.638604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.638724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.638749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.638866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.638950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.638974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.639053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.639143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.639167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.639283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.639371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.639413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.639505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.639586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.639622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.639738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.639818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.639843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.639962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.640095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.640122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.640246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.640364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.640391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.640493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.640574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.640599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.640765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.640865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.640893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.640990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.641117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.641144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.641282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.641399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.641423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.385 qpair failed and we were unable to recover it. 00:30:49.385 [2024-11-18 16:17:12.641507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.641642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.385 [2024-11-18 16:17:12.641671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.641804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.641908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.641935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.642074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.642166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.642191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.642280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.642369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.642395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.642504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.642592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.642628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.642727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.642808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.642833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.642964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.643126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.643161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.643260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.643380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.643408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.643526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.643672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.643698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.643794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.643894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.643921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.644042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.644131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.644158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.644271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.644351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.644380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.644499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.644586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.644619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.644712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.644825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.644850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.644941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.645068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.645093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.645235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.645366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.645393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.645490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.645585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.645620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.645739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.645857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.645881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.645987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.646066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.646093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.646193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.646276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.646302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.646433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.646514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.386 [2024-11-18 16:17:12.646539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.386 qpair failed and we were unable to recover it. 00:30:49.386 [2024-11-18 16:17:12.646630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.646746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.646772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.646855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.646958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.646986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.647114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.647193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.647218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.647334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.647421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.647447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.647540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.647664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.647689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.647767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.647847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.647873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.647969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.648074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.648103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.648227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.648325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.648354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.648485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.648570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.648595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.648715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.648824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.648851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.648931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.649021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.649048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.649170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.649250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.649276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.649408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.649535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.649563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.649708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.649830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.649873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.649959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.650041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.650066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.650180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.650346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.650374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.650475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.650593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.650628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.650739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.650822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.650846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.650940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.651022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.651047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.651184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.651281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.651308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.651415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.651526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.651552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.387 [2024-11-18 16:17:12.651664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.651757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.387 [2024-11-18 16:17:12.651786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.387 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.651921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.652001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.652027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.652137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.652221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.652247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.652388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.652517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.652545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.652640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.652779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.652804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.652938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.653056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.653081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.653186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.653297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.653321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.653473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.653579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.653622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.653777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.653873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.653900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.654024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.654145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.654172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.654266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.654381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.654408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.654571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.654687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.654716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.654832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.654963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.655007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.655140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.655323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.655368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.655487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.655603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.655638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.655754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.655883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.655918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.656029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.656174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.656200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.656317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.656407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.656433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.656514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.656639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.656665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.656780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.656867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.656893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.657004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.657118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.657143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.657233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.657338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.657363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.388 [2024-11-18 16:17:12.657449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.657536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.388 [2024-11-18 16:17:12.657561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.388 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.657651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.657738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.657763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.657847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.657933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.657958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.658067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.658150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.658178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.658295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.658405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.658430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.658505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.658621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.658647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.658741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.658897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.658929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.659035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.659170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.659198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.659295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.659430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.659457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.659624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.659764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.659791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.659886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.660038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.660067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.660182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.660281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.660308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.660427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.660544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.660571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.660684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.660759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.660802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.660932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.661048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.661076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.661174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.661315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.661355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.661459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.661542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.661566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.661686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.661797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.661822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.661914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.662032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.389 [2024-11-18 16:17:12.662072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.389 qpair failed and we were unable to recover it. 00:30:49.389 [2024-11-18 16:17:12.662178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.662353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.662380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.662510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.662601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.662650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.662763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.662867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.662907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.663043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.663153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.663178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.663310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.663463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.663492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.663623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.663750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.663775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.663891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.664037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.664062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.664176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.664292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.664320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.664435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.664567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.664591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.664684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.664828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.664854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.664955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.665106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.665133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.665307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.665436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.665463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.665596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.665757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.665783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.665926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.666038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.666063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.666177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.666302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.666329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.666434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.666574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.666623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.666767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.666876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.666919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.667015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.667119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.667146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.667291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.667420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.667448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.667573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.667699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.667726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.667842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.667949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.667974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.668108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.668262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.668290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.668380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.668483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.668510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.668635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.668768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.668793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.668913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.669001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.669030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.390 qpair failed and we were unable to recover it. 00:30:49.390 [2024-11-18 16:17:12.669122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.390 [2024-11-18 16:17:12.669218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.669246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.669333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.669459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.669484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.669657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.669774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.669798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.669879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.669954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.669979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.670098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.670202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.670227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.670322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.670438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.670465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.670582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.670728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.670753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.670851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.670946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.670974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.671116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.671263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.671287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.671377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.671487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.671514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.671602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.671715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.671747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.671889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.671975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.672000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.672132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.672256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.672284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.672378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.672490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.672517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.672623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.672763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.672789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.672874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.672979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.673007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.673125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.673251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.673279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.673409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.673531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.673556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.673648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.673783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.673810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.673948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.674052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.674077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.674191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.674307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.674332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.674473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.674631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.674660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.674813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.674976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.675000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.391 qpair failed and we were unable to recover it. 00:30:49.391 [2024-11-18 16:17:12.675085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.391 [2024-11-18 16:17:12.675199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.675224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.675365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.675489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.675517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.675637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.675753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.675780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.675888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.675999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.676023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.676184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.676321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.676348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.676445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.676525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.676550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.676688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.676777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.676803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.676919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.677093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.677119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.677264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.677422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.677450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.677621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.677742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.677766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.677879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.677966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.677991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.678107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.678257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.678282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.678397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.678512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.678537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.678704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.678793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.678820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.678947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.679097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.679125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.679262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.679378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.679403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.679538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.679678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.679706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.679828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.679927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.679956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.680101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.680208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.680232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.680368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.680492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.680517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.680596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.680688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.680713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.680824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.680901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.680925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.681058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.681166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.681191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.681308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.681424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.392 [2024-11-18 16:17:12.681449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.392 qpair failed and we were unable to recover it. 00:30:49.392 [2024-11-18 16:17:12.681556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.681642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.681669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.681792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.681899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.681924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.682060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.682212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.682239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.682374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.682446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.682470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.682589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.682716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.682758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.682874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.682975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.683016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.683131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.683211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.683237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.683320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.683421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.683448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.683563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.683657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.683685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.683790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.683879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.683904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.684037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.684193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.684220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.684342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.684431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.684458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.684562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.684677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.684703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.684778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.684880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.684909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.685060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.685149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.685184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.685315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.685457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.685482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.685622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.685749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.685778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.685906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.686038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.686065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.686176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.686292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.686317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.686393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.686509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.686533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.686648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.686767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.686791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.686909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.687019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.687044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.687164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.687244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.687269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.393 qpair failed and we were unable to recover it. 00:30:49.393 [2024-11-18 16:17:12.687385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.393 [2024-11-18 16:17:12.687472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.687514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.687639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.687729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.687759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.687892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.687975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.688002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.688163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.688294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.688321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.688446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.688552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.688579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.688713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.688811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.688836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.688929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.689076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.689104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.689230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.689358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.689387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.689490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.689600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.689633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.689708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.689822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.689846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.689950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.690048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.690075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.690179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.690292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.690316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.690465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.690549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.690577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.690687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.690808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.690835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.690935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.691026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.691050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.691131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.691276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.691303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.691398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.691505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.691533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.691647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.691733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.691759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.691879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.692013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.692040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.692132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.692260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.692285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.692374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.692470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.692495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.692582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.692731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.692759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.692886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.693021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.693045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.693153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.693243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.693268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.693341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.693511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.693536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.394 qpair failed and we were unable to recover it. 00:30:49.394 [2024-11-18 16:17:12.693641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.394 [2024-11-18 16:17:12.693726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.693751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.693850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.693998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.694023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.694140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.694283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.694307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.694420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.694508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.694533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.694643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.694766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.694790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.694865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.695021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.695048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.695141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.695229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.695258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.695369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.695486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.695511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.695637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.695731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.695755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.695845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.695985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.696011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.696133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.696243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.696268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.696366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.696482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.696524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.696605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.696754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.696781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.696899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.696988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.697014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.697096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.697253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.697281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.697402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.697533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.697561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.697700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.697807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.697831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.697909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.698077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.698104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.698270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.698386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.698412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.698526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.698613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.698640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.698751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.698868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.698910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.395 [2024-11-18 16:17:12.699034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.699127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.395 [2024-11-18 16:17:12.699155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.395 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.699260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.699382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.699407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.699492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.699578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.699604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.699741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.699819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.699843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.699917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.700033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.700058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.700187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.700283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.700310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.700429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.700554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.700586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.700742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.700887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.700911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.701029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.701102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.701127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.701216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.701329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.701355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.701471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.701584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.701620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.701710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.701823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.701848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.702003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.702113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.702140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.702272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.702384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.702408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.702529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.702671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.702699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.702783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.702932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.702959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.703072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.703177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.703203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.703381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.703483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.703511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.703632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.703735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.703760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.703866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.703943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.703969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.704058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.704163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.704188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.704275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.704354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.704379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.704488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.704568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.704593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.704694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.704782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.704807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.704997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.705076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.705102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.396 qpair failed and we were unable to recover it. 00:30:49.396 [2024-11-18 16:17:12.705216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.396 [2024-11-18 16:17:12.705356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.705381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.705526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.705674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.705703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.705840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.705968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.705996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.706138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.706289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.706314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.706432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.706522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.706550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.706715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.706814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.706842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.707012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.707123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.707147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.707282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.707438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.707465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.707587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.707724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.707750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.707866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.707979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.708004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.708105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.708229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.708256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.708394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.708519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.708561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.708684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.708758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.708783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.708896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.709004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.709045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.709170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.709291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.709319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.709455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.709572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.709597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.709738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.709830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.709858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.709980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.710059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.710086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.710202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.710276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.710301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.710383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.710507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.710534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.710622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.710723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.710751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.710892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.711004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.711029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.711139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.711284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.711312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.711473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.711634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.711666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.397 qpair failed and we were unable to recover it. 00:30:49.397 [2024-11-18 16:17:12.711829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.397 [2024-11-18 16:17:12.711910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.711935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.712050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.712165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.712189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.712273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.712377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.712402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.712514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.712654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.712680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.712760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.712899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.712924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.713036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.713157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.713185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.713318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.713404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.713430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.713586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.713723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.713753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.713868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.714035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.714065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.714190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.714330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.714355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.714460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.714550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.714577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.714703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.714805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.714832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.714940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.715017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.715042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.715157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.715260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.715287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.715387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.715504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.715532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.715699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.715842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.715867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.715978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.716104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.716133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.716259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.716382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.716409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.716549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.716663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.716688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.716773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.716908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.716933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.717023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.717188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.717216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.717353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.717433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.398 [2024-11-18 16:17:12.717458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.398 qpair failed and we were unable to recover it. 00:30:49.398 [2024-11-18 16:17:12.717586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.717696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.717724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.717882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.717979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.718007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.718153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.718261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.718286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.718400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.718512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.718537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.718623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.718765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.718792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.718959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.719046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.719070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.719189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.719358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.719383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.719499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.719652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.719681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.719841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.719946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.719971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.720125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.720275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.720303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.720394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.720492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.720519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.720621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.720708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.720733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.720844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.720972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.720999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.721085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.721180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.721205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.721286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.721398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.721422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.721535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.721626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.721652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.721788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.721905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.721932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.722078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.722223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.722248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.722356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.722509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.722536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.722694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.722845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.722872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.399 qpair failed and we were unable to recover it. 00:30:49.399 [2024-11-18 16:17:12.723010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.399 [2024-11-18 16:17:12.723121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.723145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.723249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.723365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.723392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.723518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.723639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.723667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.723796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.723945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.723970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.724070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.724171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.724200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.724318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.724445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.724473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.724576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.724665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.724692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.724815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.724922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.724951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.725123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.725244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.725269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.725357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.725501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.725526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.725633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.725719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.725746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.725874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.725968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.725996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.726107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.726214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.726239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.726376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.726495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.726522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.726644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.726731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.726759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.726906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.727043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.727068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.727209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.727315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.727340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.727433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.727563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.727597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.727758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.727845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.727870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.727987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.728101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.728126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.728216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.728342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.728370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.400 [2024-11-18 16:17:12.728480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.728565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.400 [2024-11-18 16:17:12.728591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.400 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.728758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.728876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.728903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.729028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.729158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.729199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.729323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.729407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.729434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.729551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.729680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.729709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.729828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.729923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.729951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.730057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.730134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.730159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.730283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.730425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.730453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.730570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.730668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.730696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.730807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.730913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.730938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.731063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.731180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.731208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.731303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.731405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.731432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.731597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.731728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.731753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.731918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.732042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.732069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.732187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.732315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.732343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.732454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.732544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.732568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.732738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.732902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.732930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.733080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.733189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.733217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.733349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.733470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.733494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.733638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.733751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.733775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.733907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.734020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.734047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.734177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.734284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.734309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.401 [2024-11-18 16:17:12.734399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.734521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.401 [2024-11-18 16:17:12.734548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.401 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.734682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.734762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.734789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.734954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.735067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.735091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.735194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.735280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.735307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.735405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.735517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.735544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.735699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.735809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.735835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.735949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.736082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.736110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.736191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.736292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.736319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.736425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.736531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.736556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.736641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.736757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.736782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.736925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.737065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.737092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.737202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.737344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.737369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.737504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.737603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.737653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.737736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.737827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.737851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.737940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.738030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.738055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.738197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.738342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.738367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.738508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.738621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.738666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.738807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.738923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.738948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.739049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.739176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.739203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.739321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.739415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.739442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.739580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.739696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.739722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.739850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.740020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.740045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.740155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.740255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.740284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.740401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.740512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.740539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.740678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.740766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.402 [2024-11-18 16:17:12.740794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.402 qpair failed and we were unable to recover it. 00:30:49.402 [2024-11-18 16:17:12.740945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.741069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.741102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.741210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.741326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.741350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.741432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.741576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.741600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.741746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.741842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.741869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.742002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.742095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.742119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.742196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.742333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.742361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.742465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.742552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.742580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.742692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.742774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.742799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.742929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.743080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.743108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.743235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.743327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.743355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.743467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.743590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.743627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.743742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.743840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.743867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.743962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.744048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.744075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.744205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.744310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.744335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.744417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.744546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.744574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.744675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.744798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.744826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.744925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.745040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.745064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.745146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.745255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.745282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.745364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.745485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.745513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.745638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.745755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.745780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.745912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.745993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.746020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.746187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.746303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.746330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.746453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.746534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.403 [2024-11-18 16:17:12.746561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.403 qpair failed and we were unable to recover it. 00:30:49.403 [2024-11-18 16:17:12.746642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.746796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.746823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.746989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.747077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.747104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.747232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.747343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.747368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.747479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.747638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.747663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.747776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.747913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.747940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.748067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.748183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.748208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.748318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.748441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.748468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.748583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.748728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.748753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.748865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.748978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.749003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.749096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.749224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.749251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.749339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.749493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.749518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.749613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.749695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.749720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.749825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.749938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.749963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.750066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.750226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.750253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.750352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.750426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.750451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.750616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.750745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.750772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.750874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.750991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.751018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.751151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.751264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.751288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.751389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.751545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.751573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.751731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.751847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.751880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.751991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.752137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.752161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.752287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.752415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.752443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.752568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.752695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.752724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.752859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.752948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.752972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.404 [2024-11-18 16:17:12.753058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.753221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.404 [2024-11-18 16:17:12.753250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.404 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.753377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.753501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.753530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.753676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.753770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.753797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.753941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.754068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.754092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.754184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.754317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.754347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.754466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.754613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.754639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.754790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.754938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.754965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.755069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.755196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.755224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.755348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.755461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.755485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.755592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.755737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.755765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.755871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.756020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.756047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.756182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.756299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.756323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.756464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.756553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.756580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.756698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.756822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.756849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.756956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.757095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.757124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.757204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.757332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.757357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.757464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.757536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.757561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.757750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.757856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.757880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.758017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.758167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.758194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.758285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.758412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.758440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.758569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.758690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.758715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.758813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.758938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.405 [2024-11-18 16:17:12.758965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.405 qpair failed and we were unable to recover it. 00:30:49.405 [2024-11-18 16:17:12.759055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.759174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.759202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.759346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.759463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.759488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.759628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.759798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.759823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.759950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.760058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.760100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.760235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.760374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.760399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.760497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.760673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.760698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.760810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.760952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.760979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.761089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.761203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.761229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.761309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.761445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.761474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.761560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.761671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.761701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.761815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.761935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.761960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.762097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.762250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.762277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.762426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.762539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.762563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.762666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.762806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.762831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.762982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.763136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.763163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.763303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.763415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.763440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.763565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.763697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.763722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.763840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.763997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.406 [2024-11-18 16:17:12.764026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.406 qpair failed and we were unable to recover it. 00:30:49.406 [2024-11-18 16:17:12.764133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.764250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.764277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.764439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.764578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.764603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.764760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.764900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.764927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.765053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.765144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.765171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.765302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.765409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.765433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.765553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.765725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.765762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.765947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.766113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.766145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.766280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.766406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.766435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.766554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.766641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.766690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.766800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.766930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.766958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.767128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.767257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.767281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.767420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.767562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.767586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.767682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.767803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.767828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.767906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.767983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.768007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.768128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.768267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.768294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.768384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.768536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.768563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.768721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.768838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.768863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.768968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.769104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.769131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.769212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.769335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.769363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.769506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.769624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.769650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.769747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.769869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.769906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.770057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.770189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.770217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.770348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.770429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.770454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.407 qpair failed and we were unable to recover it. 00:30:49.407 [2024-11-18 16:17:12.770543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.407 [2024-11-18 16:17:12.770641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.770684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.770792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.770908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.770932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.771017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.771134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.771162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.771259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.771383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.771413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.771552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.771660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.771686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.771776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.771889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.771914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.771994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.772085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.772113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.772229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.772353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.772380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.772523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.772674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.772700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.772814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.772953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.772981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.773130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.773250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.773277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.773408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.773499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.773540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.773687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.773800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.773830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.773948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.774127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.774152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.774267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.774373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.774397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.774532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.774681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.774707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.774801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.774911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.774953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.775065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.775181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.775205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.775342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.775460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.775488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.775622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.775761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.775786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.775883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.775974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.775999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.776114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.776270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.776298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.776432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.776555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.776582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.776723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.776830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.776855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.776942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.777015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.777040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.408 qpair failed and we were unable to recover it. 00:30:49.408 [2024-11-18 16:17:12.777186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.777311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.408 [2024-11-18 16:17:12.777340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.777507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.777585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.777617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.777702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.777790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.777816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.777941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.778020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.778048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.778156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.778275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.778300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.778435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.778560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.778588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.778738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.778853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.778878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.778969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.779073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.779098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.779231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.779352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.779379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.779477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.779602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.779677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.779770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.779879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.779903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.780034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.780132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.780160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.780295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.780374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.780399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.780541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.780626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.780663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.780774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.780862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.780888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.781058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.781154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.781183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.781348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.781434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.781459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.781597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.781747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.781772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.781894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.782045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.782072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.782178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.782293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.782318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.782435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.782542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.782582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.782714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.782798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.782823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.409 qpair failed and we were unable to recover it. 00:30:49.409 [2024-11-18 16:17:12.782903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.783019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.409 [2024-11-18 16:17:12.783044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.783134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.783291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.783319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.783441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.783579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.783614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.783759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.783877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.783902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.784059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.784174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.784201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.784309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.784432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.784459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.784622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.784753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.784782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.784906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.785004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.785031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.785135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.785294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.785321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.785459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.785597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.785629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.785711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.785836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.785861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.786012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.786104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.786131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.786292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.786408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.786432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.786620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.786724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.786748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.786829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.786988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.787016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.787118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.787208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.787233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.787307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.787410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.787442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.787546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.787638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.787680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.787788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.787910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.787934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.788093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.788245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.788272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.788369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.788516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.788544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.788644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.788761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.788785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.788913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.789041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.789068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.789213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.789316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.789341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.789447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.789565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.789590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.789727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.789846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.410 [2024-11-18 16:17:12.789874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.410 qpair failed and we were unable to recover it. 00:30:49.410 [2024-11-18 16:17:12.789971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.790087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.790114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.790279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.790352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.790377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.790492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.790630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.790658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.790785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.790944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.790987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.791075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.791195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.791219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.791345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.791430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.791459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.791584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.791682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.791710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.791847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.791962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.791986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.792113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.792275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.792302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.792423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.792546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.792572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.792720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.792867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.792892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.792981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.793119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.793148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.793301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.793435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.793463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.793570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.793702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.793728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.793842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.793970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.793998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.794095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.794250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.794278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.794425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.794540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.794566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.794750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.794849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.794878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.795004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.795129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.795157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.795272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.795355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.795379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.795494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.795631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.795659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.795794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.795900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.795928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.796076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.796162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.796187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.411 [2024-11-18 16:17:12.796327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.796417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.411 [2024-11-18 16:17:12.796444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.411 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.796562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.796722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.796751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.796891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.797013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.797037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.797153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.797248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.797277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.797413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.797534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.797559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.797650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.797730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.797756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.797875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.797984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.798009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.798087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.798228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.798257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.798394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.798542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.798567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.798715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.798834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.798861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.798997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.799103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.799128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.799235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.799349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.799373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.799486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.799645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.799683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.799842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.799958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.799985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.800127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.800220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.800244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.800367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.800447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.800472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.800640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.800763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.800790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.412 [2024-11-18 16:17:12.800929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.801042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.412 [2024-11-18 16:17:12.801066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.412 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.801208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.801343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.801375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.801493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.801620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.801650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.801766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.801876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.801900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.802026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.802180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.802207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.802336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.802454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.802481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.802594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.802731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.802756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.802874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.803051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.803076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.803191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.803298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.803340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.803453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.803603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.803636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.803780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.803904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.803931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.804058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.804215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.804243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.804359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.804448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.804473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.804589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.804779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.804807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.804942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.805060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.805085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.805166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.805313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.805337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.805440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.805565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.805592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.805772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.805894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.805921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.806084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.806171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.806199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.806327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.806477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.806517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.806600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.806706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.806731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.806880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.806986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.807011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.413 qpair failed and we were unable to recover it. 00:30:49.413 [2024-11-18 16:17:12.807121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.413 [2024-11-18 16:17:12.807208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.807235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.807363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.807456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.807483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.807602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.807753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.807779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.807881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.808008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.808035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.808163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.808248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.808275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.808407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.808525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.808549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.808658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.808801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.808828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.808958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.809047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.809075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.809214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.809315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.809340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.809434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.809553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.809580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.809760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.809884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.809911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.810041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.810178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.810202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.810363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.810516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.810544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.810635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.810727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.810755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.810861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.810942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.810966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.811053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.811161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.811187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.811295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.811457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.811484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.811604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.811724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.811748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.811882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.812033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.812060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.812185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.812278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.812319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.812427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.812574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.812599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.812770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.812870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.812898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.812989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.813087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.813114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.813215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.813331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.813355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.813498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.813621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.813650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.813769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.813926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.813953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.814089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.814201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.814225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.414 qpair failed and we were unable to recover it. 00:30:49.414 [2024-11-18 16:17:12.814387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.414 [2024-11-18 16:17:12.814509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.814537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.814709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.814791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.814816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.814899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.814979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.815003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.815087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.815248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.815281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.815431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.815550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.815576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.815688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.815797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.815822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.815936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.816044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.816068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.816147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.816224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.816248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.816357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.816472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.816497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.816619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.816776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.816801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.816918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.817078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.817117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.817228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.817335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.817360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.817485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.817618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.817647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.817769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.817861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.817886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.817992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.818099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.818123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.818259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.818415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.818442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.818546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.818646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.818674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.818790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.818867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.818892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.819053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.819170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.819197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.819332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.819483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.819510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.819654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.819735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.819770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.819855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.819962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.819987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.820077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.820161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.820186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.820307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.820424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.820449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.820633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.820721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.415 [2024-11-18 16:17:12.820749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.415 qpair failed and we were unable to recover it. 00:30:49.415 [2024-11-18 16:17:12.820872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.820990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.821019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.821156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.821241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.821266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.821390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.821471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.821498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.821585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.821713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.821741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.821876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.821996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.822020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.822105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.822211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.822236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.822334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.822454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.822482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.822594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.822727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.822752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.822888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.822982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.823025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.823140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.823271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.823300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.823426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.823545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.823571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.823751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.823840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.823866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.823982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.824139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.824167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.824278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.824362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.824387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.824505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.824622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.824662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.824796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.824918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.824945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.825070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.825188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.825212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.825294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.825381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.825407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.825501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.825650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.825679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.825824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.825969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.826009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.826101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.826226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.826253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.826407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.826570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.826594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.826697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.826816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.826840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.416 [2024-11-18 16:17:12.826966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.827090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.416 [2024-11-18 16:17:12.827117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.416 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.827285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.827410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.827435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.827521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.827637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.827667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.827750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.827896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.827921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.828051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.828190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.828215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.828299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.828407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.828432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.828520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.828656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.828691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.828862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.828951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.828976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.829060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.829180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.829205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.829281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.829448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.829489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.829583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.829731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.829759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.829860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.830004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.830028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.830112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.830252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.830280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.830408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.830496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.830524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.830661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.830779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.830803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.830921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.831003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.831027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.831168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.831265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.831297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.417 qpair failed and we were unable to recover it. 00:30:49.417 [2024-11-18 16:17:12.831430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.831571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.417 [2024-11-18 16:17:12.831596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.831743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.831833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.831861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.831995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.832119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.832146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.832321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.832413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.832437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.832550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.832662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.832688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.832834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.832961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.832988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.833098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.833210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.833235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.833351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.833506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.833531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.833639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.833801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.833828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.833965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.834106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.834130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.834264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.834391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.834418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.834518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.834619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.834648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.834756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.834869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.834893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.834995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.835147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.835174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.835299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.835411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.835439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.835545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.835620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.835645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.835734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.835865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.835893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.836033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.836129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.836153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.836273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.836365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.836389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.418 qpair failed and we were unable to recover it. 00:30:49.418 [2024-11-18 16:17:12.836480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.836617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.418 [2024-11-18 16:17:12.836645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.836736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.836832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.836860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.836989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.837062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.837087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.837251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.837367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.837407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.837516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.837602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.837635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.837755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.837871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.837895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.838032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.838149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.838176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.838331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.838457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.838484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.838632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.838780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.838805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.838918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.839078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.839106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.839236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.839370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.839397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.839507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.839621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.839647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.839725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.839808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.839833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.839919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.840033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.840058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.840145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.840229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.840253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.840388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.840515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.840542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.840662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.840746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.840774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.840918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.841035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.841059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.841181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.841308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.841335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.841460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.841550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.841578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.841720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.841832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.841857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.842019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.842150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.842178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.842292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.842389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.842416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.842545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.842660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.842685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.419 [2024-11-18 16:17:12.842853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.842970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.419 [2024-11-18 16:17:12.842997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.419 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.843094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.843193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.843234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.843322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.843429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.843454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.843538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.843649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.843675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.843750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.843861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.843906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.843978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.844085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.844110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.844187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.844299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.844326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.844461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.844586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.844636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.844799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.844937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.844962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.845074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.845149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.845190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.845312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.845425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.845452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.845566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.845691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.845716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.845876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.845956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.845983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.846107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.846234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.846261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.846397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.846515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.846540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.846675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.846792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.846820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.846937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.847033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.847060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.847172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.847262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.847288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.847381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.847495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.847519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.847615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.847696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.847738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.847844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.847953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.847979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.848090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.848192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.848221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.848345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.848477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.848504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.848620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.848771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.848796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.848932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.849049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.849077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.420 qpair failed and we were unable to recover it. 00:30:49.420 [2024-11-18 16:17:12.849199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.420 [2024-11-18 16:17:12.849351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.849378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.849471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.849617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.849642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.849784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.849902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.849930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.850027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.850136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.850161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.850280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.850386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.850411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.850519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.850629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.850654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.850823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.850923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.850965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.851074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.851166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.851191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.851282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.851434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.851461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.851588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.851715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.851743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.851852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.851938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.851962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.852044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.852161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.852186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.852355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.852481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.852522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.852652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.852772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.852796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.852906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.853030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.853058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.853193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.853303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.853328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.853411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.853500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.853525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.853634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.853754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.853797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.853920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.854056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.854081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.854200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.854275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.854300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.854459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.854614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.854643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.854765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.854880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.854907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.855018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.855100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.855125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.855235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.855382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.855410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.855539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.855667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.855695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.855834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.855950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.855975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.856132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.856254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.856281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.856398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.856509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.856534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.856658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.856740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.421 [2024-11-18 16:17:12.856766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.421 qpair failed and we were unable to recover it. 00:30:49.421 [2024-11-18 16:17:12.856940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.857106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.857130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.857242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.857329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.857354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.857464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.857572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.857597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.857711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.857834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.857862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.857993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.858113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.858145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.858280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.858394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.858418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.858550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.858634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.858663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.858786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.858888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.858915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.859010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.859145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.859170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.859268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.859414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.859441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.859555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.859679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.859708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.859854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.859999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.860023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.860105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.860216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.860240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.860319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.860395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.860419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.860559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.860637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.860663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.860777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.860869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.860893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.860997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.861146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.861170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.861287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.861424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.861448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.861557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.861645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.861673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.861762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.861849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.861877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.861979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.862120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.862144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.862257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.862410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.862434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.862576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.862715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.862743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.862903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.862991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.863015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.863147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.863235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.863262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.863392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.863507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.863534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.863644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.863761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.863786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.863870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.863979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.864004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.864135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.864267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.864294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.422 qpair failed and we were unable to recover it. 00:30:49.422 [2024-11-18 16:17:12.864433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.422 [2024-11-18 16:17:12.864509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.864534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.864667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.864757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.864786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.864914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.865004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.865032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.865174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.865255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.865280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.865373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.865458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.865482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.865576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.865712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.865740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.865861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.865999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.866024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.866118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.866201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.866226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.866307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.866385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.866409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.866524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.866614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.866642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.866765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.866864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.866892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.867043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.867137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.867164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.867295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.867374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.867398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.867475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.867585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.867616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.867734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.867861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.867889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.868005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.868124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.868148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.868293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.868389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.868417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.868547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.868669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.868697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.868857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.868970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.868994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.869084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.869198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.869223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.869296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.869435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.869459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.869551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.869660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.869686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.869827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.869939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.869964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.870104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.870233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.870260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.870394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.870478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.870502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.423 qpair failed and we were unable to recover it. 00:30:49.423 [2024-11-18 16:17:12.870589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.423 [2024-11-18 16:17:12.870687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.870711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.870860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.870989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.871022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.871158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.871300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.871325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.871463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.871583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.871617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.871719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.871844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.871871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.872009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.872124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.872149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.872288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.872442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.872469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.872567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.872694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.872722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.872830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.872913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.872937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.873055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.873162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.873187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.873272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.873400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.873427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.873598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.873720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.873768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.873923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.874050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.874077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.874200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.874291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.874318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.874459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.874567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.874592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.874733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.874862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.874889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.874988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.875077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.875104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.875213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.875356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.875381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.875517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.875640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.875668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.875807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.875913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.875939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.876070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.876160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.876186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.876310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.876424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.876452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.876553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.876679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.876707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.876836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.876919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.876944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.877077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.877180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.877209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.877308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.877463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.877490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.877629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.877770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.877795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.877936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.878058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.878085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.424 qpair failed and we were unable to recover it. 00:30:49.424 [2024-11-18 16:17:12.878188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.424 [2024-11-18 16:17:12.878289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.878332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.878452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.878570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.878595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.878691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.878822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.878849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.878999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.879124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.879166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.879314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.879425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.879450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.879614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.879728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.879753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.879868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.879978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.880003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.880079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.880190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.880214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.880322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.880458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.880483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.880591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.880732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.880758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.880850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.880929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.880954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.881114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.881233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.881257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.881347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.881449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.881476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.881619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.881738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.881762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.881858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.881956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.881984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.882108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.882196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.882224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.882357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.882435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.882459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.882617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.882746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.882775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.882907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.882995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.883024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.883160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.883240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.883265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.883391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.883473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.883500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.883586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.883674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.883702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.883833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.883938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.883962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.884075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.884165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.884193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.884317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.884428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.884455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.884584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.884731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.884757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.425 qpair failed and we were unable to recover it. 00:30:49.425 [2024-11-18 16:17:12.884842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.425 [2024-11-18 16:17:12.884958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.884984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.885086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.885212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.885239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.885395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.885487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.885511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.885598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.885724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.885748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.885849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.886000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.886027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.886141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.886224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.886250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.886408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.886530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.886557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.886734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.886812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.886837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.886980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.887097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.887128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.887237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.887354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.887381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.887496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.887638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.887664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.887808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.887917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.887941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.888108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.888233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.888260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.888414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.888531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.888558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.888738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.888854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.888878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.889018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.889134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.889161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.889261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.889413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.889441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.889615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.889689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.889714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.889822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.889962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.889990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.890118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.890235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.890263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.890391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.890509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.890534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.890643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.890770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.890794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.890907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.891014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.891041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.891212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.891305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.891331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.891444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.891605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.891638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.891761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.891851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.891880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.892027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.892142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.892167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.892254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.892365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.892390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.892481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.892555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.892580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.892750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.892919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.892948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.893089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.893183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.893209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.893326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.893415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.893440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.426 qpair failed and we were unable to recover it. 00:30:49.426 [2024-11-18 16:17:12.893581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.426 [2024-11-18 16:17:12.893723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.893753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.893901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.894051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.894093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.894228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.894360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.894386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.894502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.894617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.894643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.894763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.894870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.894895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.895001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.895083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.895108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.895255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.895346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.895371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.895459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.895546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.895570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.895687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.895828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.895853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.895944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.896054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.896079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.896193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.896326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.896354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.896449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.896565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.896592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.896764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.896881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.896905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.897084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.897208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.897236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.897330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.897475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.897502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.897664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.897783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.897808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.897948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.898098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.898125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.898257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.898348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.898376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.898532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.898677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.898702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.898784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.898911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.898939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.899091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.899243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.899270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.899461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.899613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.899655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.899772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.899907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.899934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.900054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.900183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.900214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.900375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.900493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.900521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.900642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.900764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.900789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.427 qpair failed and we were unable to recover it. 00:30:49.427 [2024-11-18 16:17:12.900870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.427 [2024-11-18 16:17:12.900971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.900998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.901125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.901196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.901225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.901308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.901470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.901497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.901588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.901769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.901795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.901937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.902049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.902075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.902184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.902299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.902327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.902429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.902517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.902544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.902660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.902769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.902794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.902885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.903013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.903041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.903164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.903313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.903340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.903490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.903618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.903659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.903772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.903880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.903927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.904050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.904184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.904212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.904332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.904443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.904471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.904617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.904705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.904732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.904813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.904896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.904921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.905007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.905112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.905139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.905232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.905324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.905351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.905452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.905549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.905577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.905691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.905779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.905805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.905910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.906034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.906062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.906196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.906329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.906356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.906459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.906549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.906577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.906706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.906787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.906812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.906894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.906997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.907026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.907183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.907313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.907340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.907494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.907621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.907664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.907774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.907851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.907876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.907998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.908118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.908143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.908249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.908339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.908367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.908458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.908583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.908616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.908724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.908834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.908859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.908950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.909136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.909163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.909272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.909367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.909395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.428 qpair failed and we were unable to recover it. 00:30:49.428 [2024-11-18 16:17:12.909539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.428 [2024-11-18 16:17:12.909639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.909673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.909755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.909838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.909862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.909946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.910053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.910082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.910262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.910386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.910415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.910515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.910650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.910676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.910757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.910846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.910871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.910998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.911087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.911113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.911232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.911395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.911422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.911545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.911650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.911679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.911792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.911902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.911927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.912039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.912128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.912155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.912264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.912399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.912426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.912564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.912655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.912680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.912782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.912903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.912931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.913022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.913118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.913145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.913249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.913323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.913348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.913475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.913565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.913593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.913718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.913863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.913891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.913991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.914135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.914161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.914245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.914379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.914407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.914529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.914684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.914712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.914828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.914945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.914969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.915052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.915187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.915214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.915340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.915461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.915489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.915588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.915680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.915706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.915821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.915934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.915975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.916114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.916209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.916237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.916371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.916484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.916509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.916643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.916733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.916766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.916893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.917013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.917040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.917169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.917255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.917279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.429 [2024-11-18 16:17:12.917402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.917515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.429 [2024-11-18 16:17:12.917539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.429 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.917637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.917752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.917779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.917946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.918033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.918058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.918173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.918289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.918314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.918447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.918547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.918576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.918730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.918851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.918876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.918982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.919134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.919158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.919247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.919332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.919356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.919478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.919557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.919582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.919717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.919834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.919858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.919969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.920072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.920100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.920215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.920329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.920355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.920465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.920551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.920576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.920686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.920770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.920797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.920904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.921019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.921043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.921118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.921234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.921259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.921343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.921449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.921477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.921588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.921701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.921727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.921859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.922003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.922028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.922114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.922198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.922223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.922363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.922451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.922476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.922555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.922747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.922773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.922861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.922947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.922971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.923056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.923171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.923195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.923332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.923447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.923475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.923570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.923704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.923732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.923866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.923950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.923975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.924060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.924209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.924233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.430 [2024-11-18 16:17:12.924361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.924475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.430 [2024-11-18 16:17:12.924502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.430 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.924613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.924729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.924754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.924838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.924919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.924944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.925060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.925173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.925200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.925316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.925407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.925431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.925548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.925651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.925676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.925758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.925870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.925895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.925987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.926076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.926101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.926186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.926298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.926323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.926410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.926500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.926525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.926640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.926741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.926768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.926849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.926940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.926964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.927058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.927146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.927171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.927254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.927340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.927371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.927485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.927571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.927595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.927720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.927833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.927857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.927943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.928052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.928076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.928209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.928289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.928314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.928393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.928473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.928498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.928590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.928679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.928704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.928797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.928911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.928941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.715 [2024-11-18 16:17:12.929025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.929108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.715 [2024-11-18 16:17:12.929133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.715 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.929218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.929300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.929324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.929411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.929530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.929555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.929638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.929745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.929769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.929855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.929964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.929988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.930109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.930188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.930213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.930303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.930432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.930459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.930566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.930670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.930695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.930775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.930883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.930910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.931000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.931114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.931142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.931285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.931375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.931400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.931545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.931673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.931701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.931807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.931969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.931997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.932133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.932226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.932252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.932379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.932530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.932558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.932672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.932772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.932800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.932930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.933016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.933041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.933174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.933292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.933316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.933422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.933551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.933578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.933694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.933827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.933851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.933988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.934086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.934113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.934216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.934354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.934378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.934464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.934559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.934584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.934703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.934837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.934869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.716 [2024-11-18 16:17:12.935038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.935204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.716 [2024-11-18 16:17:12.935236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.716 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.935393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.935487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.935516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.935629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.935720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.935747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.935882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.935968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.935993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.936079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.936156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.936180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.936296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.936383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.936407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.936497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.936623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.936652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.936762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.936840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.936866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.936975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.937060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.937085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.937198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.937359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.937387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.937508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.937596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.937629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.937716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.937844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.937872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.938042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.938161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.938186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.938271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.938361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.938385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.938521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.938647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.938675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.938773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.938900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.938928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.939045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.939142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.939167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.939278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.939404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.939432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.939531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.939674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.939702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.939814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.939937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.939962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.940081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.940225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.940252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.940339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.940502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.940529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.940630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.940737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.940762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.717 qpair failed and we were unable to recover it. 00:30:49.717 [2024-11-18 16:17:12.940923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.941047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.717 [2024-11-18 16:17:12.941074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.941174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.941327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.941355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.941459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.941539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.941568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.941682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.941771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.941803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.941904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.942032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.942057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.942174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.942287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.942312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.942415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.942545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.942572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.942678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.942776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.942803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.942914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.943008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.943032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.943110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.943188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.943212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.943377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.943498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.943526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.943687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.943802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.943827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.944013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.944135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.944160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.944247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.944339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.944386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.944536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.944630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.944655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.944737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.944874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.944899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.945010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.945112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.945139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.945240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.945352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.945377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.945493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.945629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.945658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.945753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.945851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.945878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.946019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.946136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.946161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.946253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.946361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.946388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.946483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.946587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.946643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.946753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.946832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.946858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.718 qpair failed and we were unable to recover it. 00:30:49.718 [2024-11-18 16:17:12.946946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.718 [2024-11-18 16:17:12.947044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.947072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.947167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.947284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.947312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.947450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.947542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.947567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.947665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.947752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.947779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.947867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.947990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.948031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.948152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.948268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.948292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.948410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.948522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.948549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.948701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.948861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.948889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.949021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.949109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.949133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.949233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.949329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.949356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.949456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.949582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.949615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.949730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.949845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.949870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.949987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.950118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.950146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.950233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.950333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.950360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.950466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.950621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.950646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.950775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.950903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.950930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.951022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.951138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.951165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.951295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.951415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.951440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.951521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.951636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.951662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.951765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.951850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.951877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.952009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.952093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.952118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.719 qpair failed and we were unable to recover it. 00:30:49.719 [2024-11-18 16:17:12.952245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.952327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.719 [2024-11-18 16:17:12.952353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.952467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.952576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.952603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.952762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.952877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.952901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.953007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.953126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.953153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.953240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.953378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.953406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.953521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.953615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.953641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.953721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.953867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.953894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.954049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.954178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.954205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.954339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.954417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.954442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.954533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.954670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.954698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.954829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.954953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.954980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.955114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.955225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.955249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.955356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.955479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.955506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.955643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.955728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.955753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.955879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.955964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.955989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.956088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.956201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.956228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.956312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.956401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.956443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.956575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.956664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.956689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.956776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.956909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.956936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.720 qpair failed and we were unable to recover it. 00:30:49.720 [2024-11-18 16:17:12.957031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.720 [2024-11-18 16:17:12.957122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.957154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.957270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.957357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.957381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.957512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.957636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.957667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.957800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.957883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.957910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.958043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.958156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.958180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.958305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.958444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.958468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.958554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.958639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.958665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.958756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.958832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.958857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.958947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.959060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.959102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.959223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.959363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.959388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.959472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.959602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.959633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.959776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.959877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.959919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.960027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.960124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.960165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.960321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.960405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.960430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.960573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.960706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.960735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.960827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.960951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.960976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.961115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.961229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.961254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.961351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.961502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.961529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.961683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.961802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.961829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.961960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.962050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.962076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.962161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.962255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.962283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.962421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.962528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.962553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.962648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.962763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.962788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.962920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.963008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.963036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.721 qpair failed and we were unable to recover it. 00:30:49.721 [2024-11-18 16:17:12.963167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.721 [2024-11-18 16:17:12.963266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.963290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.963377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.963489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.963514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.963629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.963726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.963751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.963889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.963978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.964005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.964113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.964221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.964246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.964376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.964469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.964496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.964581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.964743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.964771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.964876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.964957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.964982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.965062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.965192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.965232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.965353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.965462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.965486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.965570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.965663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.965688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.965765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.965896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.965923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.966016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.966131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.966158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.966256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.966370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.966395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.966480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.966591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.966631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.966743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.966860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.966901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.967027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.967107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.967132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.967239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.967392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.967420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.967536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.967625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.967654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.967787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.967873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.967897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.968008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.968108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.968135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.968238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.968378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.968402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.968522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.968598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.968629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.968706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.968817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.968842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.968933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.969036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.722 [2024-11-18 16:17:12.969064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.722 qpair failed and we were unable to recover it. 00:30:49.722 [2024-11-18 16:17:12.969172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.969286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.969311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.969394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.969520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.969548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.969668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.969798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.969831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.969944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.970033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.970059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.970154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.970244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.970269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.970386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.970513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.970540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.970657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.970740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.970764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.970858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.970946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.970971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.971059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.971150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.971175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.971360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.971445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.971469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.971565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.971673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.971701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.971795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.971932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.971957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.972039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.972163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.972187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.972315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.972444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.972472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.972601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.972742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.972771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.972884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.972974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.972999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.973085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.973190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.973219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.973311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.973433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.973461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.973597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.973697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.973723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.973830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.973926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.973954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.974072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.974161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.974188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.974283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.974373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.974397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.974488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.974595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.974664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.974765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.974893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.974921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.723 qpair failed and we were unable to recover it. 00:30:49.723 [2024-11-18 16:17:12.975059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.723 [2024-11-18 16:17:12.975142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.975167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.975302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.975423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.975450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.975591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.975689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.975713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.975828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.975951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.975976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.976104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.976194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.976221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.976309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.976410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.976438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.976541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.976663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.976689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.976771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.976890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.976914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.977047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.977241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.977269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.977369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.977464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.977489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.977599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.977749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.977773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.977902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.977991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.978019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.978166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.978258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.978282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.978363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.978468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.978493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.978642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.978744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.978772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.978879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.978987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.979012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.979117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.979222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.979251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.979395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.979477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.979501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.979617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.979698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.979723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.979834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.979992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.980033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.980147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.980238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.980279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.980382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.980461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.980485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.980603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.980720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.980748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.980873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.980961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.980989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.724 qpair failed and we were unable to recover it. 00:30:49.724 [2024-11-18 16:17:12.981099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.724 [2024-11-18 16:17:12.981192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.981216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.981324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.981441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.981469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.981668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.981780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.981804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.981892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.981997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.982021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.982111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.982231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.982256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.982341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.982456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.982507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.982593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.982749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.982775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.982886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.982998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.983023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.983110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.983251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.983279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.983416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.983540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.983564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.983711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.983809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.983836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.983940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.984029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.984056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.984179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.984280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.984305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.984411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.984523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.984550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.984654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.984764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.984789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.984903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.985012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.985041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.985186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.985273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.985298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.985416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.985502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.985548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.985658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.985739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.985764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.985874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.986010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.986037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.986165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.986265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.986306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.986422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.986508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.986532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.986650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.986798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.986826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.986916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.987015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.987044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.987186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.987269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.987294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.987422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.987511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.725 [2024-11-18 16:17:12.987539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.725 qpair failed and we were unable to recover it. 00:30:49.725 [2024-11-18 16:17:12.987671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.987751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.987779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.987924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.988045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.988070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.988218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.988306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.988348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.988466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.988593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.988628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.988764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.988858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.988883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.988972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.989060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.989084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.989197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.989278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.989322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.989445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.989558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.989585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.989672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.989751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.989776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.989864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.989940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.989965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.990054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.990131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.990156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.990233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.990383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.990407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.990550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.990665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.990694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.990777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.990889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.990914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.991032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.991111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.991136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.991235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.991332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.991357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.991446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.991562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.991587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.991675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.991756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.991780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.991865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.991963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.991990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.992105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.992189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.992214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.726 qpair failed and we were unable to recover it. 00:30:49.726 [2024-11-18 16:17:12.992333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.726 [2024-11-18 16:17:12.992466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.992494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.992590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.992721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.992749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.992857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.992944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.992968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.993050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.993194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.993218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.993304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.993407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.993435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.993577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.993698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.993725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.993831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.993952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.993979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.994100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.994206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.994233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.994352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.994466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.994490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.994575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.994717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.994746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.994844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.994939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.994967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.995167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.995260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.995285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.995406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.995541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.995565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.995692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.995776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.995819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.996017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.996133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.996160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.996251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.996374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.996401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.996496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.996636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.996662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.996773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.996891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.996915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.997052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.997149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.997177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.997304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.997425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.997452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.997602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.997737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.997766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.997879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.998003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.998030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.998154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.998279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.998307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.998414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.998518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.998543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.727 [2024-11-18 16:17:12.998626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.998770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.727 [2024-11-18 16:17:12.998813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.727 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:12.998904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:12.998995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:12.999021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:12.999108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:12.999220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:12.999245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:12.999360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:12.999464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:12.999489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:12.999569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:12.999687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:12.999714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:12.999811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:12.999897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:12.999923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.000030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.000119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.000147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.000248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.000347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.000371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.000485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.000603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.000635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.000737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.000872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.000897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.000988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.001078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.001103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.001226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.001311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.001336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.001455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.001538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.001563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.001712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.001812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.001840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.001958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.002150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.002195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.002291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.002438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.002466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.002588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.002696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.002724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.002863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.002958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.002983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.003128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.003268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.003295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.003422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.003563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.003591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.003715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.003834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.003860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.003971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.004057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.004081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.004230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.004324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.004352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.728 [2024-11-18 16:17:13.004486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.004598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.728 [2024-11-18 16:17:13.004631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.728 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.004768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.004890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.004918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.005019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.005127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.005154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.005262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.005381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.005405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.005502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.005637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.005665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.005788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.005913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.005940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.006060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.006179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.006204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.006297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.006378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.006403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.006564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.006672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.006701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.006900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.007012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.007052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.007147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.007274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.007301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.007394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.007522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.007550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.007682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.007813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.007838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.007958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.008038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.008063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.008158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.008243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.008268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.008386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.008503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.008528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.008620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.008711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.008736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.008820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.008937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.008963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.009121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.009250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.009275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.009389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.009529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.009554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.009645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.009794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.009821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.009953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.010040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.010065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.010196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.010318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.010345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.010436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.010534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.010562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.729 qpair failed and we were unable to recover it. 00:30:49.729 [2024-11-18 16:17:13.010681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.729 [2024-11-18 16:17:13.010797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.010826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.010992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.011111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.011138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.011274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.011396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.011423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.011560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.011650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.011676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.011776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.011888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.011916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.012009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.012107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.012134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.012264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.012387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.012411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.012510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.012633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.012661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.012756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.012911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.012939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.013056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.013168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.013193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.013317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.013454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.013482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.013620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.013735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.013764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.013905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.014014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.014039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.014190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.014285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.014312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.014416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.014503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.014530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.014636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.014713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.014738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.014906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.015010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.015037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.015164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.015312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.015339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.015454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.015566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.015591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.015734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.015822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.015852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.015977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.016103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.016130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.730 [2024-11-18 16:17:13.016239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.016339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.730 [2024-11-18 16:17:13.016366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.730 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.016463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.016571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.016598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.016691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.016799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.016824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.016903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.017013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.017038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.017135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.017305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.017330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.017441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.017537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.017565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.017712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.017820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.017845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.017966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.018062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.018089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.018217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.018363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.018391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.018536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.018681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.018707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.018825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.018908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.018954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.019072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.019222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.019250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.019388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.019503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.019528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.019629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.019772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.019800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.019920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.020010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.020038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.020224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.020315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.020340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.020425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.020507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.020532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.020618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.020701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.020726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.020843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.020936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.020961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.021084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.021167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.021191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.731 qpair failed and we were unable to recover it. 00:30:49.731 [2024-11-18 16:17:13.021291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.731 [2024-11-18 16:17:13.021414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.021455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.021657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.021744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.021769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.021858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.021965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.021990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.022088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.022209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.022236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.022342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.022426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.022451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.022540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.022681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.022706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.022785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.022875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.022899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.022994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.023108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.023132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.023225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.023311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.023336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.023452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.023537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.023562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.023669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.023778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.023816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.023971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.024080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.024125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.024263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.024375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.024402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.024485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.024599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.024634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.024723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.024860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.024886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.025003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.025112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.025138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.025237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.025367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.025393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.025515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.025632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.025658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.025768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.025849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.025874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.025998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.026122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.026149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.026242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.026329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.026361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.026456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.026542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.026569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.026744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.026825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.026867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.027029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.027121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.027148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.027276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.027396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.027423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.027518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.027596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.027628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.732 qpair failed and we were unable to recover it. 00:30:49.732 [2024-11-18 16:17:13.027758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.732 [2024-11-18 16:17:13.027847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.027872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.027989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.028085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.028114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.028218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.028326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.028355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.028465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.028543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.028568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.028690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.028804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.028829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.028920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.029036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.029061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.029147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.029266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.029293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.029418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.029521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.029549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.029702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.029821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.029846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.029977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.030071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.030098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.030216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.030341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.030368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.030491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.030601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.030636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.030738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.030848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.030872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.030985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.031118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.031146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.031250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.031380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.031408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.031521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.031676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.031702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.031821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.031941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.031968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.032105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.032189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.032215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.032329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.032418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.032446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.032537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.032675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.032701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.032811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.032896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.032921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.033058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.033183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.033211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.033341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.033434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.033462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.033592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.033683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.033708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.033848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.033977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.034005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.034135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.034226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.034254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.733 [2024-11-18 16:17:13.034382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.034521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.733 [2024-11-18 16:17:13.034550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.733 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.034675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.034807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.034831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.034912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.035028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.035055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.035165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.035264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.035292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.035443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.035571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.035599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.035744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.035863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.035889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.035992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.036141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.036169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.036296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.036417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.036444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.036568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.036695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.036721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.036838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.036919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.036944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.037075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.037207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.037232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.037369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.037469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.037497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.037596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.037692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.037719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.037831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.037921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.037947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.038034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.038159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.038186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.038277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.038399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.038428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.038524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.038621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.038664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.038750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.038825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.038849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.039005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.039120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.039147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.039275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.039403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.039436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.039561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.039705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.039731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.039809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.039920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.039945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.040061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.040163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.040190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.040291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.040448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.040475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.040627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.040741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.040766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.040877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.041005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.041044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.041159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.041285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.734 [2024-11-18 16:17:13.041312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.734 qpair failed and we were unable to recover it. 00:30:49.734 [2024-11-18 16:17:13.041420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.041535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.041563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.041700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.041785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.041809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.041971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.042092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.042120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.042243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.042349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.042377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.042501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.042625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.042667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.042787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.042879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.042921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.043035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.043141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.043166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.043276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.043359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.043386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.043471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.043598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.043633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.043764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.043838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.043863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.043950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.044052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.044081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.044207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.044287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.044314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.044488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.044638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.044664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.044783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.044903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.044946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.045044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.045164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.045207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.045285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.045395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.045420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.045510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.045638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.045669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.045765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.045858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.045886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.046017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.046102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.046127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.046244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.046380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.046408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.046575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.046699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.046725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.046867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.046980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.047005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.047118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.047206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.047234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.047341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.047471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.047499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.047624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.047738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.047764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.735 qpair failed and we were unable to recover it. 00:30:49.735 [2024-11-18 16:17:13.047897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.735 [2024-11-18 16:17:13.048018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.048045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.048161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.048261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.048287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.048401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.048482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.048506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.048650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.048807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.048834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.048961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.049109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.049137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.049281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.049371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.049396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.049542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.049624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.049650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.049732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.049821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.049846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.049961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.050057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.050083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.050164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.050324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.050352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.050471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.050593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.050629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.050773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.050914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.050938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.051081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.051181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.051206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.051336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.051448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.051477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.051646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.051732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.051757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.051851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.051945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.051973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.052123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.052211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.052239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.052354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.052439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.052464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.052592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.052752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.052782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.052870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.052976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.053000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.053143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.053257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.053285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.053437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.053576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.053603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.053749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.053891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.053916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.736 qpair failed and we were unable to recover it. 00:30:49.736 [2024-11-18 16:17:13.054004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.736 [2024-11-18 16:17:13.054094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.054120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.054215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.054328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.054353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.054479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.054595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.054630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.054735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.054854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.054879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.054971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.055084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.055109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.055191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.055295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.055321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.055465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.055538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.055563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.055705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.055834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.055861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.055991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.056113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.056141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.056298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.056390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.056415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.056548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.056655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.056684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.056781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.056927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.056952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.057067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.057185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.057210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.057312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.057405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.057434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.057558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.057689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.057717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.057857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.057944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.057968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.058113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.058210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.058238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.058356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.058459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.058487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.058648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.058762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.058787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.058889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.059017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.059045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.059163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.059252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.059280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.059383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.059488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.059513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.059648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.059735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.059763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.737 qpair failed and we were unable to recover it. 00:30:49.737 [2024-11-18 16:17:13.059892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.737 [2024-11-18 16:17:13.060036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.060061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.060176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.060267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.060292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.060387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.060469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.060493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.060601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.060774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.060800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.060955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.061040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.061064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.061199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.061297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.061325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.061452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.061549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.061577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.061707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.061849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.061874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.061953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.062069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.062111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.062236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.062352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.062379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.062530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.062642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.062668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.062758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.062909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.062936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.063061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.063188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.063216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.063324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.063440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.063465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.063583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.063687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.063715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.063804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.063931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.063958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.064099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.064205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.064229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.064347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.064443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.064470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.064558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.064689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.064734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.064816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.064941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.064967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.065091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.065184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.065209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.065343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.065441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.065469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.065611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.065704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.738 [2024-11-18 16:17:13.065730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.738 qpair failed and we were unable to recover it. 00:30:49.738 [2024-11-18 16:17:13.065860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.065976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.066008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.066125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.066213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.066241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.066367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.066481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.066507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.066614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.066700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.066728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.066822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.066965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.066991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.067106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.067220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.067245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.067336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.067475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.067515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.067641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.067762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.067790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.067904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.068032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.068057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.068139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.068278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.068306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.068399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.068518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.068550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.068664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.068751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.068777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.068858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.068989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.069029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.069145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.069261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.069287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.069400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.069518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.069543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.069702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.069787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.069812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.069899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.070044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.070072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.070190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.070304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.070329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.070409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.070511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.070535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.070655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.070789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.070816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.070920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.071036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.071061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.071171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.071298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.071325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.071486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.071615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.071644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.071811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.071933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.071957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.739 [2024-11-18 16:17:13.072061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.072189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.739 [2024-11-18 16:17:13.072217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.739 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.072353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.072476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.072504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.072619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.072761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.072786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.072867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.072981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.073006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.073103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.073301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.073325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.073472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.073614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.073640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.073779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.073912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.073937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.074105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.074224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.074252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.074364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.074451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.074476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.074605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.074725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.074753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.074860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.075025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.075049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.075187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.075279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.075304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.075435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.075554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.075582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.075693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.075855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.075884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.076051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.076253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.076280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.076441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.076591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.076651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.076784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.076881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.076907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.077040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.077186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.077227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.077358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.077485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.077513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.077655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.077753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.077781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.077919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.078061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.078086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.078228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.078327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.078355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.078506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.078623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.078652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.078755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.078845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.078870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.078977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.079067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.079091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.740 qpair failed and we were unable to recover it. 00:30:49.740 [2024-11-18 16:17:13.079175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.079311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.740 [2024-11-18 16:17:13.079338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.079468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.079560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.079586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.079681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.079763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.079789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.079879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.080032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.080057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.080167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.080250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.080274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.080416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.080554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.080581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.080736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.080826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.080851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.080971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.081083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.081107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.081241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.081383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.081410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.081500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.081622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.081650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.081792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.082007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.082034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.082140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.082262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.082290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.082395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.082486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.082519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.082650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.082740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.082765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.082856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.083002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.083045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.083145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.083261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.083289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.083397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.083478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.083503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.083593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.083712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.083737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.083937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.084113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.084140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.084243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.084355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.084381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.084476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.084604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.084658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.084761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.084892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.084920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.085037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.085116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.085141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.085246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.085330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.085355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.741 [2024-11-18 16:17:13.085468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.085553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.741 [2024-11-18 16:17:13.085581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.741 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.085711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.085811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.085836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.085949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.086066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.086108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.086235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.086367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.086394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.086531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.086713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.086739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.086911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.087037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.087064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.087215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.087313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.087341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.087457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.087599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.087631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.087733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.087846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.087873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.087978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.088104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.088132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.088234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.088327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.088352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.088442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.088550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.088577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.088697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.088823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.088847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.088943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.089015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.089040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.089122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.089253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.089281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.089410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.089562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.089590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.089744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.089859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.089883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.090016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.090169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.090196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.090303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.090427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.090456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.090594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.090729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.090754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.742 qpair failed and we were unable to recover it. 00:30:49.742 [2024-11-18 16:17:13.090895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.742 [2024-11-18 16:17:13.091050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.091077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.091190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.091271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.091295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.091381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.091464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.091489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.091602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.091721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.091749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.091844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.091963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.091992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.092127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.092212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.092235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.092319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.092443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.092466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.092578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.092692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.092717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.092840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.092918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.092943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.093062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.093225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.093253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.093387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.093466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.093490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.093613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.093707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.093732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.093869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.093958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.093986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.094102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.094230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.094257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.094363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.094443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.094466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.094604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.094724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.094753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.094888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.094979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.095006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.095114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.095197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.095222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.095311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.095429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.095453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.095570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.095662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.095710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.095829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.095937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.095961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.096073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.096194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.096221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.096316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.096399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.096426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.096530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.096679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.096705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.096847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.096938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.096981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.743 qpair failed and we were unable to recover it. 00:30:49.743 [2024-11-18 16:17:13.097100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.097192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.743 [2024-11-18 16:17:13.097217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.097358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.097439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.097464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.097660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.097745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.097769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.097938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.098040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.098067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.098228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.098360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.098384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.098508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.098680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.098706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.098796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.098905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.098930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.099043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.099182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.099207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.099328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.099423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.099450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.099583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.099694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.099722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.099827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.099955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.099980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.100110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.100226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.100253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.100375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.100460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.100487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.100586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.100674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.100702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.100816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.100980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.101007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.101111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.101247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.101273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.101361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.101453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.101478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.101559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.101711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.101737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.101823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.101931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.101957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.102096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.102172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.102197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.102276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.102407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.102449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.102560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.102637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.102663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.102793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.102904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.102929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.103021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.103104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.103129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.744 qpair failed and we were unable to recover it. 00:30:49.744 [2024-11-18 16:17:13.103205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.103363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.744 [2024-11-18 16:17:13.103390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.103562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.103677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.103703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.103848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.103974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.104002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.104096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.104229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.104258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.104395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.104515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.104540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.104631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.104765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.104807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.104934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.105054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.105081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.105214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.105333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.105358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.105476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.105568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.105593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.105693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.105799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.105823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.105911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.105984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.106010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.106100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.106212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.106238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.106347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.106462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.106486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.106597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.106695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.106720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.106800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.106889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.106913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.107007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.107122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.107164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.107280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.107358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.107383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.107468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.107572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.107623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.107712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.107824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.107864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.107983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.108072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.108096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.108187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.108292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.108320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.108441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.108545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.108576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.108701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.108813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.108838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.745 qpair failed and we were unable to recover it. 00:30:49.745 [2024-11-18 16:17:13.108923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.745 [2024-11-18 16:17:13.109053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.109080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.109222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.109328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.109353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.109505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.109592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.109627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.109777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.109858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.109882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.110001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.110087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.110113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.110196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.110292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.110318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.110402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.110563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.110591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.110728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.110817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.110844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.111013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.111103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.111131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.111281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.111401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.111426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.111561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.111688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.111717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.111858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.111967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.111992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.112099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.112226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.112253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.112347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.112501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.112529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.112655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.112740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.112764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.112858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.112966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.112996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.113112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.113228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.113256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.113360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.113450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.113477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.113619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.113758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.113786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.113889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.113985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.114010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.114119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.114208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.114233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.114363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.114487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.114515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.114684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.114833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.114858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.746 qpair failed and we were unable to recover it. 00:30:49.746 [2024-11-18 16:17:13.114960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.746 [2024-11-18 16:17:13.115070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.115094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.115204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.115294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.115322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.115415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.115538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.115566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.115720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.115850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.115875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.116014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.116128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.116156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.116257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.116367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.116392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.116514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.116597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.116630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.116761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.116845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.116873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.116958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.117099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.117126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.117259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.117349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.117374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.117501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.117618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.117652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.117772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.117862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.117887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.117970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.118057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.118083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.118174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.118307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.118335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.118430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.118517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.118545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.118647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.118751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.118776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.118907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.119038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.119067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.119166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.119288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.119316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.119421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.119539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.119564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.119698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.119793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.119819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.119919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.120044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.120070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.120182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.120299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.120322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.747 qpair failed and we were unable to recover it. 00:30:49.747 [2024-11-18 16:17:13.120458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.120546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.747 [2024-11-18 16:17:13.120572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.120729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.120854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.120880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.120988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.121146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.121169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.121271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.121369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.121395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.121545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.121678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.121706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.121865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.121976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.122000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.122139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.122301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.122327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.122461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.122544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.122570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.122707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.122797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.122821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.122992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.123077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.123104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.123228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.123375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.123399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.123511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.123589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.123623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.123759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.123848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.123875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.123965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.124053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.124083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.124192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.124276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.124307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.124415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.124502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.124527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.124677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.124807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.124847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.748 [2024-11-18 16:17:13.124996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.125079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.748 [2024-11-18 16:17:13.125103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.748 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.125242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.125341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.125368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.125463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.125558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.125585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.125765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.125847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.125872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.125994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.126141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.126169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.126270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.126389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.126431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.126513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.126597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.126631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.126710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.126793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.126818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.126905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.127009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.127038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.127149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.127255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.127280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.127396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.127536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.127564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.127667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.127766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.127794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.127918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.128006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.128031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.128113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.128230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.128255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.128376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.128460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.128485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.128620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.128709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.128734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.128855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.128939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.128979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.129069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.129166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.129195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.129328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.129407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.129432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.129519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.129626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.129658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.129802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.129890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.129916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.130025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.130107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.130132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.130214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.130331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.130356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.130488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.130619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.130648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.749 qpair failed and we were unable to recover it. 00:30:49.749 [2024-11-18 16:17:13.130783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.749 [2024-11-18 16:17:13.130866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.130891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.131027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.131113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.131141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.131242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.131333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.131360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.131491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.131634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.131659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.131808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.131947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.131971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.132082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.132214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.132242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.132343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.132460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.132484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.132572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.132690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.132716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.132808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.132927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.132951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.133075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.133185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.133210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.133313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.133412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.133441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.133579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.133724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.133749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.133864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.133942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.133967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.134057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.134144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.134169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.134307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.134408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.134435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.134583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.134712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.134738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.134842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.134968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.134995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.135125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.135220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.135247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.135389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.135482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.135508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.135595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.135693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.135718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.135829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.135920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.135948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.136053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.136171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.136196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.136277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.136354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.136379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.136463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.136546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.136571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.136675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.136782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.136810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.136951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.137059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.137084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.750 qpair failed and we were unable to recover it. 00:30:49.750 [2024-11-18 16:17:13.137168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.750 [2024-11-18 16:17:13.137254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.137295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.137400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.137511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.137535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.137622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.137734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.137759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.137850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.137981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.138009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.138118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.138198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.138223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.138304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.138446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.138473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.138605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.138760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.138787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.138930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.139005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.139030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.139130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.139250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.139278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.139434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.139561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.139588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.139726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.139810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.139835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.139921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.140014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.140038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.140168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.140321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.140348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.140482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.140560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.140584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.140672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.140762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.140787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.140916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.141042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.141069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.141183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.141257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.141281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.141369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.141516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.141556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.141671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.141761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.141802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.141920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.142030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.142055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.142186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.142274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.142301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.142399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.142500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.142527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.142625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.142709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.142733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.142844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.142948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.142978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.143110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.143197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.143224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.143332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.143412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.143437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.751 [2024-11-18 16:17:13.143528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.143604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.751 [2024-11-18 16:17:13.143638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.751 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.143751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.143844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.143869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.143949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.144040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.144064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.144172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.144274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.144302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.144400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.144519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.144546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.144650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.144774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.144799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.144892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.144985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.145010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.145092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.145202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.145227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.145347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.145465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.145490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.145642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.145733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.145761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.145846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.145969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.145996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.146113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.146227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.146251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.146359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.146445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.146473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.146600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.146738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.146764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.146853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.146960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.146985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.147120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.147209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.147236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.147328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.147425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.147453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.147557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.147642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.147668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.147754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.147845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.147872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.148002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.148136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.148160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.148245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.148353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.148377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.148495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.148612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.148639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.148736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.148850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.148891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.149029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.149117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.149148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.149309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.149426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.149454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.149546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.149641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.149669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.149835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.149924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.149948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.150052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.150175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.150202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.752 [2024-11-18 16:17:13.150295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.150434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.752 [2024-11-18 16:17:13.150458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.752 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.150569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.150684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.150710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.150827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.150911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.150937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.151014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.151108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.151136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.151248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.151358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.151384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.151467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.151579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.151619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.151746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.151844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.151871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.151973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.152055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.152079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.152172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.152286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.152325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.152446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.152535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.152561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.152682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.152793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.152818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.152945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.153068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.153096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.153183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.153275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.153302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.153399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.153518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.153543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.153634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.153721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.153766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.153904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.154014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.154039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.154160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.154284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.154309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.154426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.154516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.154544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.154684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.154779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.154804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.154888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.154979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.155003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.155094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.155227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.155254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.155351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.155445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.155473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.155577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.155689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.155714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.155802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.155917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.155942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.156097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.156191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.156219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.156366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.156445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.753 [2024-11-18 16:17:13.156470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.753 qpair failed and we were unable to recover it. 00:30:49.753 [2024-11-18 16:17:13.156591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.156757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.156782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.156888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.157003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.157028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.157161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.157246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.157271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.157359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.157437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.157462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.157545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.157729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.157756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.157840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.157950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.157974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.158051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.158189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.158218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.158316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.158443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.158468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.158555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.158662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.158688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.158796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.158908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.158932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.159005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.159091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.159116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.159207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.159348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.159373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.159474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.159614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.159643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.159734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.159857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.159885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.160048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.160129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.160154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.160246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.160337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.160365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.160495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.160593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.160629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.160772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.160893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.160918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.160999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.161111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.161136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.161245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.161363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.161403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.161495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.161578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.161633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.161724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.161803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.161828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.161914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.161995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.162020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.162101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.162226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.162252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.162339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.162443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.162471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.162567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.162725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.162750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.162898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.163011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.163037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.163144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.163296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.163324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.754 qpair failed and we were unable to recover it. 00:30:49.754 [2024-11-18 16:17:13.163454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.754 [2024-11-18 16:17:13.163543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.163571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.163682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.163757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.163782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.163914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.164010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.164042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.164185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.164297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.164321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.164438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.164520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.164545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.164644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.164762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.164804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.164904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.165021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.165060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.165177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.165267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.165291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.165395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.165510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.165538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.165630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.165753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.165781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.165914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.166004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.166028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.166108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.166248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.166273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.166362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.166447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.166487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.166598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.166729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.166754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.166852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.166944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.166971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.167095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.167209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.167237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.167345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.167439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.167463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.167558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.167676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.167703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.167791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.167946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.167973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.168109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.168194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.168218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.168309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.168449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.168477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.168579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.168726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.168754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.168866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.172707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.172760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.172951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.173044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.173069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.173172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.173271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.173299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.173419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.173499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.173524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.755 [2024-11-18 16:17:13.173615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.173707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.755 [2024-11-18 16:17:13.173732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.755 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.173887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.174000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.174025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.174121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.174205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.174230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.174354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.174474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.174502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.174667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.174759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.174784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.174924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.175007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.175032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.175144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.175267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.175295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.175437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.175552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.175576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.175672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.175824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.175849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.175940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.176033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.176062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.176152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.176311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.176336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.176453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.176561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.176585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.176680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.176759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.176784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.176858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.176938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.176963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.177073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.177187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.177212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.177300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.177443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.177468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.177585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.177709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.177734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.177813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.177926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.177951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.178059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.178143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.178168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.178304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.178417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.178442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.178557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.178645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.178671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.178797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.178959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.178984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.179119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.179251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.179278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.179393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.179468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.179493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.179600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.179720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.179747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.179868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.179991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.180018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.180162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.180273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.180298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.180416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.180502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.180532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.756 qpair failed and we were unable to recover it. 00:30:49.756 [2024-11-18 16:17:13.180626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.180713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.756 [2024-11-18 16:17:13.180742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.180904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.181025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.181050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.181206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.181334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.181358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.181467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.181545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.181570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.181694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.181809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.181834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.181910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.181990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.182016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.182153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.182246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.182274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.182377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.182469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.182494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.182640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.182722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.182763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.182857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.182996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.183024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.183202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.183280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.183304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.183468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.183583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.183618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.183756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.183910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.183938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.184051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.184164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.184189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.184293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.184438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.184463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.184635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.184749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.184776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.184898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.185014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.185040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.185203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.185320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.185348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.185464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.185597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.185630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.185715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.185825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.185849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.186000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.186097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.186124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.186253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.186379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.186406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.186568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.186686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.186711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.186823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.186984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.187011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.187106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.187202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.187230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.187364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.187459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.187484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.187575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.187678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.187704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.187849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.187982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.188010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.188116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.188235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.188260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.188388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.188504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.757 [2024-11-18 16:17:13.188532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.757 qpair failed and we were unable to recover it. 00:30:49.757 [2024-11-18 16:17:13.188664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.188789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.188817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.188946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.189056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.189080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.189160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.189301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.189325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.189456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.189619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.189648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.189785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.189931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.189957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.190058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.190188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.190216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.190315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.190439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.190465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.190594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.190696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.190722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.190859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.190983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.191010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.191106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.191256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.191283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.191421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.191539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.191564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.191693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.191778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.191805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.191923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.192080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.192107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.192242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.192320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.192345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.192426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.192575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.192603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.192758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.192910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.192938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.193061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.193175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.193200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.193313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.193451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.193480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.193594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.193694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.193722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.193871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.194016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.194041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.194206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.194333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.194364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.194487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.194580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.194616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.194737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.194850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.194885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.194977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.195055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.195080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.195177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.195309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.195336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.195462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.195538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.195563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.195687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.195828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.195853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.195980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.196080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.196107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.758 [2024-11-18 16:17:13.196254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.196392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.758 [2024-11-18 16:17:13.196417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.758 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.196526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.196651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.196680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.196810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.196914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.196941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.197048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.197189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.197215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.197346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.197474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.197501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.197634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.197786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.197826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.197917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.198030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.198055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.198187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.198278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.198306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.198459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.198595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.198627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.198701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.198793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.198819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.198964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.199046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.199090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.199218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.199335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.199363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.199494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.199612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.199637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.199747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.199887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.199912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.200029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.200135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.200164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.200301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.200381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.200406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.200515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.200599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.200632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.200800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.200972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.200999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.201138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.201255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.201279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.201358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.201471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.201513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.201599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.201739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.201764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.201848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.201957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.201982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.202080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.202196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.202220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.202352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.202495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.202519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.202613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.202715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.202740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.202851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.202925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.202950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.203055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.203151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.203178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.203277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.203385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.203409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.203503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.203621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.203654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.203774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.203900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.203927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.204065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.204150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.204174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.204311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.204462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.204501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.204637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.204773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.204801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.204915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.205008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.205033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.205111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.205220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.205245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.759 qpair failed and we were unable to recover it. 00:30:49.759 [2024-11-18 16:17:13.205371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.205502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.759 [2024-11-18 16:17:13.205529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.205653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.205794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.205819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.205946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.206071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.206098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.206202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.206319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.206347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.206444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.206561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.206585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.206667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.206753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.206778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.206889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.207000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.207025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.207131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.207235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.207260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.207406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.207540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.207573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.207725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.207867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.207892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.207984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.208056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.208080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.208161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.208238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.208262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.208367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.208483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.208526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.208703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.208822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.208847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.209000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.209113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.209138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.209253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.209392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.209420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.209551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.209648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.209674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.209766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.209908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.209936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.210060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.210190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.210222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.210368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.210460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.210484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.210597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.210700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.210725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.210811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.210915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.210939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.211062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.211135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.211159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.211301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.211382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.211423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.211546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.211647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.211675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.211787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.211870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.211894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.211978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.212093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.212118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.212263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.212386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.212413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.212524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.212637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.212663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.212775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.212913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.212940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.760 qpair failed and we were unable to recover it. 00:30:49.760 [2024-11-18 16:17:13.213069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.760 [2024-11-18 16:17:13.213184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.213212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.213349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.213438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.213464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.213595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.213721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.213749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.213898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.214022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.214049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.214176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.214294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.214318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.214464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.214616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.214642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.214724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.214810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.214834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.214930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.215013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.215037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.215124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.215237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.215262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.215381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.215522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.215546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.215656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.215763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.215788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.215863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.216008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.216033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.216114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.216190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.216215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.216357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.216471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.216495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.216658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.216754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.216782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.216875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.217027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.217054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.217193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.217300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.217324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.217400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.217570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.217597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.217713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.217802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.217827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.217941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.218020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.218045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.218183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.218338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.218363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.218480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.218619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.218648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.218757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.218879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.218904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.219032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.219124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.219152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.219309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.219425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.219451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.219559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.219673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.219698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.219780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.219863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.219889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.220056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.220153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.220182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.220284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.220370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.220397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.220513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.220657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.220686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.220789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.220904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.220931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.221041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.221151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.221175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.221256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.221425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.221452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.221603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.221746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.221774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.761 qpair failed and we were unable to recover it. 00:30:49.761 [2024-11-18 16:17:13.221920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.761 [2024-11-18 16:17:13.221996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.222021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.222148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.222263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.222288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.222375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.222538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.222565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.222705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.222783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.222808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.222893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.223062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.223089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.223182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.223305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.223337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.223478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.223591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.223624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.223757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.223878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.223906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.224002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.224081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.224108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.224241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.224359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.224384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.224516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.224647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.224676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.224801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.224922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.224949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.225085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.225199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.225223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.225302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.225411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.225436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.225525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.225675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.225701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.225812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.225923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.225947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.226040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.226176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.226203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.226343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.226417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.226442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.226561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.226654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.226681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.226763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.226871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.226895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.226986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.227117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.227145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.227277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.227384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.227409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.227506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.227663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.227689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.227804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.227948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.227975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.228083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.228191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.228215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.228333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.228500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.228527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.228658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.228809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.228836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.228999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.229140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.229183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.229302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.229456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.229481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.762 qpair failed and we were unable to recover it. 00:30:49.762 [2024-11-18 16:17:13.229572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.762 [2024-11-18 16:17:13.229705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.229734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.229866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.229960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.229985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.230059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.230162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.230187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.230338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.230452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.230477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.230551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.230693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.230719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.230824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.230955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.230984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.231137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.231261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.231289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.231425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.231506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.231530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.231637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.231738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.231766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.231922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.232070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.232097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.232208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.232286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.232311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.232452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.232591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.232649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.232808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.232898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.232925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.233030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.233169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.233194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.233290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.233408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.233437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.233534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.233634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.233663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.233786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.233896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.233921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.234003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.234169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.234196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.234325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.234440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.234468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.234622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.234761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.234786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.234883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.235032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.235056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.235181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.235307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.235334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.235456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.235543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.235568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.235677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.235794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.235822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.235902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.236032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.236059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.236199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.236313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.236337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.236455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.236585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.236620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.236746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.236889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.236918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.237038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.237118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.237142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.237302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.237431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.237459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.237583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.237755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.237783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.237943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.238062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.238088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.238256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.238379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.238406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.238497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.238622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.238664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.763 qpair failed and we were unable to recover it. 00:30:49.763 [2024-11-18 16:17:13.238752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.238866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.763 [2024-11-18 16:17:13.238892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.239003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.239156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.239183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.239335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.239459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.239486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.239620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.239735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.239760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.239861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.239948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.239975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.240069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.240231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.240255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.240375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.240479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.240504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.240660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.240778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.240806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.240956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.241074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.241101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.241266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.241378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.241402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.241503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.241631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.241659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.241755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.241835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.241862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.241996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.242133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.242158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.242330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.242444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.242471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.242564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.242699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.242728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.242832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.242940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.242965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.243039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.243148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.243173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.243278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.243427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.243454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.243587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.243692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.243718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.243835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.243950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.243975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.244071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.244189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.244216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.244324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.244467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.244492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.244658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.244778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.244806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.244958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.245089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.245116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.245266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.245380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.245406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.245570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.245698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.245727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.245815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.245916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.245959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.246103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.246215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.246239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.246336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.246466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.246494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.246582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.246705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.246733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.246865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.246978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.247002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.247110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.247223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.247266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.247352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.247452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.247479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.247580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.247732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.247757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.247882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.248017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.248045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.248171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.248263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.764 [2024-11-18 16:17:13.248291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.764 qpair failed and we were unable to recover it. 00:30:49.764 [2024-11-18 16:17:13.248425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.248507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.248532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.248663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.248790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.248817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.248934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.249062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.249089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.249203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.249296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.249320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.249434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.249523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.249547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.249635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.249716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.249742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.249865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.249980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.250004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.250086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.250174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.250200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.250315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.250458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.250491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.250600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.250731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.250756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.250875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.250961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.250986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.251094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.251201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.251243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.251398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.251507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.251531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.251619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.251752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.251779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.251898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.251990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.252017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.252149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.252229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.252253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.252393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.252519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.252546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.252695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.252828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.252857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.252992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.253073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.253102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.253231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.253361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.253388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.253520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.253617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.253645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.253809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.253891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.253915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.254008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.254147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.254175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.254334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.254484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.254512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.254667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.254754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.254778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.254904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.254992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.255021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.255156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.255269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.255293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.255407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.255486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.255510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.255622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.255761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.255789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.255953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.256056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.256081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.765 qpair failed and we were unable to recover it. 00:30:49.765 [2024-11-18 16:17:13.256202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.765 [2024-11-18 16:17:13.256320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.256346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.256493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.256582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.256635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.256744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.256825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.256853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.257019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.257133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.257158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.257265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.257382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.257409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.257557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.257711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.257739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.257873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.257964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.257989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.258108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.258241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.258268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.258393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.258551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.258577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.258707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.258797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.258822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.258913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.259019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.259063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.259197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.259309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.259334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.259448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.259559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.259584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.259711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.259786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.259811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.259939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.260105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.260130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.260242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.260362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.260386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.260492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.260582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.260628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.260768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.260867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.260894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.261015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.261137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.261161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.261290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.261380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.261407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.261513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.261637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.261666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.261774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.261860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.261884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.262025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.262103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.262128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.766 [2024-11-18 16:17:13.262204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.262313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.766 [2024-11-18 16:17:13.262338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.766 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.262446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.262559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.262584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.262706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.262790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.262814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.262920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.263011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.263038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.263136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.263256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.263281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.263366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.263503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.263543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.263683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.263790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.263815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.263935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.264048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.264073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.264192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.264295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.264322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.264487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.264574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.264599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.264697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.264790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.264815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.264908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.265013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.265041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.265214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.265327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.265351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.265461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.265576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.265600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.265754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.265890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.265917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.266057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.266172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.266197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.266309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.266419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.266447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.266538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.266665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.266694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.266821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.266915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.266942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.267044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.267139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.267165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.267258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.267373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.267398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.267571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.267658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.267684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.267811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.267890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.267914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.268048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.268166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.268194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.268363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.268510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.268535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.268680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.268796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.268821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.268932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.269072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.269100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.269232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.269389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.269417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.269522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.269661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.269686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.767 qpair failed and we were unable to recover it. 00:30:49.767 [2024-11-18 16:17:13.269854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.767 [2024-11-18 16:17:13.269941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.269968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.270122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.270208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.270235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.270368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.270483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.270507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.270641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.270790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.270817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.270909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.271027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.271055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.271170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.271255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.271280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.271386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.271472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.271497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.271571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.271651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.271676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.271761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.271880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.271905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.272015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.272095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.272119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.272222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.272339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.272366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.272538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.272695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.272722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.272893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.273004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.273028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.273116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.273225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.273250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.273376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.273460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.273485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.273559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.273678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.273704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.273824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.273911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.273952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.274060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.274152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.274177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.274290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.274432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.274457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.274553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.274640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.274676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.274776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.274853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.274877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.274968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.275051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.275076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.275153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.275285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.275312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.275417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.275531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.275557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.275642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.275727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.275752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.275905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.275985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.276013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.276137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.276254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.276278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.276385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.276481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.276508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.768 [2024-11-18 16:17:13.276637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.276752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.768 [2024-11-18 16:17:13.276780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.768 qpair failed and we were unable to recover it. 00:30:49.769 [2024-11-18 16:17:13.276907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.276986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.277011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.769 qpair failed and we were unable to recover it. 00:30:49.769 [2024-11-18 16:17:13.277100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.277216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.277258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.769 qpair failed and we were unable to recover it. 00:30:49.769 [2024-11-18 16:17:13.277391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.277480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.277504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.769 qpair failed and we were unable to recover it. 00:30:49.769 [2024-11-18 16:17:13.277631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.277727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.277752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.769 qpair failed and we were unable to recover it. 00:30:49.769 [2024-11-18 16:17:13.277843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.277957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.277981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.769 qpair failed and we were unable to recover it. 00:30:49.769 [2024-11-18 16:17:13.278090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.278223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.278251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.769 qpair failed and we were unable to recover it. 00:30:49.769 [2024-11-18 16:17:13.278388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.278485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.278511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.769 qpair failed and we were unable to recover it. 00:30:49.769 [2024-11-18 16:17:13.278630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.278733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:49.769 [2024-11-18 16:17:13.278758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:49.769 qpair failed and we were unable to recover it. 00:30:49.769 [2024-11-18 16:17:13.278837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.278949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.278973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.279110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.279189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.279219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.279346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.279466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.279494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.279620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.279714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.279742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.279857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.279955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.279980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.280069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.280211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.280236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.280344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.280462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.280486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.280581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.280713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.280738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.280814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.280889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.280913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.280995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.281088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.281113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.281192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.281282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.281308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.281409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.281482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.281506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.281597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.281721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.281746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.281853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.281928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.281953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.282055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.282166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.282191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.282273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.282388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.060 [2024-11-18 16:17:13.282413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.060 qpair failed and we were unable to recover it. 00:30:50.060 [2024-11-18 16:17:13.282521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.282662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.282687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.282834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.282946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.282970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.283059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.283139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.283164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.283282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.283362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.283387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.283462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.283576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.283601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.283737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.283818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.283842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.283961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.284078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.284103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.284215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.284357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.284381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.284498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.284640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.284668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.284758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.284842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.284867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.284981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.285099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.285125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.285203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.285356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.285381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.285471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.285586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.285618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.285733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.285811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.285837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.286020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.286160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.286184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.286264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.286384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.286408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.286511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.286624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.286652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.286753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.286848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.286877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.287016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.287157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.287182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.287367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.287482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.287506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.287627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.287725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.287751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.287862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.287951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.287975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.288051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.288159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.288183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.288344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.288429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.288456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.288594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.288763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.288803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.061 qpair failed and we were unable to recover it. 00:30:50.061 [2024-11-18 16:17:13.288901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.061 [2024-11-18 16:17:13.288988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.289016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.289172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.289292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.289318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.289430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.289548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.289573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.289693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.289773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.289798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.289907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.290038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.290068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.290232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.290347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.290372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.290537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.290659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.290687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.290777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.290860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.290887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.291044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.291189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.291231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.291386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.291484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.291511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.291617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.291775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.291802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.292006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.292119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.292147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.292313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.292459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.292486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.292588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.292707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.292736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.292888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.293028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.293070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.293241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.293350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.293374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.293474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.293575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.293603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.293728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.293865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.293890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.294022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.294155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.294180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.294267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.294384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.294408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.294498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.294619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.294645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.294777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.294914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.294939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.295032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.295192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.295221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.062 qpair failed and we were unable to recover it. 00:30:50.062 [2024-11-18 16:17:13.295337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.295453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.062 [2024-11-18 16:17:13.295478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.295594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.295769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.295797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.295961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.296041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.296065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.296181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.296294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.296320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.296405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.296565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.296592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.296733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.296848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.296874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.296982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.297126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.297150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.297246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.297342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.297369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.297496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.297621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.297650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.297784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.297897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.297922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.298058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.298153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.298180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.298307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.298429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.298457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.298563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.298678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.298704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.298811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.298928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.298953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.299066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.299180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.299204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.299296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.299399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.299424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.299509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.299657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.299683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.299782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.299925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.299949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.300069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.300213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.300238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.300391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.300514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.300541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.300693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.300822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.300850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.300981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.301089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.301113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.301273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.301367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.301394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.301494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.301649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.301677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.301788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.301925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.301950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.302039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.302144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.063 [2024-11-18 16:17:13.302169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.063 qpair failed and we were unable to recover it. 00:30:50.063 [2024-11-18 16:17:13.302255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.302333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.302358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.302477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.302589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.302620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.302703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.302819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.302844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.302955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.303129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.303156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.303310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.303385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.303409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.303496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.303668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.303697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.303827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.303980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.304008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.304175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.304253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.304279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.304404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.304526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.304554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.304713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.304799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.304826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.304984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.305146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.305173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.305300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.305421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.305460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.305569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.305690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.305715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.305801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.305882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.305914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.305997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.306104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.306128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.306203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.306328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.306355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.306482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.306612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.306638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.306749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.306853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.306882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.306989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.307109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.307137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.307247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.307322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.307347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.307503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.307653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.307681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.064 qpair failed and we were unable to recover it. 00:30:50.064 [2024-11-18 16:17:13.307808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.064 [2024-11-18 16:17:13.307961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.307988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.308119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.308231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.308255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.308378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.308471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.308503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.308604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.308804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.308829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.308980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.309097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.309137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.309233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.309318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.309345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.309464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.309584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.309618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.309722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.309835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.309859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.310019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.310137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.310164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.310266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.310383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.310410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.310550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.310638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.310663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.310796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.310915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.310942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.311032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.311155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.311182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.311331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.311478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.311502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.311618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.311742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.311770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.311893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.312009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.312036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.312176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.312319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.312343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.312449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.312603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.312649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.312822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.312964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.312989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.313108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.313221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.313246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.313383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.313481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.313508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.313636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.313736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.313764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.313872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.313977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.314002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.314120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.314233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.314259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.065 qpair failed and we were unable to recover it. 00:30:50.065 [2024-11-18 16:17:13.314394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.314516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.065 [2024-11-18 16:17:13.314544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.314706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.314844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.314868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.314979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.315099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.315123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.315214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.315329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.315354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.315470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.315589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.315619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.315784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.315870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.315897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.316023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.316120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.316148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.316278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.316394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.316419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.316588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.316762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.316788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.316899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.317063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.317090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.317226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.317339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.317363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.317531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.317654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.317682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.317839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.317994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.318022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.318192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.318302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.318327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.318431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.318543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.318570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.318675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.318808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.318836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.318981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.319090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.319115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.319228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.319336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.319378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.319481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.319616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.319644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.319775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.319887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.319912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.320024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.320132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.320157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.320235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.320312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.320337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.320416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.320506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.320531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.320646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.320811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.320839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.320925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.321025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.066 [2024-11-18 16:17:13.321053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.066 qpair failed and we were unable to recover it. 00:30:50.066 [2024-11-18 16:17:13.321213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.321316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.321341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.321437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.321528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.321555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.321654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.321773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.321801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.321902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.322019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.322044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.322172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.322299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.322333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.322511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.322618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.322644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.322790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.322876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.322903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.323035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.323133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.323161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.323248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.323408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.323433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.323549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.323659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.323685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.323789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.323910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.323937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.324079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.324185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.324210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.324300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.324389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.324413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.324557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.324643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.324684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.324779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.324875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.324900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.325023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.325104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.325130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.325274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.325389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.325414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.325525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.325641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.325677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.325802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.325891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.325917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.326078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.326196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.326235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.326324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.326446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.326487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.326636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.326761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.326786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.326926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.327005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.327047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.327175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.327298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.327326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.327459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.327577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.327601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.067 qpair failed and we were unable to recover it. 00:30:50.067 [2024-11-18 16:17:13.327741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.067 [2024-11-18 16:17:13.327906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.327931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.328045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.328127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.328151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.328260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.328364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.328389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.328499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.328627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.328656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.328791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.328909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.328937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.329076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.329190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.329216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.329357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.329488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.329515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.329635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.329758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.329783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.329889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.330006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.330030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.330142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.330260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.330288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.330418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.330568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.330595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.330741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.330822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.330847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.330955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.331070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.331094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.331187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.331314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.331342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.331447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.331554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.331578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.331696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.331840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.331864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.332024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.332144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.332171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.332308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.332422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.332448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.332631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.332771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.332797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.332963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.333099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.333123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.333205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.333348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.333374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.333453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.333557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.333587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.333682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.333810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.333839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.333968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.334050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.334076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.334233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.334338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.334365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.334491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.334647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.334676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.334812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.334903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.334927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.335060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.335183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.335212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.068 qpair failed and we were unable to recover it. 00:30:50.068 [2024-11-18 16:17:13.335341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.068 [2024-11-18 16:17:13.335490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.335517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.335684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.335767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.335792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.335891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.336054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.336087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.336212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.336297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.336324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.336486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.336593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.336624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.336765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.336876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.336900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.337033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.337129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.337156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.337288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.337404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.337429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.337559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.337667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.337694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.337800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.337924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.337952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.338057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.338201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.338227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.338356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.338481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.338509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.338660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.338756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.338784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.338927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.339014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.339038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.339150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.339267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.339308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.339438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.339563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.339590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.339702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.339797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.339822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.339939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.340081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.340108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.340223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.340345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.340375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.340482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.340579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.340603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.340737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.340833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.340860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.340953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.341093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.341119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.341235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.341347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.341373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.341526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.341642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.341667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.341784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.341905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.341932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.342043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.342159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.342184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.342300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.342381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.342406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.342517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.342633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.342659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.069 [2024-11-18 16:17:13.342736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.342823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.069 [2024-11-18 16:17:13.342847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.069 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.342972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.343068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.343095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.343215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.343320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.343347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.343515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.343615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.343641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.343749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.343866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.343891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.344034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.344188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.344215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.344361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.344473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.344497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.344585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.344745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.344773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.344928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.345041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.345068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.345229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.345347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.345371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.345472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.345566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.345594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.345701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.345829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.345856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.346000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.346112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.346136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.346263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.346389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.346416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.346507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.346604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.346652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.346765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.346887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.346912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.347049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.347199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.347227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.347325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.347441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.347468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.347587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.347673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.347698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.347776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.347892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.347917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.348002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.348088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.348113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.348199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.348307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.348331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.348415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.348497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.348522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.348662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.348831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.348856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.348969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.349087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.349111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.070 qpair failed and we were unable to recover it. 00:30:50.070 [2024-11-18 16:17:13.349270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.349365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.070 [2024-11-18 16:17:13.349399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.349509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.349637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.349665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.349823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.349961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.349985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.350133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.350254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.350282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.350407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.350557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.350584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.350704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.350824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.350849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.350955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.351111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.351138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.351264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.351355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.351384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.351552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.351671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.351697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.351810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.351914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.351938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.352076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.352194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.352225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.352384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.352506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.352530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.352623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.352753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.352781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.352878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.352963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.352990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.353145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.353261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.353285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.353419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.353515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.353542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.353662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.353789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.353818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.353976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.354082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.354106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.354241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.354367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.354394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.354547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.354699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.354727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.354835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.354916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.354941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.355032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.355123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.355148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.355258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.355420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.355448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.355590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.355685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.355710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.355840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.355957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.355985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.356099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.356221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.356249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.356348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.356466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.356490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.356596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.356753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.356782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.356902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.357016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.357043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.071 qpair failed and we were unable to recover it. 00:30:50.071 [2024-11-18 16:17:13.357154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.071 [2024-11-18 16:17:13.357233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.357258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.357369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.357444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.357468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.357587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.357700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.357728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.357854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.357968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.357993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.358071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.358185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.358209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.358293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.358427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.358454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.358565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.358680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.358705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.358806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.358914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.358939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.359046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.359136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.359160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.359253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.359340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.359364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.359473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.359623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.359651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.359775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.359875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.359902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.360065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.360193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.360218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.360300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.360385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.360410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.360556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.360709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.360737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.360874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.361012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.361037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.361127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.361262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.361289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.361431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.361542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.361567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.361663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.361742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.361766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.361850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.361934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.361959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.362128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.362241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.362268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.362413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.362489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.362514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.362658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.362777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.362804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.362915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.363033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.363061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.072 [2024-11-18 16:17:13.363193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.363308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.072 [2024-11-18 16:17:13.363334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.072 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.363434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.363549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.363577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.363724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.363857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.363885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.364034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.364153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.364178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.364312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.364482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.364507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.364619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.364707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.364732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.364844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.364930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.364954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.365044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.365151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.365190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.365343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.365510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.365541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.365649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.365762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.365788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.365888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.365986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.366015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.366180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.366268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.366294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.366385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.366501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.366526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.366673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.366794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.366821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.366936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.367050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.367077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.367213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.367335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.367360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.367458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.367568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.367592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.367712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.367833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.367860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.367964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.368080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.368105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.368187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.368349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.368377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.368531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.368639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.368667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.368827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.368913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.368938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.369091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.369192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.369219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.369345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.369465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.369492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.369623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.369713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.369738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.369838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.369991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.370016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.370147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.370249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.370277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.370390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.370466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.370492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.073 [2024-11-18 16:17:13.370629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.370722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.073 [2024-11-18 16:17:13.370750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.073 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.370883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.371017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.371044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.371170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.371313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.371337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.371469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.371623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.371652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.371805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.371895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.371922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.372049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.372137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.372162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.372270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.372410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.372435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.372562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.372670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.372699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.372835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.372979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.373003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.373122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.373248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.373276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.373404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.373494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.373521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.373650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.373769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.373794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.373874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.373989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.374013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.374119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.374234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.374262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.374392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.374535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.374560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.374673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.374750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.374793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.374916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.375040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.375067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.375180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.375267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.375293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.375433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.375570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.375597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.375700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.375861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.375886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.376004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.376156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.376180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.376359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.376455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.376480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.376617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.376749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.376778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.376915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.377004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.377030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.377151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.377269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.377295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.377395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.377520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.377547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.377681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.377797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.377821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.377925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.378043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.378070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.378202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.378355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.378382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.074 qpair failed and we were unable to recover it. 00:30:50.074 [2024-11-18 16:17:13.378485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.074 [2024-11-18 16:17:13.378565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.378590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.378741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.378853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.378878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.378984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.379076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.379108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.379246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.379353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.379378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.379505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.379615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.379642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.379775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.379916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.379942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.380085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.380178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.380203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.380311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.380417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.380457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.380543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.380645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.380674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.380813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.380948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.380973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.381085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.381210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.381237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.381361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.381475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.381503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.381619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.381706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.381731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.381814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.381956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.381997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.382125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.382209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.382236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.382375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.382514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.382539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.382628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.382789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.382814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.382958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.383051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.383078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.383194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.383273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.383297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.383384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.383503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.383527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.383664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.383790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.383817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.383955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.384069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.384095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.384236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.384362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.384390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.384512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.384651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.384676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.384804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.384883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.384908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.385040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.385162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.385190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.385347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.385459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.385487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.385594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.385698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.385723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.385868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.385953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.075 [2024-11-18 16:17:13.385994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.075 qpair failed and we were unable to recover it. 00:30:50.075 [2024-11-18 16:17:13.386109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.386222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.386249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.386383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.386463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.386489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.386614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.386726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.386750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.386892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.387010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.387037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.387149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.387239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.387263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.387387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.387529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.387554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.387695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.387820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.387848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.387986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.388099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.388123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.388243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.388390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.388417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.388508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.388661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.388689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.388832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.388944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.388968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.389084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.389220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.389247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.389414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.389533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.389557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.389641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.389764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.389789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.389917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.390050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.390075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.390206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.390364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.390392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.390547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.390661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.390686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.390828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.390950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.390977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.391072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.391192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.391219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.391333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.391439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.391463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.391579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.391722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.391750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.391952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.392090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.392118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.392236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.392377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.392401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.392494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.392639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.392668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.392796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.392949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.392981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.393085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.393192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.393216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.393338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.393429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.393457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.393583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.393752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.393780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.076 [2024-11-18 16:17:13.393931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.394014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.076 [2024-11-18 16:17:13.394038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.076 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.394128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.394243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.394268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.394415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.394570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.394598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.394804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.394920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.394960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.395048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.395174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.395201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.395292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.395407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.395435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.395635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.395776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.395816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.395942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.396113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.396137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.396281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.396411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.396439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.396576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.396715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.396742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.396880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.396984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.397013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.397141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.397233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.397261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.397375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.397485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.397509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.397658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.397827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.397853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.397962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.398079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.398104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.398218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.398329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.398353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.398483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.398616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.398644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.398777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.398868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.398895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.398998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.399111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.399135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.399221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.399334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.399362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.399564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.399722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.399750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.399946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.400060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.400084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.400184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.400285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.400313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.400413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.400564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.400591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.400724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.400812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.400836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.077 [2024-11-18 16:17:13.400974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.401060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.077 [2024-11-18 16:17:13.401100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.077 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.401261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.401384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.401411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.401558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.401649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.401674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.401806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.401894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.401922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.402073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.402193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.402220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.402378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.402488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.402513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.402624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.402747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.402775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.402903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.403031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.403058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.403168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.403254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.403279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.403409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.403533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.403562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.403671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.403788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.403815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.403979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.404091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.404115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.404224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.404323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.404352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.404461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.404630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.404656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.404769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.404859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.404885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.404973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.405165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.405190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.405280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.405431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.405457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.405550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.405664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.405690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.405801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.405950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.405977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.406127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.406249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.406277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.406391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.406540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.406564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.406688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.406781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.406808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.406932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.407052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.407086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.407211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.407324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.407348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.407434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.407549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.407574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.407664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.407806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.407848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.407941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.408055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.408080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.408170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.408275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.408302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.408427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.408520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.408547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.078 qpair failed and we were unable to recover it. 00:30:50.078 [2024-11-18 16:17:13.408663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.078 [2024-11-18 16:17:13.408759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.408786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.408864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.408943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.408968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.409075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.409165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.409193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.409296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.409419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.409448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.409552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.409675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.409704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.409814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.409932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.409957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.410072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.410187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.410211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.410306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.410423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.410465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.410589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.410693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.410721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.410857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.410943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.410967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.411044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.411186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.411213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.411307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.411419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.411443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.411586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.411708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.411733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.411902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.412025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.412053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.412152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.412255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.412279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.412428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.412511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.412535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.412660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.412752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.412779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.412905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.412998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.413026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.413179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.413256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.413281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.413391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.413508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.413536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.413638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.413726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.413754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.413853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.413941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.413965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.414074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.414243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.414271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.414396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.414530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.414557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.414704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.414821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.414846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.414953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.415098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.415126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.415225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.415322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.415350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.415492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.415601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.415631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.415727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.415821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.079 [2024-11-18 16:17:13.415848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.079 qpair failed and we were unable to recover it. 00:30:50.079 [2024-11-18 16:17:13.415979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.416106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.416133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.416236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.416319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.416344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.416417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.416554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.416582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.416736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.416861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.416912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.417035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.417127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.417153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.417294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.417415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.417452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.417574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.417680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.417709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.417835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.417926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.417950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.418040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.418124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.418150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.418269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.418374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.418402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.418535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.418634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.418660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.418768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.418860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.418888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.419010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.419123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.419150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.419247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.419350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.419375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.419453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.419584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.419631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.419755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.419864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.419892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.420028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.420116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.420140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.420224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.420342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.420383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.420482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.420634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.420663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.420767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.420845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.420870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.420979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.421078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.421105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.421241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.421379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.421403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.421516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.421593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.421624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.421708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.421784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.421809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.421973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.422101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.422128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.422232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.422312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.422340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.422472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.422592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.422651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.422797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.422916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.422940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.080 [2024-11-18 16:17:13.423034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.423142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.080 [2024-11-18 16:17:13.423166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.080 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.423273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.423403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.423430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.423531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.423620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.423648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.423789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.423877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.423903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.424064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.424164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.424191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.424330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.424416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.424440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.424556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.424670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.424696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.424777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.424904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.424932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.425027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.425166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.425190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.425269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.425349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.425373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.425512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.425589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.425620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.425708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.425816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.425844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.425945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.426026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.426051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.426167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.426275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.426303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.426434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.426547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.426572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.426670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.426774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.426799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.426889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.426978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.427005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.427100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.427188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.427215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.427346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.427461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.427485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.427564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.427654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.427679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.427771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.427879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.427903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.427990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.428105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.428130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.428211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.428290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.428315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.428401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.428508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.428549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.428663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.428750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.428776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.428858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.428977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.429001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.429156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.429243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.429271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.429408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.429490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.429515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.429635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.429740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.429768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.081 qpair failed and we were unable to recover it. 00:30:50.081 [2024-11-18 16:17:13.429868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.429984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.081 [2024-11-18 16:17:13.430011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.430125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.430238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.430263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.430364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.430485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.430513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.430604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.430705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.430733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.430835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.430930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.430955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.431070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.431147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.431171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.431258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.431333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.431358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.431444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.431518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.431542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.431653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.431736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.431760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.431864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.431950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.431977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.432113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.432204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.432229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.432363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.432485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.432514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.432619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.432711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.432738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.432882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.432963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.432988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.433092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.433212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.433240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.433362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.433483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.433512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.433633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.433724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.433749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.433870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.433946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.433987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.434089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.434215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.434244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.434352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.434435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.434464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.434543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.434646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.434674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.434815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.434900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.434927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.435022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.435105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.435130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.435212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.435324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.435349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.435449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.435570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.435599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.082 qpair failed and we were unable to recover it. 00:30:50.082 [2024-11-18 16:17:13.435744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.082 [2024-11-18 16:17:13.435828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.435853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.435944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.436086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.436114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.436204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.436299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.436326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.436434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.436546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.436571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.436665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.436749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.436778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.436869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.436978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.437002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.437093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.437216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.437240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.437331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.437438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.437465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.437553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.437652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.437680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.437816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.437909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.437934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.438020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.438098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.438122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.438251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.438339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.438366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.438468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.438584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.438617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.438743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.438837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.438864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.438993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.439123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.439150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.439275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.439361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.439386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.439510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.439622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.439652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.439746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.439842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.439872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.439983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.440066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.440091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.440171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.440300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.440327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.440424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.440539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.440567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.440707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.440829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.440854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.440960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.441051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.441079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.441169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.441260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.441287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.441401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.441551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.441575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.441739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.441851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.441875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.441960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.442072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.442101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.442202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.442293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.442317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.083 qpair failed and we were unable to recover it. 00:30:50.083 [2024-11-18 16:17:13.442443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.083 [2024-11-18 16:17:13.442579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.442613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.442747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.442856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.442881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.442995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.443085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.443110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.443197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.443284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.443310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.443395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.443476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.443502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.443582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.443673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.443700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.443822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.443978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.444003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.444093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.444177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.444203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.444286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.444430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.444455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.444582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.444711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.444740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.444828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.444950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.444977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.445115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.445229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.445254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.445390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.445518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.445546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.445674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.445772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.445799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.445931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.446035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.446059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.446165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.446282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.446306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.446395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.446497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.446524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.446640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.446755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.446787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.446877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.446990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.447018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.447112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.447230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.447258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.447361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.447503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.447528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.447635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.447726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.447751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.447835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.447955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.447980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.448123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.448233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.448258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.448359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.448536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.448563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.448710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.448802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.448830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.448939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.449056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.449081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.449193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.449316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.449348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.449479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.449566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.084 [2024-11-18 16:17:13.449594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.084 qpair failed and we were unable to recover it. 00:30:50.084 [2024-11-18 16:17:13.449716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.449850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.449874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.449957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.450073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.450100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.450227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.450315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.450342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.450454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.450529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.450553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.450637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.450722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.450746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.450860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.450938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.450978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.451096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.451212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.451237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.451321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.451448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.451476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.451616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.451700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.451725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.451816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.451900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.451925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.452056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.452177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.452205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.452335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.452516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.452541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.452653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.452729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.452754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.452905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.453033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.453060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.453148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.453235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.453262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.453424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.453538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.453563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.453685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.453779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.453807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.453961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.454057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.454084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.454256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.454378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.454402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.454494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.454583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.454615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.454710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.454846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.454874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.455016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.455135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.455159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.455239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.455400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.455428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.455545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.455669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.455698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.455803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.455884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.455909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.456043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.456149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.456174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.456321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.456426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.456454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.456591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.456735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.456760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.085 qpair failed and we were unable to recover it. 00:30:50.085 [2024-11-18 16:17:13.456867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.456988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.085 [2024-11-18 16:17:13.457015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.457105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.457203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.457231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.457364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.457452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.457477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.457581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.457714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.457743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.457896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.457988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.458015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.458121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.458245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.458270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.458408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.458539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.458566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.458698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.458824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.458851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.458951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.459038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.459062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.459192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.459289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.459316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.459468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.459570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.459595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.459690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.459778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.459803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.459919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.460048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.460072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.460156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.460236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.460280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.460447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.460533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.460557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.460640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.460763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.460787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.460878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.460992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.461016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.461134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.461220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.461245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.461349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.461469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.461497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.461616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.461738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.461765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.461852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.461976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.462001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.462134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.462255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.462286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.462420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.462513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.462541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.462681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.462771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.462797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.462887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.463014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.463043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.086 [2024-11-18 16:17:13.463187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.463271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.086 [2024-11-18 16:17:13.463297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.086 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.463416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.463506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.463531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.463665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.463755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.463783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.463904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.464029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.464058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.464169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.464248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.464273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.464408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.464535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.464562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.464689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.464794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.464822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.464925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.465061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.465086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.465203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.465299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.465324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.465463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.465583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.465619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.465715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.465812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.465839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.465929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.466027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.466054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.466155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.466263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.466288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.466375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.466516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.466544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.466637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.466764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.466791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.466915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.467034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.467062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.467202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.467286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.467310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.467410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.467525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.467549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.467675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.467764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.467791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.467890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.467985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.468012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.468146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.468228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.468252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.468366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.468448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.468473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.468590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.468707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.468735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.468861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.468986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.469013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.469115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.469223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.469248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.469331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.469459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.469487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.469583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.469688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.469717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.469840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.469928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.469956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.470095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.470183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.470207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.087 qpair failed and we were unable to recover it. 00:30:50.087 [2024-11-18 16:17:13.470298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.087 [2024-11-18 16:17:13.470379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.470403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.470515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.470653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.470681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.470831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.470923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.470964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.471080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.471159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.471184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.471302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.471410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.471437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.471520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.471619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.471647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.471750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.471836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.471862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.471967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.472055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.472081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.472204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.472349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.472377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.472467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.472628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.472657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.472800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.472897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.472925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.473062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.473154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.473179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.473256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.473363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.473387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.473525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.473667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.473694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.473779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.473860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.473884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.473999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.474086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.474109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.474197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.474359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.474386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.474483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.474584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.474620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.474709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.474831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.474865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.474970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.475084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.475109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.475240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.475327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.475355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.475480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.475602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.475638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.475769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.475872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.475901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.476031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.476114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.476138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.476236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.476324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.476366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.476454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.476559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.476584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.476696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.476831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.476863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.477017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.477110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.477140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.477269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.477410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.088 [2024-11-18 16:17:13.477449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.088 qpair failed and we were unable to recover it. 00:30:50.088 [2024-11-18 16:17:13.477575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.477733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.477763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.477926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.478090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.478122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.478288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.478389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.478418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.478580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.478703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.478733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.478876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.478995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.479027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.479167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.479276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.479309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.479447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.479547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.479576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.479637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x160f980 (9): Bad file descriptor 00:30:50.089 [2024-11-18 16:17:13.479809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.479983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.480014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.480155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.480264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.480294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.480409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.480534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.480560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.480685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.480781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.480807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.480901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.481019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.481044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.481161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.481274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.481300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.481396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.481477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.481502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.481643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.481761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.481786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.481905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.482004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.482031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.482177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.482315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.482344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.482469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.482626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.482670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.482798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.482892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.482917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.483020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.483195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.483229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.483352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.483457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.483486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.483621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.483746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.483772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.483874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.483958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.483983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.484102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.484248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.484276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.484412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.484531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.484558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.484655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.484741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.484766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.484856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.484967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.484992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.089 [2024-11-18 16:17:13.485085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.485172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.089 [2024-11-18 16:17:13.485198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.089 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.485285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.485380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.485405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.485497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.485577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.485636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.485741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.485834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.485860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.485969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.486053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.486079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.486175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.486323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.486352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.486521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.486637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.486664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.486747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.486841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.486866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.486979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.487081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.487110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.487250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.487335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.487360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.487519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.487666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.487693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.487775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.487866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.487891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.488016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.488136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.488165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.488282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.488405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.488446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.488539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.488673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.488698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.488783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.488897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.488922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.489002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.489124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.489154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.489290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.489403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.489427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.489507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.489595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.489630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.489740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.489875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.489904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.489992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.490099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.490139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.490281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.490368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.490393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.490484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.490633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.490667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.490825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.490975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.491003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.491148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.491269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.491293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.491412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.491501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.491526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.491685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.491819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.491847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.491964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.492080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.492105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.492191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.492287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.492328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.090 qpair failed and we were unable to recover it. 00:30:50.090 [2024-11-18 16:17:13.492425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.090 [2024-11-18 16:17:13.492546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.492588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.492771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.492893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.492918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.493036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.493152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.493178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.493294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.493412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.493442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.493596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.493689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.493715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.493805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.493897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.493951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.494105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.494249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.494274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.494364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.494449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.494476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.494563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.494742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.494783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.494921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.495016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.495045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.495210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.495299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.495324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.495452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.495555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.495582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.495695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.495849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.495877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.496019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.496161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.496187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.496307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.496487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.496516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.496635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.496761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.496789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.496905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.497032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.497057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.497188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.497296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.497324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.497458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.497571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.497598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.497714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.497816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.497841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.497971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.498105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.498145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.498279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.498387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.498411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.498501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.498583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.498614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.498695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.498811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.498835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.498967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.499061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.091 [2024-11-18 16:17:13.499101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.091 qpair failed and we were unable to recover it. 00:30:50.091 [2024-11-18 16:17:13.499222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.499342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.499367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.499456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.499566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.499590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.499716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.499851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.499880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.499992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.500112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.500136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.500286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.500410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.500449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.500551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.500677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.500705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.500854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.500940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.500966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.501055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.501166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.501194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.501291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.501390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.501417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.501525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.501613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.501639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.501760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.501844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.501869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.501988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.502104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.502132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.502301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.502406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.502431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.502536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.502694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.502724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.502850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.502974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.503003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.503152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.503230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.503254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.503368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.503465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.503493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.503685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.503777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.503801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.503919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.504019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.504045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.504168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.504324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.504352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.504463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.504578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.504603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.504747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.504837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.504863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.504993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.505109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.505137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.505242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.505369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.505397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.505530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.505633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.505659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.505775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.505885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.505909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.506014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.506132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.506158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.506278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.506393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.506417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.092 qpair failed and we were unable to recover it. 00:30:50.092 [2024-11-18 16:17:13.506548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.092 [2024-11-18 16:17:13.506746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.506779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.506930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.507056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.507090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.507247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.507401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.507430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.507584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.507733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.507767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.507891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.508058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.508090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.508220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.508323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.508352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.508487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.508593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.508634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.508789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.508907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.508941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.509087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.509210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.509239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.509414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.509502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.509532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.509642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.509786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.509819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.509960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.510086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.510116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.510229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.510372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.510418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.510562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.510684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.510722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.510885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.511005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.511034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.511163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.511266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.511303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.511432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.511576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.511616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.511781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.511906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.511935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.512101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.512239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.512271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.512393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.512500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.512532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.512693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.512813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.512842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.513002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.513138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.513172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.513356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.513466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.513497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.513647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.513775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.513805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.513918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.514089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.514118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.514235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.514376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.514406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.514526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.514647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.514674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.514762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.514856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.514881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.093 [2024-11-18 16:17:13.514990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.515104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.093 [2024-11-18 16:17:13.515130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.093 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.515263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.515358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.515384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.515513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.515645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.515674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.515796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.515933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.515960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.516072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.516186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.516212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.516329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.516479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.516507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.516659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.516791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.516820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.516958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.517049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.517074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.517204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.517300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.517329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.517459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.517593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.517629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.517726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.517837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.517863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.517951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.518062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.518087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.518168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.518248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.518305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.518448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.518565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.518590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.518764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.518857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.518885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.518989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.519142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.519169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.519281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.519360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.519385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.519520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.519648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.519678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.519772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.519910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.519938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.520070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.520188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.520213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.520343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.520465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.520494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.520582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.520706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.520735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.520849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.520997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.521021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.521148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.521294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.521318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.521439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.521526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.521551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.521658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.521741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.521767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.521879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.521971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.521997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.522084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.522183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.522210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.522338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.522420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.522445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.094 qpair failed and we were unable to recover it. 00:30:50.094 [2024-11-18 16:17:13.522592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.094 [2024-11-18 16:17:13.522694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.522722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.522851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.522951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.522978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.523091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.523176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.523201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.523292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.523405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.523432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.523576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.523748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.523776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.523910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.524001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.524026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.524154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.524310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.524340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.524441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.524556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.524584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.524740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.524863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.524888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.525014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.525134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.525163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.525260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.525363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.525392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.525509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.525627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.525654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.525740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.525878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.525907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.526055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.526180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.526209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.526319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.526406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.526437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.526534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.526631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.526656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.526752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.526866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.526891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.526983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.527062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.527088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.527186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.527266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.527291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.527427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.527520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.527547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.527689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.527780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.527806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.527904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.528016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.528049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.528192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.528312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.528340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.528472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.528558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.528585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.528738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.528886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.528927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.529107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.529218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.529251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.095 qpair failed and we were unable to recover it. 00:30:50.095 [2024-11-18 16:17:13.529402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.529530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.095 [2024-11-18 16:17:13.529560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.529718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.529875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.529905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.530044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.530148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.530197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.530354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.530455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.530485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.530621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.530765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.530794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.530919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.531050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.531078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.531193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.531286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.531327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.531443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.531524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.531550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.531660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.531765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.531797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.531915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.531995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.532020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.532101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.532212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.532237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.532328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.532495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.532524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.532673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.532760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.532785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.532900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.533070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.533112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.533237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.533328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.533353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.533442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.533560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.533585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.533690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.533784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.533811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.533929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.534040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.534071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.534222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.534336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.534367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.534455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.534530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.534555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.534662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.534751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.534776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.534895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.534976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.535001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.535110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.535232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.535260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.535386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.535484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.535511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.535633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.535722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.535747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.535861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.535939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.535964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.536075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.536151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.536175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.096 [2024-11-18 16:17:13.536260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.536363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.096 [2024-11-18 16:17:13.536388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.096 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.536498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.536581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.536612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.536709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.536796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.536821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.536916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.537036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.537060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.537193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.537314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.537341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.537467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.537558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.537585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.537707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.537787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.537811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.537900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.537996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.538023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.538193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.538306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.538331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.538450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.538530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.538555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.538642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.538757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.538783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.538893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.539042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.539067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.539182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.539264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.539290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.539424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.539554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.539582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.539698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.539811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.539838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.539927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.540013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.540037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.540192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.540329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.540357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.540448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.540546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.540575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.540702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.540790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.540815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.540902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.541010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.541037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.541195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.541322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.541349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.541462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.541571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.541595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.541720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.541833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.541866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.541979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.542148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.542180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.542322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.542442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.542471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.542597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.542723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.542753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.542865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.542999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.543032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.543140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.543233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.543258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.543348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.543427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.543452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.097 qpair failed and we were unable to recover it. 00:30:50.097 [2024-11-18 16:17:13.543595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.097 [2024-11-18 16:17:13.543691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.543716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.543827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.543915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.543940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.544049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.544141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.544168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.544266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.544399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.544427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.544531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.544631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.544657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.544755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.544834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.544858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.544959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.545082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.545109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.545215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.545324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.545348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.545424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.545534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.545559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.545695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.545808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.545833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.545919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.546008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.546032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.546151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.546240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.546281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.546368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.546517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.546545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.546658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.546740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.546771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.546882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.546998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.547041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.547163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.547247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.547275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.547413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.547534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.547558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.547772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.547861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.547885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.547994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.548089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.548116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.548240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.548324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.548348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.548434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.548540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.548568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.548700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.548782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.548807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.548900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.548980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.549004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.549081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.549183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.549215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.549322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.549411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.549454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.549542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.549630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.549655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.549739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.549843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.549868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.549964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.550092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.550119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.550262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.550379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.098 [2024-11-18 16:17:13.550404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.098 qpair failed and we were unable to recover it. 00:30:50.098 [2024-11-18 16:17:13.550492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.550652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.550677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.550801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.550915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.550939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.551065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.551181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.551207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.551339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.551433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.551460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.551593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.551716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.551742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.551866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.551982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.552006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.552090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.552178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.552203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.552309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.552397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.552424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.552571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.552671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.552696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.552783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.552893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.552916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.552991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.553103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.553129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.553214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.553296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.553321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.553448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.553570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.553597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.553721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.553808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.553833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.553924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.554012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.554036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.554151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.554229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.554253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.554329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.554444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.554468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.554617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.554731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.554756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.554842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.554979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.555006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.555104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.555192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.555218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.555359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.555439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.555463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.555580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.555675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.555700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.555783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.555871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.555915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.556016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.556122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.556146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.556232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.556370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.556398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.556551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.556666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.556692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.556788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.556903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.556927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.557048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.557159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.557183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.099 qpair failed and we were unable to recover it. 00:30:50.099 [2024-11-18 16:17:13.557260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.557396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.099 [2024-11-18 16:17:13.557424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.557535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.557620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.557645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.557807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.557905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.557932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.558057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.558188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.558230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.558320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.558433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.558458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.558553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.558658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.558682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.558777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.558861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.558901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.559014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.559119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.559144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.559250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.559366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.559389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.559518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.559602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.559634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.559763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.559848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.559872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.559965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.560099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.560126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.560266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.560352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.560376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.560487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.560637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.560662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.560801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.560970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.560997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.561126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.561276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.561303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.561418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.561550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.561574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.561674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.561820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.561849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.561939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.562096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.562123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.562214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.562298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.562323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.562444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.562570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.562599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.562783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.562882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.562910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.563054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.563169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.563193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.563278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.563381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.563408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.563501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.563619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.563647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.563778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.563856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.563880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.563958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.564069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.564097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.100 qpair failed and we were unable to recover it. 00:30:50.100 [2024-11-18 16:17:13.564199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.100 [2024-11-18 16:17:13.564318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.564346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.564498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.564589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.564632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.564735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.564855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.564882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.565012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.565140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.565168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.565277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.565370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.565396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.565510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.565596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.565629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.565735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.565827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.565852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.565941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.566031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.566056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.566163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.566316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.566341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.566506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.566618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.566643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.566758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.566835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.566859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.566958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.567036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.567060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.567141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.567248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.567276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.567382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.567500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.567525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.567618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.567759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.567783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.567915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.568030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.568057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.568161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.568274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.568298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.568448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.568541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.568569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.568691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.568788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.568816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.568951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.569043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.569069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.569199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.569283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.569310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.569438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.569562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.569590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.569710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.569796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.569820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.569929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.570038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.570061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.570139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.570243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.570268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.570391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.570479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.570503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.570587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.570678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.570702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.570857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.570940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.570967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.571080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.571225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.571249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.571356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.571476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.571504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.571594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.571734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.571762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.101 qpair failed and we were unable to recover it. 00:30:50.101 [2024-11-18 16:17:13.571903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.101 [2024-11-18 16:17:13.571995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.572020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.572119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.572214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.572241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.572391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.572536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.572564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.572735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.572825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.572849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.572957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.573049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.573076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.573207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.573305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.573330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.573413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.573495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.573519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.573630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.573736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.573763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.573898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.573986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.574012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.574102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.574210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.574235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.574317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.574398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.574428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.574517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.574652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.574680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.574823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.574908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.574932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.575093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.575209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.575250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.575336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.575450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.575474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.575620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.575711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.575735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.575926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.576014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.576041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.576140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.576239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.576266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.576362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.576450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.576475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.576568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.576673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.576698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.576839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.576982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.577006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.577122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.577215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.577240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.577320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.577423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.577447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.577537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.577662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.577687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.577794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.577909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.577932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.578063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.578148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.578175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.578274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.578373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.578400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.578499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.578610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.578635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.578729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.578836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.578862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.578983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.579100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.579127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.102 [2024-11-18 16:17:13.579259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.579381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.102 [2024-11-18 16:17:13.579405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.102 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.579516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.579670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.579697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.579790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.579910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.579955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.580041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.580133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.580157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.580266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.580377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.580401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.580513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.580589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.580619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.580731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.580834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.580860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.580961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.581195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.581223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.581351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.581453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.581480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.581584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.581730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.581755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.581870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.581998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.582042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.582180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.582335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.582371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.582545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.582656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.582686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.582826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.582965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.582998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.583141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.583270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.583297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.583401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.583479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.583504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.583616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.583745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.583772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.583899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.583993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.584021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.584153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.584306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.584347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.584437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.584529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.584557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.584661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.584792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.584817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.584908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.584995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.585021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.585097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.585203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.585227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.585336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.585412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.585454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.585558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.585657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.585682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.585781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.585916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.585940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.586072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.586221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.586249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.586397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.586488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.586513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.586630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.586711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.586751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.586874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.586974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.587001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.587110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.587206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.587231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.587312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.587448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.587480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.587615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.587785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.587810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.587889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.588006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.588031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.103 qpair failed and we were unable to recover it. 00:30:50.103 [2024-11-18 16:17:13.588116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.103 [2024-11-18 16:17:13.588230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.588255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.588366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.588485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.588512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.588641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.588755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.588780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.588918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.589001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.589029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.589195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.589313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.589340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.589447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.589565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.589589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.589732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.589854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.589881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.589976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.590072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.590105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.590260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.590342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.590367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.590472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.590572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.590599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.590708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.590799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.590826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.590961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.591072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.591096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.591175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.591316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.591344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.591435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.591562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.591589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.591777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.591863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.591889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.592032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.592136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.592161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.592278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.592418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.592446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.592528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.592642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.592686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.592763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.592869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.592895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.593056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.593151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.593187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.593290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.593415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.593443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.593553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.593662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.593688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.593778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.593868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.593909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.594030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.594130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.594158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.594285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.594408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.594436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.594571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.594670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.594697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.594808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.594897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.594924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.595007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.595154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.595179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.595280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.595414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.595442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.104 [2024-11-18 16:17:13.595556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.595648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.104 [2024-11-18 16:17:13.595675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.104 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.595765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.595873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.595915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.596055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.596144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.596186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.596266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.596380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.596404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.596568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.596726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.596751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.596852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.596951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.596978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.597095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.597179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.597202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.597292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.597421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.597448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.597605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.597755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.597780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.597894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.597986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.598010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.598102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.598178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.598202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.598320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.598403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.598428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.598538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.598628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.598654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.598770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.598855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.598880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.598971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.599050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.599073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.599186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.599261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.599284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.599373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.599488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.599511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.599635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.599747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.599772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.599852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.599928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.599953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.600033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.600138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.600165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.600272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.600362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.600389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.600490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.600600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.600629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.600712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.600792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.600816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.600988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.601082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.601109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.601214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.601292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.601316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.601394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.601494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.601520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.601620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.601753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.601778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.601865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.601983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.602007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.602116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.602200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.602225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.602325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.602451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.602482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.602588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.602710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.602735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.602891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.602987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.603029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.603141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.603235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.603260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.603370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.603491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.603516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.105 qpair failed and we were unable to recover it. 00:30:50.105 [2024-11-18 16:17:13.603604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.105 [2024-11-18 16:17:13.603721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.603745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.603859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.603967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.603991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.604071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.604190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.604213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.604329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.604445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.604472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.604630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.604743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.604767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.604885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.604977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.605002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.605113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.605245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.605272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.605401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.605527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.605554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.605680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.605798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.605823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.605922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.606037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.606063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.606191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.606283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.606311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.606466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.606596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.606627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.606748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.606834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.606858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.606988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.607123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.607147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.607231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.607346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.607370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.607455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.607532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.607556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.607646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.607728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.607752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.607879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.607966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.607991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.608126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.608286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.608313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.608441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.608536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.608563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.608697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.608809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.608833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.608928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.609080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.609106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.609203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.609316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.609343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.609457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.609597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.609629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.609723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.609831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.609855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.609967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.610078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.610105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.610217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.610298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.610323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.610406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.610554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.610579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.610704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.610843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.610868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.610952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.611064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.611087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.611169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.611255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.611279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.611361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.611466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.611493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.611625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.611737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.611763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.106 [2024-11-18 16:17:13.611845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.612001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.106 [2024-11-18 16:17:13.612028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.106 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.612129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.612225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.612252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.612357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.612438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.612462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.612568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.612737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.612762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.612911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.613027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.613053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.613202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.613294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.613318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.613450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.613537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.613564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.613693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.613810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.613835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.613926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.614018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.614042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.614129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.614240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.614281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.614374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.614466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.614494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.614601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.614712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.614737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.614826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.614938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.614963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.615054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.615144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.615172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.615257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.615344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.615367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.615449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.615592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.615628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.615775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.615859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.615884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.615979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.616057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.616081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.616196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.616279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.616304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.616391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.616472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.616496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.107 [2024-11-18 16:17:13.616576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.616693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.107 [2024-11-18 16:17:13.616719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.107 qpair failed and we were unable to recover it. 00:30:50.108 [2024-11-18 16:17:13.616809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.108 [2024-11-18 16:17:13.616952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.108 [2024-11-18 16:17:13.616976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.108 qpair failed and we were unable to recover it. 00:30:50.108 [2024-11-18 16:17:13.617068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.108 [2024-11-18 16:17:13.617214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.108 [2024-11-18 16:17:13.617238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.108 qpair failed and we were unable to recover it. 00:30:50.108 [2024-11-18 16:17:13.617354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.108 [2024-11-18 16:17:13.617439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.108 [2024-11-18 16:17:13.617464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.108 qpair failed and we were unable to recover it. 00:30:50.108 [2024-11-18 16:17:13.617575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.108 [2024-11-18 16:17:13.617743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.108 [2024-11-18 16:17:13.617767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.108 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.617895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.617992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.618016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.618102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.618189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.618214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.618320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.618400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.618424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.618542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.618684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.618709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.618798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.618889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.618913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.619002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.619111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.619136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.619253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.619332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.619357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.619467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.619553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.619577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.619699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.619812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.619836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.619920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.620031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.620055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.620173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.620256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.620280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.620369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.620456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.620480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.620613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.620709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.620733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.620811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.620900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.620924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.621010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.621095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.621119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.621282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.621373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.621397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.621513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.621598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.621649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.621737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.621821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.621846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.621958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.622038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.622062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.622166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.622312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.622345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.622482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.622624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.622655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.386 qpair failed and we were unable to recover it. 00:30:50.386 [2024-11-18 16:17:13.622766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.386 [2024-11-18 16:17:13.622841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.622873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.622970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.623085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.623114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.623258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.623402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.623428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.623536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.623620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.623648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.623767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.623906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.623932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.624028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.624141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.624167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.624285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.624403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.624429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.624540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.624684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.624709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.624860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.624964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.624988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.625101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.625181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.625205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.625292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.625407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.625432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.625544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.625628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.625656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.625771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.625881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.625905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.626013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.626166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.626194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.626310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.626441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.626465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.626552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.626640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.626665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.626806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.626906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.626931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.627039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.627184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.627211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.627340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.627466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.627492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.627661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.627753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.627778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.627923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.628054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.628081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.628210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.628413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.628440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.628574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.628698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.628723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.628819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.628943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.628968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.629083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.629189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.629214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.629368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.629501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.629529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.629668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.629790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.629814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.629957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.630109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.630137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.387 qpair failed and we were unable to recover it. 00:30:50.387 [2024-11-18 16:17:13.630334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.630418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.387 [2024-11-18 16:17:13.630449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.630565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.630713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.630739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.630897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.631048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.631075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.631180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.631341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.631368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.631489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.631622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.631665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.631762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.631852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.631892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.631994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.632142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.632166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.632274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.632428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.632455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.632582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.632725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.632750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.632864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.632991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.633018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.633205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.633342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.633369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.633493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.633647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.633673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.633782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.633896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.633922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.634015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.634112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.634141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.634269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.634361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.634389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.634528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.634616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.634641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.634748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.634861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.634903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.635032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.635122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.635149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.635322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.635421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.635448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.635597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.635702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.635726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.635807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.635947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.635975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.636144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.636341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.636369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.636524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.636605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.636656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.636776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.636880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.636904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.637005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.637111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.388 [2024-11-18 16:17:13.637137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.388 qpair failed and we were unable to recover it. 00:30:50.388 [2024-11-18 16:17:13.637305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.637428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.637456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.637585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.637738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.637766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.637886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.637996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.638020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.638137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.638224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.638262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.638420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.638545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.638571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.638734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.638835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.638859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.639036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.639190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.639216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.639340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.639460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.639487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.639605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.639728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.639752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.639933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.640062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.640090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.640208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.640333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.640359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.640534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.640655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.640680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.640795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.640925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.640952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.641092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.641181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.641207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.641348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.641474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.641500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.641645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.641734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.641763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.641854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.642008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.642036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.642157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.642295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.642320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.642453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.642574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.642601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.642735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.642816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.642844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.642978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.643084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.643108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.643249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.643349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.643377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.643503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.643623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.643650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.643788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.643890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.643914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.644089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.644201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.644224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.644331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.644440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.644468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.644617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.644734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.644763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.389 [2024-11-18 16:17:13.644924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.645016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.389 [2024-11-18 16:17:13.645043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.389 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.645170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.645255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.645282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.645388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.645530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.645554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.645655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.645805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.645831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.645949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.646103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.646130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.646245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.646356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.646381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.646466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.646642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.646670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.646780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.646891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.646916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.646997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.647108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.647132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.647214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.647315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.647357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.647446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.647561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.647602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.647745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.647860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.647884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.647983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.648107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.648136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.648240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.648397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.648424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.648561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.648703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.648728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.648872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.648957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.648981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.649098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.649222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.649249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.649387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.649502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.649526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.649685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.649790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.649817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.649901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.650023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.650050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.650142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.650301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.650325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.650412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.650525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.650550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.650678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.650809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.650836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.650964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.651079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.651103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.651194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.651307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.651333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.651417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.651531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.651556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.651635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.651757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.651780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.390 qpair failed and we were unable to recover it. 00:30:50.390 [2024-11-18 16:17:13.651911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.390 [2024-11-18 16:17:13.652032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.652059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.652152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.652242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.652268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.652406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.652516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.652540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.652711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.652837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.652865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.652970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.653101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.653128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.653294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.653416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.653441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.653536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.653632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.653657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.653739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.653848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.653873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.653960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.654076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.654100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.654227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.654344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.654371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.654500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.654584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.654617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.654731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.654812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.654835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.654958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.655049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.655075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.655161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.655258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.655285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.655397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.655519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.655542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.655630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.655743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.655769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.655863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.655957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.655983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.656081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.656233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.656274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.656402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.656526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.656555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.656697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.656795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.656819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.656932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.657016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.657041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.391 [2024-11-18 16:17:13.657144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.657226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.391 [2024-11-18 16:17:13.657253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.391 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.657342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.657424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.657450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.657579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.657664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.657693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.657829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.657947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.657974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.658096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.658223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.658249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.658378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.658464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.658487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.658576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.658727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.658752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.658832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.658941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.658965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.659054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.659166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.659190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.659295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.659391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.659419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.659540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.659640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.659668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.659771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.659872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.659898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.660014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.660189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.660234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.660353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.660459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.660483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.660604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.660701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.660725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.660851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.660982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.661005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.661088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.661203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.661229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.661347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.661428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.661452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.661544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.661652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.661679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.661765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.661857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.661884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.662021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.662109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.662136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.662220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.662312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.662337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.662493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.662585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.662622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.662761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.662846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.662870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.662958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.663062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.663088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.663210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.663299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.663326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.663426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.663532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.663557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.392 [2024-11-18 16:17:13.663636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.663766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.392 [2024-11-18 16:17:13.663793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.392 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.663887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.663981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.664007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.664177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.664255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.664278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.664392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.664508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.664535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.664633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.664754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.664781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.664882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.664992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.665016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.665138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.665223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.665265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.665382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.665479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.665508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.665615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.665703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.665728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.665812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.665909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.665937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.666075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.666159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.666183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.666297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.666387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.666411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.666508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.666652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.666678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.666771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.666858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.666900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.667039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.667130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.667154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.667316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.667441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.667467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.667602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.667704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.667731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.667871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.667962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.667986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.668111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.668208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.668235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.668405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.668489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.668514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.668599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.668691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.668715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.668806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.668910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.668938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.393 [2024-11-18 16:17:13.669061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.669158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.393 [2024-11-18 16:17:13.669185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.393 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.669317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.669411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.669435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.669525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.669614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.669641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.669759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.669889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.669915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.670037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.670149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.670174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.670354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.670485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.670509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.670629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.670715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.670740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.670833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.670917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.670940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.671016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.671122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.671148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.671300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.671451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.671478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.671631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.671714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.671738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.671840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.671920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.671946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.672110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.672260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.672287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.672397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.672485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.672509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.672632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.672748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.672777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.672870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.673025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.673052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.673187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.673305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.673329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.673435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.673521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.673545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.673665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.673913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.673941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.674075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.674168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.674193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.674308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.674386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.674410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.674583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.674727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.674756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.674890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.674983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.675009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.675097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.675241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.675283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.675378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.675463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.675491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.675592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.675688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.675712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.394 qpair failed and we were unable to recover it. 00:30:50.394 [2024-11-18 16:17:13.675793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.675904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.394 [2024-11-18 16:17:13.675929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.676019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.676117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.676160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.676271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.676386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.676411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.676541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.676658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.676687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.676784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.676901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.676928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.677056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.677140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.677165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.677248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.677350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.677375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.677519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.677633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.677662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.677770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.677856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.677880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.678021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.678104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.678128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.678250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.678375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.678402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.678504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.678599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.678631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.678741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.678825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.678849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.678933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.679068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.679095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.679227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.679347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.679371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.679484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.679578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.679604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.679701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.679797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.679824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.679933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.680045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.680069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.680200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.680352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.680380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.680477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.680604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.680641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.680780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.680862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.680887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.680991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.681126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.681153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.681274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.681386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.681413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.681571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.681668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.681694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.681779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.681877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.681905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.682020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.682118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.682145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.682261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.682368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.682393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.682506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.682646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.682672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.682787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.682871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.395 [2024-11-18 16:17:13.682895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.395 qpair failed and we were unable to recover it. 00:30:50.395 [2024-11-18 16:17:13.683032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.683124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.683149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.683230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.683336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.683361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.683498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.683595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.683633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.683801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.683888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.683911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.684054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.684138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.684165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.684264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.684401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.684429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.684591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.684689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.684714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.684832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.684916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.684943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.685081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.685206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.685234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.685333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.685440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.685465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.685580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.685673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.685701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.685821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.685895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.685918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.686003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.686084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.686109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.686195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.686275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.686299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.686411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.686511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.686538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.686679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.686759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.686783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.686918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.687037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.687063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.687181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.687308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.687335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.687445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.687586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.687623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.687726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.687852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.687879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.688011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.688140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.688180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.688282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.688399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.688423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.688543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.688679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.688708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.688837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.688964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.688988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.396 [2024-11-18 16:17:13.689100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.689190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.396 [2024-11-18 16:17:13.689214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.396 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.689311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.689418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.689443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.689523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.689604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.689636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.689719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.689808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.689831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.689974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.690078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.690105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.690205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.690296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.690323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.690436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.690553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.690576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.690715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.690809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.690836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.690937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.691033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.691061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.691172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.691286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.691311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.691402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.691509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.691537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.691664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.691767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.691795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.691966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.692083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.692108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.692216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.692336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.692364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.692463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.692642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.692668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.692777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.692853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.692877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.692998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.693092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.693134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.693265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.693385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.693412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.693547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.693659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.693684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.693770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.693874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.693902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.694022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.694119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.694147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.694307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.694395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.694419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.694512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.694635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.694675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.694825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.694954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.694982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.695143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.695230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.695254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.695351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.695445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.695474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.695578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.695713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.695743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.695878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.695974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.696000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.696086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.696162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.696186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.397 qpair failed and we were unable to recover it. 00:30:50.397 [2024-11-18 16:17:13.696267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.397 [2024-11-18 16:17:13.696342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.696366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.696478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.696620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.696645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.696807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.696942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.696967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.697089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.697241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.697269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.697411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.697522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.697546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.697759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.697878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.697903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.698019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.698130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.698154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.698243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.698383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.698407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.698528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.698619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.698654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.698780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.698918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.698942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.699044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.699133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.699156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.699274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.699354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.699377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.699485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.699565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.699590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.699687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.699814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.699839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.699952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.700063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.700088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.700204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.700290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.700316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.700430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.700507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.700531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.700621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.700738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.700762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.700906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.701021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.701053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.701193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.701286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.701311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.701453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.701963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.701995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.702145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.702286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.702311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.702397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.702486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.702510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.702630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.702783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.702812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.702943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.703105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.703132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.703243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.703348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.703374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.703514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.703677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.703705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.703807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.703920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.703947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.398 [2024-11-18 16:17:13.704114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.704234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.398 [2024-11-18 16:17:13.704258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.398 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.704400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.704491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.704517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.704616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.704743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.704771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.704901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.704983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.705008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.705093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.705228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.705255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.705378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.705499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.705526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.705650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.705764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.705789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.705877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.705993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.706017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.706125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.706263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.706289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.706376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.706488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.706513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.706602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.706749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.706776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.706936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.707036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.707063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.707196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.707344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.707368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.707474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.707588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.707635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.707792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.707924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.707950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.708084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.708174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.708197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.708348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.708436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.708462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.708577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.708675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.708703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.708832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.708919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.708943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.709024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.709139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.709164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.709255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.709380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.709407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.709515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.709614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.709640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.709781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.709863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.709887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.709972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.710105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.710133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.710266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.710346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.710371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.710485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.710656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.710682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.710758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.710845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.710869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.711010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.711090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.711114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.711262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.711359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.711385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.399 qpair failed and we were unable to recover it. 00:30:50.399 [2024-11-18 16:17:13.711476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.399 [2024-11-18 16:17:13.711592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.711635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.711752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.711887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.711911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.712007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.712122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.712150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.712276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.712439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.712466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.712597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.712688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.712713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.712799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.712887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.712911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.713003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.713114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.713139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.713247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.713323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.713348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.713459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.713542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.713567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.713679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.713770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.713796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.713874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.713993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.714018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.714097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.714192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.714219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.714310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.714459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.714492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.714629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.714738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.714762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.714898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.715018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.715046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.715133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.715249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.715276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.715379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.715459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.715483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.715656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.715773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.715800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.715891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.716015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.716042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.716151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.716256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.716281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.716361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.716480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.716504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.716674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.716802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.716828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.716998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.717112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.717136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.717258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.717346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.717374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.717465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.717623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.717652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.717769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.717892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.717919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.400 qpair failed and we were unable to recover it. 00:30:50.400 [2024-11-18 16:17:13.718054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.400 [2024-11-18 16:17:13.718206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.718234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.718358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.718457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.718486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.718621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.718716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.718740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.718828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.718913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.718937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.719047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.719135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.719176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.719301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.719416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.719440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.719571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.719726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.719754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.719887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.720006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.720033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.720147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.720257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.720281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.720378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.720516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.720539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.720630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.720730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.720757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.720894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.720976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.720999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.721095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.721209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.721236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.721343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.721421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.721447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.721574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.721672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.721696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.721809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.721934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.721959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.722074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.722149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.722172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.722295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.722375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.722400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.722530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.722646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.722675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.722799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.722925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.722952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.723078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.723165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.723190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.723340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.723490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.723517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.723688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.723797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.723822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.723903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.724056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.724080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.724231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.724321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.724347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.724494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.724618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.724646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.724781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.724886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.724910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.725070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.725178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.725206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.401 [2024-11-18 16:17:13.725330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.725452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.401 [2024-11-18 16:17:13.725480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.401 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.725592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.725768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.725794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.725961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.726082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.726109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.726232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.726375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.726402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.726535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.726624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.726650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.726758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.726841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.726883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.727022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.727122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.727150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.727301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.727431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.727455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.727585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.727739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.727767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.727929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.728025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.728056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.728189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.728271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.728295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.728428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.728522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.728549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.728717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.728839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.728865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.728991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.729099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.729124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.729207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.729337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.729365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.729517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.729600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.729634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.729779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.729892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.729917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.730081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.730211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.730238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.730406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.730486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.730510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.730630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.730741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.730766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.730892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.731014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.731040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.731198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.731346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.731372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.731502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.731622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.731647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.731754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.731860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.731884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.731974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.732088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.732112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.732194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.732306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.732331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.732443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.732577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.732603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.732703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.732794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.732820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.732957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.733095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.402 [2024-11-18 16:17:13.733120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.402 qpair failed and we were unable to recover it. 00:30:50.402 [2024-11-18 16:17:13.733238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.733382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.733406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.733522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.733637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.733680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.733785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.733900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.733924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.734027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.734169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.734193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.734306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.734452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.734479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.734622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.734736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.734760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.734887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.735012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.735039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.735163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.735279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.735306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.735436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.735581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.735605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.735756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.735853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.735881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.735998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.736161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.736185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.736305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.736449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.736474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.736580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.736739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.736767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.736907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.737020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.737044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.737167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.737280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.737304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.737445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.737604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.737639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.737730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.737855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.737882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.738011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.738118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.738143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.738246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.738369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.738393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.738509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.738649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.738679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.738786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.738898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.738923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.739042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.739177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.739204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.739339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.739468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.739496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.739604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.739728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.739753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.739875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.739986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.740029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.740123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.740250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.740277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.740417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.740497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.740522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.740650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.740810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.740834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.403 qpair failed and we were unable to recover it. 00:30:50.403 [2024-11-18 16:17:13.740924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.403 [2024-11-18 16:17:13.741014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.741038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.741152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.741239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.741263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.741396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.741511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.741538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.741675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.741795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.741827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.741944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.742055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.742080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.742168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.742280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.742306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.742388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.742528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.742553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.742652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.742762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.742787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.742953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.743076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.743103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.743257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.743346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.743374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.743506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.743635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.743661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.743756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.743846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.743870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.743981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.744061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.744085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.744198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.744282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.744306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.744486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.744570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.744596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.744712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.744851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.744876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.744990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.745097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.745122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.745224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.745344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.745371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.745455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.745552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.745579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.745719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.745799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.745823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.745929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.746044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.746071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.746159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.746243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.746284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.746358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.746468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.746492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.746584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.746699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.746727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.746826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.746947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.746975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.747100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.747218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.747243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.747362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.747439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.747465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.747557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.747657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.747686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.747828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.747925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.404 [2024-11-18 16:17:13.747950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.404 qpair failed and we were unable to recover it. 00:30:50.404 [2024-11-18 16:17:13.748089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.748221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.748248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.748349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.748475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.748502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.748634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.748750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.748775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.748900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.748992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.749019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.749135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.749257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.749284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.749396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.749535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.749559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.749708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.749832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.749859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.749957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.750071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.750098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.750262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.750373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.750398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.750530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.750671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.750699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.750821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.750985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.751013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.751123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.751200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.751224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.751311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.751384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.751408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.751489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.751676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.751705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.751840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.751965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.751990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.752117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.752272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.752300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.752417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.752583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.752615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.752730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.752842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.752867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.752997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.753121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.753148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.753262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.753409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.753437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.753538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.753633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.753658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.753779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.753861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.753901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.754020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.754190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.754215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.754338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.754452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.754477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.754617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.754760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.754787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.405 qpair failed and we were unable to recover it. 00:30:50.405 [2024-11-18 16:17:13.754883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.405 [2024-11-18 16:17:13.754997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.755029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.755140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.755259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.755284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.755445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.755549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.755592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.755723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.755838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.755862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.755972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.756150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.756190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.756342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.756461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.756488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.756581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.756749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.756777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.756889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.757006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.757031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.757163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.757275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.757302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.757426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.757549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.757577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.757693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.757799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.757828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.757944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.758111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.758139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.758232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.758354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.758382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.758487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.758594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.758627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.758708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.758801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.758829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.758951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.759112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.759137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.759278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.759392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.759416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.759523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.759645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.759674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.759830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.759958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.759984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.760098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.760211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.760235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.760334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.760450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.760476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.760605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.760716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.760743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.760882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.760971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.760995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.761116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.761241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.761269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.761400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.761546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.761572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.761684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.761777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.761801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.761959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.762059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.762086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.762218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.762335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.762362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.406 qpair failed and we were unable to recover it. 00:30:50.406 [2024-11-18 16:17:13.762486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.406 [2024-11-18 16:17:13.762574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.762599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.762719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.762836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.762863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.763023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.763152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.763180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.763302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.763412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.763436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.763547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.763628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.763653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.763784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.763908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.763935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.764039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.764201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.764226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.764323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.764398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.764422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.764539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.764616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.764641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.764790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.764907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.764931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.765065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.765201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.765226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.765348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.765481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.765508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.765640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.765749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.765773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.765938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.766064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.766091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.766187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.766311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.766338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.766472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.766623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.766648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.766832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.766946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.766972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.767130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.767289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.767314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.767426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.767512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.767537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.767645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.767770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.767799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.767918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.768070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.768098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.768200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.768321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.768345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.768436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.768562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.768591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.768698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.768868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.768893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.769008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.769125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.769149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.769247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.769371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.769397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.769520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.769648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.769676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.769809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.769954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.769978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.407 [2024-11-18 16:17:13.770150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.770271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.407 [2024-11-18 16:17:13.770311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.407 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.770429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.770537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.770564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.770705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.770797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.770822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.770947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.771082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.771109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.771262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.771392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.771417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.771553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.771669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.771700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.771878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.771981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.772005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.772164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.772317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.772344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.772476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.772580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.772604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.772724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.772899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.772923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.773030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.773181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.773208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.773381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.773520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.773562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.773696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.773822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.773849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.774005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.774109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.774135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.774267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.774374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.774398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.774518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.774638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.774666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.774756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.774868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.774896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.775026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.775104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.775128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.775219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.775309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.775334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.775502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.775625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.775653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.775758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.775873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.775898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.775980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.776090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.776115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.776201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.776371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.776398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.776565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.776682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.776707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.776816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.776949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.776976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.777131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.777243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.777270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.777434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.777518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.777542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.777653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.777800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.777826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.777982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.778135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.778162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.408 qpair failed and we were unable to recover it. 00:30:50.408 [2024-11-18 16:17:13.778295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.408 [2024-11-18 16:17:13.778438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.778462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.778557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.778673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.778697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.778780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.778855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.778879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.779021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.779127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.779151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.779242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.779320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.779344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.779459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.779563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.779586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.779753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.779858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.779887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.779984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.780113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.780156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.780260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.780445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.780488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.780571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.780719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.780745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.780833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.780982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.781007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.781173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.781324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.781367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.781458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.781600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.781634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.781797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.781944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.781987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.782123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.782259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.782285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.782395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.782480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.782506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.782622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.782763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.782788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.782874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.782959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.782985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.783095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.783173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.783198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.783344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.783464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.783489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.783570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.783682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.783708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.783817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.783898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.783923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.784012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.784128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.784154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.784299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.784418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.784445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.784532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.784644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.784670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.784788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.784898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.784922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.785014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.785129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.785153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.785289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.785420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.785448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.409 qpair failed and we were unable to recover it. 00:30:50.409 [2024-11-18 16:17:13.785531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.409 [2024-11-18 16:17:13.785630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.785671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.785760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.785882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.785910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.786036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.786191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.786219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.786344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.786465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.786492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.786577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.786697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.786722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.786850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.786979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.787005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.787105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.787204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.787232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.787358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.787493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.787520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.787678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.787791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.787832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.787992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.788093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.788125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.788276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.788397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.788424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.788550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.788648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.788672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.788764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.788876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.788901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.788991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.789150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.789183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.789297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.789434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.789460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.789595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.789745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.789770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.789881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.789969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.789993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.790146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.790263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.790291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.790390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.790507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.790534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.790707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.790790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.790818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.790898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.791036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.791060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.791176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.791313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.791353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.791490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.791636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.791661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.791767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.791867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.791891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.792013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.792103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.792130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.792249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.792333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.410 [2024-11-18 16:17:13.792359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.410 qpair failed and we were unable to recover it. 00:30:50.410 [2024-11-18 16:17:13.792471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.792574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.792603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.792742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.792822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.792847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.792985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.793071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.793099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.793217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.793331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.793355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.793454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.793546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.793570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.793782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.793962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.793999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.794196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.794326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.794373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.794533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.794710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.794742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.794888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.795053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.795081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.795230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.795318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.795342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.795458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.795549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.795573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.795673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.795791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.795815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.795923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.796004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.796037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.796168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.796256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.796285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.796410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.796522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.796549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.796735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.796851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.796876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.797005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.797130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.797157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.797244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.797394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.797421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.797566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.797673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.797699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.797788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.797859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.797901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.798024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.798133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.798157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.798272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.798360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.798384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.798495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.798640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.798681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.798797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.798922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.798949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.799058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.799147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.799172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.799255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.799341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.799365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.799470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.799622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.799647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.799729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.799808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.799832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.411 qpair failed and we were unable to recover it. 00:30:50.411 [2024-11-18 16:17:13.799963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.411 [2024-11-18 16:17:13.800077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.800104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.800266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.800416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.800443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.800553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.800630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.800656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.800739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.800823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.800846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.801033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.801119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.801144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.801257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.801370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.801394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.801530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.801682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.801707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.801800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.801888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.801912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.802024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.802136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.802162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.802291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.802422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.802449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.802589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.802708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.802734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.802823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.802901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.802936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.803045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.803151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.803192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.803309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.803420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.803448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.803550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.803676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.803700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.803790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.803875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.803899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.803973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.804057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.804086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.804223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.804311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.804339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.804482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.804603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.804638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.804741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.804859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.804887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.805029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.805143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.805168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.805338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.805425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.805452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.805573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.805691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.805719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.805832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.805942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.805966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.806128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.806278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.806305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.806424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.806516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.806543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.806698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.806778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.806802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.806890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.807000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.807025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.412 [2024-11-18 16:17:13.807195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.807344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.412 [2024-11-18 16:17:13.807372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.412 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.807485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.807559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.807583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.807720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.807848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.807877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.808003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.808155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.808182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.808350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.808446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.808470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.808616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.808698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.808743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.808835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.808961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.808988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.809149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.809266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.809290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.809398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.809512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.809539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.809635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.809764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.809789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.809935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.810019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.810043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.810129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.810220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.810246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.810353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.810509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.810537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.810627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.810763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.810788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.810902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.811016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.811040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.811147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.811254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.811278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.811393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.811484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.811509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.811617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.811733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.811761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.811847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.811946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.811972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.812096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.812230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.812255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.812397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.812489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.812516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.812597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.812728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.812756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.812869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.812967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.812991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.813122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.813241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.813268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.813378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.813514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.813542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.813673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.813764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.813791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.813880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.813998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.814026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.814163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.814289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.814317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.814453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.814535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.814561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.413 qpair failed and we were unable to recover it. 00:30:50.413 [2024-11-18 16:17:13.814660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.413 [2024-11-18 16:17:13.814749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.814774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.814896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.814978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.815014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.815142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.815258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.815282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.815423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.815553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.815580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.815726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.815883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.815933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.816125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.816251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.816297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.816454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.816596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.816643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.816790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.816911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.816936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.817054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.817164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.817190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.817269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.817390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.817415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.817503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.817631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.817661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.817747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.817827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.817852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.817960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.818056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.818083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.818181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.818352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.818380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.818511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.818591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.818632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.818750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.818906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.818934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.819031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.819155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.819183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.819368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.819481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.819505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.819605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.819750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.819775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.819915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.820017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.820045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.820215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.820329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.820358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.820474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.820569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.820598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.820743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.820832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.820858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.820947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.821031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.821056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.821210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.821338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.821365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.414 qpair failed and we were unable to recover it. 00:30:50.414 [2024-11-18 16:17:13.821486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.821632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.414 [2024-11-18 16:17:13.821675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.821794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.821907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.821931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.822071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.822200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.822228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.822354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.822472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.822500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.822636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.822733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.822758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.822848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.822998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.823024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.823154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.823276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.823307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.823415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.823506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.823531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.823650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.823767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.823792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.823868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.824027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.824052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.824164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.824266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.824291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.824396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.824512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.824543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.824673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.824781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.824806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.824951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.825057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.825082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.825219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.825370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.825408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.825543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.825680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.825705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.825825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.825938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.825963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.826068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.826187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.826214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.826329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.826461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.826503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.826590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.826674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.826698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.826813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.826912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.826937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.827023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.827189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.827217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.827348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.827465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.827490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.827564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.827689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.827715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.827810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.827894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.827919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.828042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.828133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.828157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.828278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.828362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.828386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.828480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.828631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.828657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.828772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.828877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.415 [2024-11-18 16:17:13.828901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.415 qpair failed and we were unable to recover it. 00:30:50.415 [2024-11-18 16:17:13.829036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.829189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.829216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.829340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.829464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.829502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.829635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.829778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.829802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.829937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.830045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.830074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.830200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.830342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.830369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.830529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.830651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.830677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.830802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.830881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.830922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.831076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.831197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.831228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.831334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.831409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.831433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.831513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.831676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.831701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.831806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.831913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.831955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.832099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.832255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.832280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.832388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.832482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.832506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.832588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.832710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.832754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.832898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.833020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.833046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.833174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.833294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.833321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.833445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.833600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.833636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.833776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.833867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.833897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.834029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.834116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.834144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.834298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.834445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.834471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.834604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.834750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.834775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.834891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.835057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.835084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.835209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.835298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.835325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.835428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.835539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.835563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.835704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.835787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.835815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.835948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.836072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.836099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.836272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.836348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.836372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.836453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.836565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.416 [2024-11-18 16:17:13.836590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.416 qpair failed and we were unable to recover it. 00:30:50.416 [2024-11-18 16:17:13.836767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.836884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.836911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.837081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.837193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.837235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.837396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.837482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.837510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.837620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.837743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.837785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.837903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.838020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.838044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.838198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.838314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.838338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.838446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.838575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.838602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.838753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.838870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.838894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.839027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.839105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.839133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.839281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.839369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.839396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.839515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.839630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.839655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.839743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.839911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.839938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.840033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.840113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.840140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.840303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.840429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.840471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.840625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.840725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.840764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.840879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.841041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.841069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.841199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.841310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.841334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.841412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.841580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.841616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.841722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.841848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.841875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.842040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.842148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.842173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.842260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.842373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.842398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.842509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.842684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.842710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.842788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.842892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.842917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.843001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.843123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.843150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.843264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.843399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.843436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.843534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.843659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.843684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.843758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.843838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.843864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.843971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.844074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.844106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.417 qpair failed and we were unable to recover it. 00:30:50.417 [2024-11-18 16:17:13.844240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.844324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.417 [2024-11-18 16:17:13.844351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.844532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.844648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.844674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.844774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.844921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.844946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.845066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.845159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.845185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.845320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.845457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.845482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.845625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.845775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.845801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.845915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.846004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.846028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.846141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.846242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.846269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.846423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.846512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.846551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.846663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.846746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.846770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.846877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.846994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.847018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.847145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.847266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.847293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.847437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.847522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.847551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.847673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.847762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.847786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.847897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.848055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.848079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.848194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.848332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.848366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.848528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.848645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.848673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.848763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.848886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.848920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.849024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.849112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.849136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.849228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.849339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.849367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.849495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.849641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.849667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.849810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.849934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.849958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.850136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.850251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.850278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.850420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.850552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.850580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.850733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.850851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.850877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.850975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.851143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.851167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.851314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.851453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.851489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.851582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.851672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.851698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.851836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.851961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.851989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.852150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.852307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.852332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.418 [2024-11-18 16:17:13.852419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.852492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.418 [2024-11-18 16:17:13.852517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.418 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.852624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.852771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.852799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.852899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.853021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.853060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.853152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.853292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.853317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.853449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.853588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.853662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.853861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.853997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.854039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.854157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.854300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.854325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.854429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.854556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.854593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.854766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.854884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.854912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.855075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.855192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.855217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.855338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.855463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.855490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.855571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.855668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.855697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.855861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.855951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.855976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.856140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.856242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.856266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.856382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.856516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.856544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.856716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.856833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.856858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.857001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.857087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.857114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.857208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.857322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.857350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.857448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.857558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.857582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.857734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.857862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.857889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.858053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.858178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.858205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.858320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.858469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.858493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.858648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.858771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.858799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.858941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.859095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.859123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.859240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.859353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.859378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.859505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.859614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.859651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.859807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.859959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.859987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.860098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.860172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.860196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.419 [2024-11-18 16:17:13.860352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.860476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.419 [2024-11-18 16:17:13.860503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.419 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.860598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.860760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.860787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.860921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.861033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.861058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.861187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.861287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.861314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.861445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.861525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.861549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.861673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.861816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.861846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.862031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.862169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.862195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.862274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.862354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.862378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.862484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.862597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.862648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.862783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.862955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.862980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.863099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.863225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.863252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.863392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.863503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.863527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.863660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.863759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.863787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.863887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.863988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.864015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.864145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.864237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.864263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.864377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.864487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.864528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.864688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.864811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.864839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.864975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.865055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.865080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.865213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.865340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.865367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.865533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.865658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.865686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.865837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.865956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.865980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.866116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.866223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.866251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.866339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.866458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.866485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.866644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.866730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.866755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.866843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.866954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.866979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.867077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.867156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.867181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.867264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.867377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.867402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.867482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.867575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.867599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.867749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.867849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.867877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.868036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.868175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.868200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.868348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.868437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.868463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.420 [2024-11-18 16:17:13.868553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.868658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.420 [2024-11-18 16:17:13.868685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.420 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.868840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.868948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.868973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.869060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.869171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.869197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.869306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.869467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.869494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.869619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.869737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.869762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.869853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.869939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.869964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.870083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.870224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.870251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.870390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.870528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.870553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.870648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.870801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.870828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.870963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.871086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.871114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.871251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.871367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.871391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.871500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.871614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.871642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.871766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.871892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.871920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.872067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.872188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.872212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.872322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.872453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.872478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.872553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.872675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.872701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.872789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.872904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.872929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.873033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.873134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.873162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.873286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.873384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.873413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.873508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.873671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.873697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.873832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.873949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.873974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.874102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.874241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.874268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.874407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.874524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.874548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.874711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.874835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.874863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.874994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.875090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.875115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.875266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.875348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.875377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.875476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.875597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.875647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.875770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.875892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.875927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.876060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.876176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.876200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.876336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.876422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.876449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.876578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.876712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.876741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.421 [2024-11-18 16:17:13.876873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.876963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.421 [2024-11-18 16:17:13.876988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.421 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.877088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.877191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.877223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.877363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.877486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.877511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.877638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.877747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.877771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.877938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.878071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.878103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.878225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.878341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.878368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.878494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.878599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.878632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.878726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.878844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.878871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.878973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.879087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.879114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.879213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.879353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.879377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.879473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.879563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.879593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.879748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.879846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.879874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.880023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.880135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.880160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.880297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.880394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.880422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.880547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.880704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.880733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.880865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.880956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.880987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.881070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.881213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.881240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.881355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.881503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.881532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.881675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.881792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.881817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.881911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.882043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.882067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.882170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.882282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.882326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.882446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.882582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.882614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.882732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.882858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.882885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.882979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.883115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.883140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.883259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.883372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.883398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.883524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.883666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.883691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.883831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.883982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.884009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.884128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.884278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.884303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.884412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.884529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.884557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.884645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.884769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.884796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.884905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.884996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.885021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.422 qpair failed and we were unable to recover it. 00:30:50.422 [2024-11-18 16:17:13.885201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.885338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.422 [2024-11-18 16:17:13.885365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.885493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.885583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.885621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.885757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.885853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.885878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.886003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.886146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.886173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.886256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.886356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.886380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.886496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.886619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.886646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.886778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.886945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.886969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.887088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.887233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.887261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.887379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.887504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.887529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.887632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.887797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.887825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.887959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.888086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.888113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.888218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.888361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.888386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.888496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.888645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.888674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.888786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.888909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.888937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.889089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.889176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.889200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.889316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.889438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.889466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.889632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.889761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.889789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.889951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.890039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.890063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.890151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.890260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.890284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.890358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.890461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.890485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.890625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.890711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.890735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.890842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.890948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.890973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.891148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.891225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.891250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.891395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.891529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.891553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.891663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.891773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.891805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.891906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.891990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.892028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.892170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.892261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.892286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.892371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.892490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.892514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.892603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.892697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.892722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.892832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.892978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.423 [2024-11-18 16:17:13.893002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.423 qpair failed and we were unable to recover it. 00:30:50.423 [2024-11-18 16:17:13.893148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.893247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.893274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.893368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.893485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.893513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.893656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.893747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.893773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.893905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.894083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.894111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.894260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.894354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.894382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.894519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.894657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.894682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.894816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.894944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.894972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.895077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.895170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.895198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.895329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.895408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.895432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.895537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.895647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.895672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.895753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.895920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.895947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.896065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.896197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.896228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.896333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.896429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.896456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.896578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.896675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.896704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.896832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.896976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.897001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.897154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.897269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.897297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.897393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.897541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.897569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.897716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.897800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.897824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.897941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.898085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.898113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.898208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.898334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.898362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.898459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.898573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.898598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.898681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.898790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.898819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.898989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.899072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.899098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.899184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.899268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.899294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.899436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.899627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.899652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.899771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.899894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.899922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.900025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.900125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.900149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.900237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.900386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.900448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.900575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.900738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.900767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.900903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.900982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.901007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.901172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.901275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.901303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.901454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.901578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.901616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.901723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.901841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.901866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.424 qpair failed and we were unable to recover it. 00:30:50.424 [2024-11-18 16:17:13.901966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.424 [2024-11-18 16:17:13.902083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.902107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.902278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.902390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.902418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.902551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.902699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.902725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.902844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.902929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.902954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.903092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.903195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.903222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.903357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.903453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.903477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.903578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.903700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.903730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.903823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.903912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.903940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.904082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.904172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.904196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.904332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.904462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.904490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.904574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.904683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.904711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.904819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.904902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.904932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.905020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.905126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.905158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.905247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.905367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.905395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.905528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.905626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.905652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.905794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.905947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.905971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.906087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.906220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.906248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.906353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.906440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.906464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.906595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.906698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.906726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.906852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.906984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.907012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.907130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.907227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.907252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.907368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.907509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.907537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.907680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.907778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.907804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.907895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.908019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.908044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.908125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.908223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.908250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.908376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.908461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.908489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.908619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.908700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.908725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.908807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.908946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.908973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.909063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.909186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.909212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.909327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.909417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.909442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.909581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.909680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.909708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.909806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.909941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.909969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.910106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.910184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.425 [2024-11-18 16:17:13.910208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.425 qpair failed and we were unable to recover it. 00:30:50.425 [2024-11-18 16:17:13.910345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.910459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.910486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.910620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.910777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.910804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.910945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.911024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.911050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.911178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.911268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.911296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.911388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.911531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.911556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.911673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.911786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.911811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.911901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.911982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.912007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.912150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.912251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.912279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.912379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.912500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.912524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.912618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.912731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.912759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.912857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.912977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.913005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.913158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.913266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.913291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.913425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.913539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.913567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.913694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.913848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.913876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.914025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.914142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.914167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.914330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.914419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.914446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.914538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.914671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.914699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.914810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.914897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.914921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.915018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.915126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.915155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.915286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.915429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.915454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.915545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.915633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.915659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.915777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.915907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.915934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.916022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.916170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.916198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.916288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.916404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.916431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.916537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.916625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.916650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.916771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.916874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.916899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.916987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.917125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.917153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.917262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.917346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.917371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.917483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.917626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.917655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.917778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.917921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.917948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.918081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.918168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.918197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.918304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.918429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.918458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.918589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.918732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.918758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.918876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.918961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.918986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.919095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.919180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.426 [2024-11-18 16:17:13.919208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.426 qpair failed and we were unable to recover it. 00:30:50.426 [2024-11-18 16:17:13.919347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.919423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.919448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.919531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.919639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.919665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.919798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.919887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.919931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.920016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.920103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.920128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.920202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.920279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.920303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.920384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.920466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.920499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.920613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.920749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.920777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.920879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.920989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.921014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.921096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.921232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.921259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.921348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.921486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.921510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.921592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.921674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.921699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.921809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.921968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.921995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.922091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.922203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.922230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.922367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.922446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.922470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.922581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.922701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.922727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.922818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.922902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.922926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.923022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.923101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.923126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.923217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.923305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.923329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.923442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.923582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.923633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.923750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.923842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.923866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.923998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.924081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.924124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.924279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.924401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.924428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.924572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.924670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.924696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.924827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.924913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.924940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.925071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.925164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.925191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.925302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.925416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.925441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.925558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.925658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.925686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.925824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.925968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.925993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.926083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.926174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.926200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.926308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.926387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.926412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.926549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.926663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.926692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.926806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.926915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.926940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.427 qpair failed and we were unable to recover it. 00:30:50.427 [2024-11-18 16:17:13.927031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.927107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.427 [2024-11-18 16:17:13.927131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.927229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.927313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.927338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.927450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.927533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.927558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.927746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.927873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.927901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.928001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.928154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.928181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.928283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.928373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.928398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.928485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.928615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.928644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.928772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.928862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.928889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.929002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.929091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.929116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.929259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.929334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.929374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.929463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.929579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.929613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.929728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.929852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.929878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.929985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.930075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.930102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.930204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.930285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.930312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.930412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.930488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.930513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.930614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.930693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.930718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.930830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.930974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.930998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.931088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.931204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.931228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.931328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.931442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.931469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.931590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.931704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.931732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.931839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.931981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.932005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.932111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.932193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.932221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.932338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.932433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.932460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.932591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.932675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.932700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.932781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.932897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.932928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.933039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.933118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.933143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.933231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.933343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.933369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.933498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.933590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.933625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.933748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.933841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.933870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.933980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.934144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.934169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.934271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.934362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.934391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.934486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.934605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.934641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.934766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.934858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.934883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.934988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.935092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.935117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.935199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.935283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.935307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.935456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.935565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.935590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.428 qpair failed and we were unable to recover it. 00:30:50.428 [2024-11-18 16:17:13.935746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.428 [2024-11-18 16:17:13.935845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.935873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.935998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.936121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.936149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.936289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.936400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.936425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.936551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.936678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.936707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.936797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.936921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.936948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.937087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.937169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.937193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.937290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.937414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.937442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.937568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.937698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.937726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.937864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.937977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.938002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.938083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.938191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.938219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.938305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.938398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.938439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.938555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.938644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.938670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.938772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.938934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.938962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.939087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.939261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.939286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.939371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.939460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.939485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.939570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.939664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.939690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.939811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.939935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.939962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.940105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.940182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.940207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.940342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.940464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.940492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.940578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.940696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.940725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.940855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.941002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.941026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.941139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.941228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.941255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.941357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.941446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.941473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.941635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.941722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.941747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.941860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.941935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.941959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.942048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.942155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.942180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.942338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.942447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.942471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.942550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.942641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.942666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.942746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.942832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.942858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.942941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.943042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.943067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.943199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.943331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.943358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.943510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.943632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.943661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.943803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.943887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.943911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.944007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.944094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.944122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.944232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.944347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.944388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.429 [2024-11-18 16:17:13.944498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.944617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.429 [2024-11-18 16:17:13.944643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.429 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.944725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.944825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.944852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.945013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.945132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.945156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.945270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.945350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.945375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.945458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.945621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.945651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.945786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.945929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.945953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.946082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.946197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.946223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.946328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.946447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.946474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.946617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.946731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.946757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.946873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.946958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.946982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.947089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.947189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.947216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.947355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.947451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.947478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.947621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.947710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.947735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.947844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.947967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.947994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.948122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.948243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.948282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.948377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.948459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.948483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.948584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.948681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.948723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.948816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.948937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.948964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.949076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.949155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.949180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.949261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.949349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.949374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.949459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.949585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.949638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.949772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.949862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.949887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.950003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.950132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.950159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.950280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.950403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.950430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.950567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.950649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.950674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.950824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.950920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.950947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.951067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.951235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.951260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.951374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.951451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.951475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.951559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.951676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.951700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.951787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.951890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.951918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.952031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.952139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.952164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.952248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.952397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.952421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.952509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.952591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.952637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.952728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.952814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.952839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.952919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.953058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.953085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.953182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.953295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.953322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.430 qpair failed and we were unable to recover it. 00:30:50.430 [2024-11-18 16:17:13.953423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.953512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.430 [2024-11-18 16:17:13.953536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.431 qpair failed and we were unable to recover it. 00:30:50.431 [2024-11-18 16:17:13.953621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.953711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.953736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.431 qpair failed and we were unable to recover it. 00:30:50.431 [2024-11-18 16:17:13.953853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.953969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.953993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.431 qpair failed and we were unable to recover it. 00:30:50.431 [2024-11-18 16:17:13.954082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.954157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.954182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.431 qpair failed and we were unable to recover it. 00:30:50.431 [2024-11-18 16:17:13.954267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.954381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.954405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.431 qpair failed and we were unable to recover it. 00:30:50.431 [2024-11-18 16:17:13.954499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.954583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.954613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.431 qpair failed and we were unable to recover it. 00:30:50.431 [2024-11-18 16:17:13.954697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.954779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.954804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.431 qpair failed and we were unable to recover it. 00:30:50.431 [2024-11-18 16:17:13.954936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.955056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.955083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.431 qpair failed and we were unable to recover it. 00:30:50.431 [2024-11-18 16:17:13.955199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.955323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.955350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.431 qpair failed and we were unable to recover it. 00:30:50.431 [2024-11-18 16:17:13.955540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.955647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.955673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.431 qpair failed and we were unable to recover it. 00:30:50.431 [2024-11-18 16:17:13.955766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.955903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.431 [2024-11-18 16:17:13.955927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.431 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.956007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.956124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.956149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.956235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.956313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.956337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.956450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.956540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.956564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.956673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.956764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.956790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.956880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.956964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.956989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.957075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.957165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.957189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.957287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.957375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.957400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.957489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.957578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.957619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.957702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.957793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.957822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.957909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.957990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.958015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.958104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.958193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.958217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.958305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.958391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.958415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.958495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.958586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.958617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.958710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.958789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.958814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.958896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.958980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.959004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.959113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.959198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.959222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.959306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.959448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.959472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.959557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.959653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.959679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.959772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.959857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.959883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.960020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.960133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.960158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.960272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.960378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.960406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.960518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.960602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.960648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.960736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.960856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.960883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.960986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.961076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.961103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.961201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.961288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.961315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.961439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.961543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.961568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.961654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.961736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.716 [2024-11-18 16:17:13.961760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.716 qpair failed and we were unable to recover it. 00:30:50.716 [2024-11-18 16:17:13.961866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.961991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.962019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.962119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.962245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.962280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.962385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.962473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.962500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.962617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.962731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.962758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.962882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.962967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.962993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.963088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.963205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.963233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.963327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.963414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.963438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.963554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.963661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.963690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.963789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.963887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.963928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.964057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.964165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.964190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.964267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.964357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.964381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.964473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.964581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.964622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.964816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.964947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.964977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.965069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.965185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.965217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.965342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.965465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.965500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.965593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.965707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.965742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.965832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.965937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.965965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.966071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.966161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.966188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.966317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.966407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.966438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.966528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.966658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.966694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.966818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.966911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.966942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.967028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.967144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.967175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.967302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.967426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.967454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.967556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.967663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.967692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.967784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.967888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.967933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.968041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.968150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.968176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.968296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.968381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.968406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.968502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.968659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.968688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.717 qpair failed and we were unable to recover it. 00:30:50.717 [2024-11-18 16:17:13.968818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.717 [2024-11-18 16:17:13.968950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.968979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.969103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.969225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.969251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.969340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.969435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.969459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.969554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.969712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.969741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.969854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.970008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.970037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.970161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.970252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.970277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.970363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.970458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.970483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.970594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.970690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.970716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.970843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.970928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.970953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.971043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.971132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.971157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.971298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.971410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.971436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.971538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.971627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.971673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.971777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.971868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.971896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.972011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.972116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.972143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.972230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.972353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.972379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.972465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.972572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.972596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.972695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.972786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.972811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.972910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.973005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.973031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.973147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.973305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.973332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.973440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.973534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.973563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.973672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.973752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.973779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.973884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.974033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.974062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.974167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.974260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.974287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.974376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.974510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.974538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.974678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.974769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.974794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.974872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.974950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.974975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.975092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.975229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.975257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.975366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.975474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.975503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.975655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.975766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.718 [2024-11-18 16:17:13.975790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.718 qpair failed and we were unable to recover it. 00:30:50.718 [2024-11-18 16:17:13.975873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.975972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.975996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.976116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.976223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.976280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.976452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.976540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.976568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.976680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.976767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.976793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.976909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.977000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.977025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.977122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.977220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.977247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.977341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.977464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.977493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.977660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.977761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.977786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.977872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.978007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.978034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.978139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.978273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.978301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.978406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.978537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.978565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.978687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.978769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.978794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.978877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.979026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.979068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.979206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.979332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.979372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.979465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.979571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.979598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.979762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.979848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.979879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.979991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.980139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.980166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.980291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.980412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.980452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.980549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.980637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.980696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.980810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.980891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.980934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.981072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.981187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.981215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.981297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.981412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.981440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.981569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.981697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.981723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.981810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.981928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.981956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.982115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.982265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.982294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.982481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.982618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.982668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.982757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.982848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.982872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.983010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.983131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.983157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.719 qpair failed and we were unable to recover it. 00:30:50.719 [2024-11-18 16:17:13.983272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.719 [2024-11-18 16:17:13.983377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.983405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.983532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.983642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.983686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.983773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.983905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.983933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.984062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.984147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.984172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.984308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.984404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.984432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.984520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.984619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.984649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.984766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.984891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.984917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.985023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.985170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.985200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.985329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.985448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.985475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.985595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.985718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.985745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.985830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.985937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.985963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.986046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.986131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.986173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.986261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.986427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.986456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.986559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.986665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.986691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.986797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.986939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.986968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.987099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.987226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.987253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.987385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.987503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.987532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.987692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.987781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.987812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.987975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.988097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.988140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.988269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.988384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.988411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.988506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.988604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.988691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.988782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.988903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.988927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.989039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.989182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.989208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.989338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.989459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.989486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.720 qpair failed and we were unable to recover it. 00:30:50.720 [2024-11-18 16:17:13.989600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.720 [2024-11-18 16:17:13.989696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.989720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.989815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.989894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.989918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.990014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.990092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.990117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.990228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.990335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.990361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.990501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.990613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.990643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.990737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.990853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.990881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.990994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.991076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.991101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.991226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.991305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.991331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.991417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.991498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.991538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.991693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.991804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.991829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.991925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.992048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.992074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.992151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.992231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.992256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.992372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.992482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.992508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.992587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.992728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.992759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.992861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.993002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.993031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.993169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.993277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.993302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.993404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.993513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.993543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.993635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.993778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.993807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.993941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.994066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.994092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.994203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.994341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.994367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.994491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.994653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.994682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.994791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.994892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.994918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.995016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.995100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.995125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.995258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.995349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.995376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.995509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.995630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.995656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.995782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.995896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.995923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.996018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.996170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.996197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.996323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.996441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.996468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.721 [2024-11-18 16:17:13.996676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.996809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.721 [2024-11-18 16:17:13.996836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.721 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.997002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.997101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.997129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.997249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.997364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.997391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.997478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.997588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.997628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.997727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.997829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.997859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.998003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.998089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.998116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.998254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.998375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.998403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.998509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.998599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.998638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.998766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.998876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.998901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.998985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.999100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.999128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.999294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.999414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.999440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.999560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.999682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.999708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:13.999846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.999953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:13.999992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.000146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.000300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.000330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.000436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.000531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.000556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.000673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.000808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.000837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.000947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.001050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.001078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.001200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.001296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.001322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.001411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.001491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.001516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.001620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.001752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.001781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.001913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.002061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.002089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.002194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.002282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.002308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.002431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.002532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.002562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.002679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.002774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.002802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.002951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.003035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.003062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.003176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.003284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.003312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.003462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.003560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.003588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.003727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.003824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.003849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.003970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.004072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.004099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.722 qpair failed and we were unable to recover it. 00:30:50.722 [2024-11-18 16:17:14.004200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.722 [2024-11-18 16:17:14.004321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.004350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.004522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.004636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.004662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.004780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.004905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.004933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.005040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.005123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.005150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.005266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.005357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.005393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.005511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.005627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.005653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.005735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.005857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.005882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.005987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.006105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.006142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.006261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.006382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.006422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.006516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.006601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.006635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.006766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.006886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.006911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.007026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.007112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.007139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.007263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.007397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.007425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.007600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.007720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.007746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.007839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.007927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.007952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.008045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.008216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.008245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.008377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.008456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.008481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.008579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.008675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.008700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.008799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.008906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.008953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.009070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.009161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.009187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.009306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.009422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.009447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.009560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.009716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.009745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.009851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.009965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.010006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.010117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.010246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.010273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.010360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.010503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.010529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.010623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.010769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.010812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.010933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.011119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.011147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.011274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.011378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.011406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.723 qpair failed and we were unable to recover it. 00:30:50.723 [2024-11-18 16:17:14.011532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.723 [2024-11-18 16:17:14.011645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.011671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.011801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.011890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.011918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.012041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.012169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.012197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.012312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.012393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.012419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.012551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.012720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.012747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.012838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.012972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.013000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.013119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.013196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.013221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.013381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.013474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.013503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.013657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.013762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.013787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.013889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.014008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.014048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.014147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.014254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.014282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.014422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.014551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.014579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.014705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.014788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.014831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.014931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.015094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.015120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.015206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.015308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.015336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.015479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.015622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.015649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.015813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.015930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.015955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.016034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.016160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.016189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.016318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.016431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.016457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.016560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.016697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.016723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.016856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.017023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.017052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.017187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.017336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.017362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.017497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.017638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.017665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.017744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.017843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.017870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.018002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.018087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.018115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.018227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.018372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.018402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.018533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.018652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.018683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.018785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.018872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.018898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.724 [2024-11-18 16:17:14.019012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.019095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.724 [2024-11-18 16:17:14.019153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.724 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.019263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.019381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.019411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.019555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.019643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.019669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.019800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.019920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.019949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.020079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.020178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.020204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.020291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.020397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.020423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.020532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.020642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.020671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.020827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.020919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.020945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.021033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.021138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.021163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.021246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.021378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.021406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.021489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.021584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.021648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.021819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.021953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.021995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.022163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.022278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.022303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.022396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.022509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.022547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.022697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.022812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.022842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.022985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.023131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.023160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.023291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.023402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.023428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.023551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.023655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.023682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.023769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.023858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.023886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.023989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.024090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.024117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.024208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.024295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.024321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.024410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.024508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.024545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.024648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.024739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.024772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.024871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.024957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.024984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.025107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.025227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.025252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.025378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.025464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.725 [2024-11-18 16:17:14.025490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.725 qpair failed and we were unable to recover it. 00:30:50.725 [2024-11-18 16:17:14.025593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.025715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.025742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.025834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.025931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.025957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.026046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.026135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.026169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.026266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.026355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.026383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.026505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.026600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.026632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.026733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.026822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.026853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.026951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.027048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.027083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.027201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.027323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.027351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.027438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.027523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.027553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.027652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.027736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.027763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.027857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.027964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.027992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.028110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.028208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.028235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.028315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.028406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.028439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.028528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.028620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.028646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.028747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.028875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.028901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.029020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.029105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.029132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.029236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.029358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.029385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.029499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.029587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.029623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.029728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.029832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.029866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.029956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.030050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.030076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.030165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.030257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.030287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.030404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.030487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.030512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.030613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.030715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.030742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.030827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.030922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.030948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.031042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.031135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.031162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.031277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.031386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.031419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.031518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.031621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.031656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.726 qpair failed and we were unable to recover it. 00:30:50.726 [2024-11-18 16:17:14.031756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.031850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.726 [2024-11-18 16:17:14.031876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.031986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.032074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.032100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.032222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.032313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.032340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.032425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.032510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.032535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.032624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.032715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.032742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.032836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.032926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.032952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.033034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.033113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.033138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.033222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.033309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.033336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.033442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.033561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.033587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.033721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.033803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.033829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.033943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.034052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.034078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.034168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.034255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.034281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.034422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.034533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.034559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.034643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.034730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.034756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.034846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.034929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.034954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.035065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.035173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.035198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.035282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.035410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.035436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.035518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.035642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.035670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.035782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.035872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.035898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.035992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.036070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.036096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.036226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.036341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.036368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.036455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.036563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.036589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.036685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.036770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.036797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.036889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.037017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.037045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.037164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.037256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.037282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.037376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.037461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.037486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.037579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.037675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.037701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.037829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.037912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.037938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.038055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.038176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.727 [2024-11-18 16:17:14.038201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.727 qpair failed and we were unable to recover it. 00:30:50.727 [2024-11-18 16:17:14.038323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.038435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.038460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.038573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.038694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.038721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.038803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.038899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.038926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.039010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.039104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.039131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.039238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.039321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.039347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.039434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.039626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.039653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.039733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.039825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.039851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.039954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.040095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.040120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.040209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.040325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.040351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.040473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.040600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.040638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.040789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.040909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.040934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.041035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.041128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.041156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.041289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.041418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.041446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.041595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.041689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.041714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.041809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.041909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.041936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.042043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.042138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.042165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.042290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.042408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.042436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.042533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.042622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.042667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.042752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.042829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.042854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.042985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.043082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.043109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.043229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.043329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.043357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.043443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.043561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.043588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.043740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.043821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.043845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.043961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.044061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.044088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.044244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.044332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.044359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.044447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.044539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.728 [2024-11-18 16:17:14.044567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.728 qpair failed and we were unable to recover it. 00:30:50.728 [2024-11-18 16:17:14.044716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.044798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.044822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.044938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.045019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.045043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.045159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.045263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.045290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.045445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.045567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.045594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.045710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.045802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.045827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.045912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.046029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.046054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.046188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.046323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.046347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.046455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.046592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.046628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.046729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.046904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.046931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.047017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.047141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.047168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.047358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.047485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.047512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.047625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.047763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.047787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.047873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.047969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.048010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.048117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.048217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.048245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.048334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.048459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.048491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.048620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.048786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.048811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.048927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.049042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.049067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.049245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.049320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.049345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.049457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.049590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.049625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.049757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.049849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.049873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.049975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.050069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.050110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.050254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.050347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.050389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.050525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.050617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.050643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.050733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.050848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.050872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.050967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.051077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.729 [2024-11-18 16:17:14.051102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.729 qpair failed and we were unable to recover it. 00:30:50.729 [2024-11-18 16:17:14.051245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.051326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.051350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.051426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.051508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.051533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.051622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.051709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.051734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.051814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.051931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.051955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.052079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.052202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.052229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.052347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.052432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.052460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.052567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.052675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.052700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.052789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.052879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.052904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.053036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.053133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.053160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.053296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.053377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.053401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.053539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.053632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.053676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.053760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.053843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.053868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.053961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.054044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.054069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.054153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.054266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.054290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.054379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.054495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.054519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.054630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.054754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.054779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.054883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.054996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.055024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.055149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.055231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.055258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.055362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.055446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.055471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.055567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.055705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.055733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.055832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.055935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.055964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.056068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.056239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.056264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.056441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.056551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.056575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.056696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.056842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.056867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.056978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.057059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.057083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.730 [2024-11-18 16:17:14.057162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.057251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.730 [2024-11-18 16:17:14.057276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.730 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.057362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.057502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.057532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.057634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.057722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.057748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.057833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.057928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.057957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.058051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.058205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.058232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.058343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.058429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.058454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.058529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.058645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.058674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.058767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.058864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.058892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.059003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.059113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.059138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.059229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.059309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.059334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.059414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.059531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.059555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.059678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.059762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.059788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.059908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.059997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.060025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.060153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.060308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.060332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.060416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.060509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.060533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.060628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.060710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.060740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.060826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.060917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.060944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.061028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.061136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.061160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.061245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.061343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.061370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.061497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.061584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.061620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.061730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.061840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.061865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.061948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.062078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.062105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.062228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.062314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.062341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.062468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.062617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.062642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.062776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.062899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.062928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.063075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.063163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.063191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.063302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.063413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.063439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.063521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.063631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.063661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.063744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.063861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.063889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.731 qpair failed and we were unable to recover it. 00:30:50.731 [2024-11-18 16:17:14.064024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.731 [2024-11-18 16:17:14.064141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.064166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.064310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.064445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.064469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.064557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.064651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.064676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.064765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.064903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.064928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.065087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.065205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.065232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.065327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.065426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.065454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.065589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.065686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.065712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.065827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.065958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.065985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.066088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.066300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.066327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.066484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.066592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.066624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.066724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.066812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.066841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.066957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.067114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.067139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.067255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.067346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.067372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.067511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.067626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.067669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.067788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.067937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.067964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.068105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.068184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.068209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.068294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.068391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.068418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.068555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.068680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.068708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.068821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.068899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.068924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.069014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.069158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.069185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.069281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.069376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.069403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.069538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.069623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.069649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.069741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.069827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.069853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.069938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.070022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.070047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.070230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.070304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.070328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.070467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.070553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.732 [2024-11-18 16:17:14.070580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.732 qpair failed and we were unable to recover it. 00:30:50.732 [2024-11-18 16:17:14.070739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.070828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.070855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.070958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.071047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.071072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.071181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.071270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.071295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.071405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.071545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.071571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.071696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.071777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.071803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.071889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.072034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.072062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.072154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.072278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.072305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.072451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.072531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.072556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.072670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.072780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.072808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.072962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.073051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.073080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.073216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.073331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.073356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.073492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.073619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.073652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.073779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.073912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.073937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.074022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.074136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.074160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.074319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.074449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.074474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.074562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.074719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.074747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.074860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.074973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.074998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.075101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.075199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.075226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.075312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.075434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.075461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.075574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.075669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.075694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.075825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.075929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.075957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.076073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.076224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.076253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.076364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.076474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.076502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.076633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.076744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.076769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.076852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.076951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.076980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.077085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.077178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.077203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.077318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.077399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.077424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.077511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.077623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.077648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.733 [2024-11-18 16:17:14.077740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.077820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.733 [2024-11-18 16:17:14.077844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.733 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.077936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.078011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.078035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.078121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.078266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.078293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.078396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.078482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.078507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.078594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.078734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.078762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.078892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.079018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.079047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.079195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.079307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.079332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.079462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.079586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.079633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.079717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.079805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.079829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.079944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.080025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.080049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.080128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.080271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.080298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.080421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.080511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.080539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.080653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.080736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.080761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.080841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.080941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.080969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.081103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.081255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.081282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.081390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.081476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.081500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.081591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.081675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.081701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.081843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.081993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.082020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.082125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.082273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.082297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.082405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.082497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.082524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.082605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.082704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.082732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.082834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.082971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.082996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.083090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.083204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.083228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.734 qpair failed and we were unable to recover it. 00:30:50.734 [2024-11-18 16:17:14.083305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.734 [2024-11-18 16:17:14.083382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.083406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.083502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.083625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.083668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.083757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.083834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.083859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.083977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.084114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.084141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.084247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.084360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.084384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.084491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.084583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.084629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.084760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.084890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.084917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.085027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.085115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.085139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.085268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.085392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.085419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.085506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.085595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.085634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.085748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.085886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.085911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.086041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.086148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.086177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.086284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.086413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.086439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.086522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.086616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.086642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.086732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.086820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.086846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.087026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.087123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.087148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.087288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.087373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.087398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.087498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.087666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.087692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.087774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.087898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.087926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.088060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.088170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.088194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.088295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.088438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.088466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.088560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.088711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.088744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.088874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.088963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.088988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.089130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.089217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.089244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.089375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.089468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.089495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.089604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.089700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.089724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.089843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.089960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.089984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.090101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.090216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.090240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.735 [2024-11-18 16:17:14.090317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.090426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.735 [2024-11-18 16:17:14.090451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.735 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.090535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.090618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.090644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.090734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.090846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.090871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.090983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.091067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.091092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.091181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.091331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.091359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.091452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.091550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.091577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.091704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.091793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.091818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.091924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.092048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.092076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.092200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.092288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.092315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.092420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.092521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.092549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.092671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.092753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.092777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.092864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.092968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.092996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.093134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.093242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.093267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.093384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.093466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.093490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.093603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.093700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.093744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.093882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.093970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.093996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.094110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.094195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.094221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.094366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.094462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.094490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.094627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.094747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.094772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.094911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.095000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.095027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.095153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.095280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.095308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.095413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.095553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.095578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.095705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.095800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.095827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.095956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.096056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.096084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.096224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.096335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.096360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.096473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.096616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.096644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.096770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.096892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.096920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.097028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.097117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.097143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.097228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.097361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.097389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.736 qpair failed and we were unable to recover it. 00:30:50.736 [2024-11-18 16:17:14.097478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.097643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.736 [2024-11-18 16:17:14.097669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.097746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.097852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.097877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.097993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.098089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.098118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.098203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.098315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.098343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.098446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.098556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.098580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.098717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.098811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.098839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.098925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.099030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.099057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.099198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.099316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.099340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.099420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.099573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.099598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.099726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.099803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.099828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.099954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.100032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.100057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.100172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.100304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.100331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.100453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.100546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.100573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.100695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.100782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.100807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.100896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.100974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.100998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.101081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.101156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.101184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.101304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.101392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.101417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.101493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.101571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.101597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.101690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.101769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.101793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.101903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.102035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.102059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.102204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.102290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.102316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.102391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.102502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.102527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.102614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.102740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.102765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.102909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.103058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.103083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.103219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.103347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.103374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.103477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.103556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.103581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.737 [2024-11-18 16:17:14.103739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.103842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.737 [2024-11-18 16:17:14.103869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.737 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.103964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.104086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.104113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.104251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.104365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.104390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.104485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.104582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.104618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.104745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.104866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.104893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.105005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.105091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.105115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.105200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.105345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.105372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.105494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.105622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.105652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.105771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.105882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.105907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.106036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.106175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.106199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.106311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.106417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.106441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.106522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.106613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.106639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.106724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.106821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.106849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.106978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.107111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.107138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.107301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.107390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.107414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.107505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.107658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.107683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.107853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.107947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.107974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.108134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.108338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.108365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.108515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.108669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.108697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.108829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.108954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.108982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.109112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.109255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.109280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.109376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.109474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.109501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.109593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.109808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.109832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.109981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.110069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.110094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.110213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.110317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.110341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.110416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.110524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.110548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.110630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.110736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.110760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.110882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.111016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.111043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.111170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.111257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.111284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.738 qpair failed and we were unable to recover it. 00:30:50.738 [2024-11-18 16:17:14.111409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.111493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.738 [2024-11-18 16:17:14.111519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.111654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.111813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.111841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.112002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.112138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.112165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.112296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.112382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.112407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.112540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.112665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.112694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.112782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.112883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.112910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.113104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.113242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.113284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.113439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.113559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.113584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.113667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.113756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.113783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.113871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.114060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.114085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.114218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.114306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.114335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.114430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.114555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.114588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.114706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.114848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.114873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.114984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.115142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.115166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.115259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.115341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.115366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.115444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.115556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.115582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.115722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.115811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.115837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.115988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.116180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.116207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.116337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.116477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.116502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.116641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.116753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.116783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.116883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.117031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.117058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.117202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.117284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.117313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.739 [2024-11-18 16:17:14.117496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.117637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.739 [2024-11-18 16:17:14.117664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.739 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.117820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.117944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.117971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.118115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.118194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.118220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.118318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.118441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.118467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.118603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.118775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.118799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.118917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.119104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.119128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.119260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.119422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.119449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.119548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.119726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.119754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.119856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.120003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.120027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.120158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.120281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.120310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.120435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.120604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.120635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.120710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.120789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.120813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.120927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.121006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.121031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.121171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.121287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.121315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.121446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.121591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.121625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.121767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.121907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.121933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.122020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.122132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.122156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.122269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.122380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.122405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.122522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.122646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.122672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.122810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.123007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.123034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.123139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.123281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.123306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.123477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.123600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.123634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.123804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.123921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.123945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.124062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.124170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.124194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.124322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.124441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.124468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.124584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.124731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.124759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.124863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.125052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.125076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.125241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.125362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.125389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.125490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.125620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.125648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.740 qpair failed and we were unable to recover it. 00:30:50.740 [2024-11-18 16:17:14.125778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.125859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.740 [2024-11-18 16:17:14.125883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.125966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.126077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.126101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.126232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.126388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.126415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.126630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.126741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.126765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.126879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.126960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.126985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.127115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.127202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.127229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.127358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.127443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.127468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.127604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.127762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.127790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.127943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.128066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.128093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.128199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.128288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.128312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.128403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.128500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.128528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.128671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.128748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.128778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.128886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.129002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.129027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.129183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.129305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.129333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.129420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.129536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.129565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.129671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.129787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.129811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.129906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.130029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.130056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.130217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.130375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.130402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.130567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.130667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.130692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.130801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.130939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.130964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.131046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.131178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.131206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.131322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.131440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.131469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.131598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.131696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.131724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.131849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.132042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.132070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.132199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.132340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.132364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.132508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.132654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.132679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.741 qpair failed and we were unable to recover it. 00:30:50.741 [2024-11-18 16:17:14.132757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.741 [2024-11-18 16:17:14.132875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.132899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.132983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.133054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.133079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.133172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.133303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.133331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.133425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.133564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.133589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.133785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.133942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.133970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.134091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.134193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.134221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.134329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.134444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.134471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.134646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.134743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.134768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.134853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.134999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.135023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.135175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.135297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.135324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.135460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.135605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.135636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.135745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.135901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.135928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.136028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.136188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.136215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.136372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.136487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.136513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.136651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.136804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.136831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.136959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.137079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.137107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.137220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.137332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.137356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.137488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.137658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.137687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.137806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.137957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.137984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.138177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.138267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.138291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.138403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.138481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.138505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.138618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.138782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.138810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.138924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.139038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.139063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.139173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.139277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.139301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.139439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.139551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.139577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.139667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.139808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.139832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.139952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.140084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.140112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.140262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.140357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.140384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.140499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.140628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.140654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.742 qpair failed and we were unable to recover it. 00:30:50.742 [2024-11-18 16:17:14.140756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.742 [2024-11-18 16:17:14.140930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.140954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.141062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.141253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.141280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.141416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.141533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.141557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.141664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.141754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.141779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.141899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.142027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.142056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.142192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.142306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.142330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.142441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.142617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.142642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.142758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.142952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.142977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.143089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.143192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.143216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.143346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.143474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.143502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.143653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.143769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.143793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.143911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.143995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.144020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.144138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.144218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.144258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.144353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.144472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.144500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.144611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.144751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.144776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.144913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.145004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.145031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.145150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.145277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.145304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.145471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.145563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.145592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1717108 Killed "${NVMF_APP[@]}" "$@" 00:30:50.743 [2024-11-18 16:17:14.145732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.145836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.145864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.145961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 16:17:14 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:50.743 [2024-11-18 16:17:14.146085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.146110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 16:17:14 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:50.743 [2024-11-18 16:17:14.146218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 16:17:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:50.743 [2024-11-18 16:17:14.146327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.146353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 16:17:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:50.743 [2024-11-18 16:17:14.146470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 16:17:14 -- common/autotest_common.sh@10 -- # set +x 00:30:50.743 [2024-11-18 16:17:14.146549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.146575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.146670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.146777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.146801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.146883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.147022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.147047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.147150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.147309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.147336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.743 qpair failed and we were unable to recover it. 00:30:50.743 [2024-11-18 16:17:14.147458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.743 [2024-11-18 16:17:14.147574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.147615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.147748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.147888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.147919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.148045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.148203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.148230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.148355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.148468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.148496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.148600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.148730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.148756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.148912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.149000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.149024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.149161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.149300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.149329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.149492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.149573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.149599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 16:17:14 -- nvmf/common.sh@469 -- # nvmfpid=1717811 00:30:50.744 16:17:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:50.744 16:17:14 -- nvmf/common.sh@470 -- # waitforlisten 1717811 00:30:50.744 [2024-11-18 16:17:14.149774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.149871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.149902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 16:17:14 -- common/autotest_common.sh@829 -- # '[' -z 1717811 ']' 00:30:50.744 16:17:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:50.744 [2024-11-18 16:17:14.150069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 16:17:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:50.744 16:17:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:50.744 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:50.744 [2024-11-18 16:17:14.150260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.150300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 16:17:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:50.744 [2024-11-18 16:17:14.150400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 16:17:14 -- common/autotest_common.sh@10 -- # set +x 00:30:50.744 [2024-11-18 16:17:14.150516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.150545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.150690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.150777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.150805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.150937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.151035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.151064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.151206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.151299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.151323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.151442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.151630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.151656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.151797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.151875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.151916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.152056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.152148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.152173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.152270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.152384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.152410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.152543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.152664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.152690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.152782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.152858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.152882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.153001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.153135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.153162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.153257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.153381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.153408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.153534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.153629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.744 [2024-11-18 16:17:14.153655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.744 qpair failed and we were unable to recover it. 00:30:50.744 [2024-11-18 16:17:14.153759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.153865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.153892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.154026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.154121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.154149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.154255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.154372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.154397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.154500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.154613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.154643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.154849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.154956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.154983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.155121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.155200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.155225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.155307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.155404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.155429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.155570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.155671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.155700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.155837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.155931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.155955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.156047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.156147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.156172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.156282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.156412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.156454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.156546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.156671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.156697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.156796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.156928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.156955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.157060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.157155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.157196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.157283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.157388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.157414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.157492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.157570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.157595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.157740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.157821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.157845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.157933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.158048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.158073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.158187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.158328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.158356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.158477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.158601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.158637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.158759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.158880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.158904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.158996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.159132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.159160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.159279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.159421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.159446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.159545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.159644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.159684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.159774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.159862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.159911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.160041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.160164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.160193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.160342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.160418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.160442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.160527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.160653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.160689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.745 qpair failed and we were unable to recover it. 00:30:50.745 [2024-11-18 16:17:14.160859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.160959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.745 [2024-11-18 16:17:14.160983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.161075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.161191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.161217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.161321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.161415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.161442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.161530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.161637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.161667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.161775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.161865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.161890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.161971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.162059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.162083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.162218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.162317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.162344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.162473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.162569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.162594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.162687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.162804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.162828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.163008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.163093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.163124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.163234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.163345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.163371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.163476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.163577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.163604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.163703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.163828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.163856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.163970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.164088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.164113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.164204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.164311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.164340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.164434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.164529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.164556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.164678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.164767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.164791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.164870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.164961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.164986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.165069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.165213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.165241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.165374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.165450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.165475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.165632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.165763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.165789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.165903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.166017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.166043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.166183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.166292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.166317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.166404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.166511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.166537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.166708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.166821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.166845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.166966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.167059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.167083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.167204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.167344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.167369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.167452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.167563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.167588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.167685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.167878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.167902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.746 qpair failed and we were unable to recover it. 00:30:50.746 [2024-11-18 16:17:14.167993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.746 [2024-11-18 16:17:14.168083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.168107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.168197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.168281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.168306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.168397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.168486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.168511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.168604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.168700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.168724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.168813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.168964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.168989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.169072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.169153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.169178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.169274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.169357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.169382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.169466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.169543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.169568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.169669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.169760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.169787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.169873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.170067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.170092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.170187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.170276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.170300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.170392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.170488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.170513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.170598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.170724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.170749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.170836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.171023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.171047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.171159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.171274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.171300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.171387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.171461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.171485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.171564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.171686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.171712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.171796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.171879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.171904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.172025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.172140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.172165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.172246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.172332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.172357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.172444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.172565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.172591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.172696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.172798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.172824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.172916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.173007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.173033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.173119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.173193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.173217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.173325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.173409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.173434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.173517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.173645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.173671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.173760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.173904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.173929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.174126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.174216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.174240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.747 qpair failed and we were unable to recover it. 00:30:50.747 [2024-11-18 16:17:14.174391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.174480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.747 [2024-11-18 16:17:14.174505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.174583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.174788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.174813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.174920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.175039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.175064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.175150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.175232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.175261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.175381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.175474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.175499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.175590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.175684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.175709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.175796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.175915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.175940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.176056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.176168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.176192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.176274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.176351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.176375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.176457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.176541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.176565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.176686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.176777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.176802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.176920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.177053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.177078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.177158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.177247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.177273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.177364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.177451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.177475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.177569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.177781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.177807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.177903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.177988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.178012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.178088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.178179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.178205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.178297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.178380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.178405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.178481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.178568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.178593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.178719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.178810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.178835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.178916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.179015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.179040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.179129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.179239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.179264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.179356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.179468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.179492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.179604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.179719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.179743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.179835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.179931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.179956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.180036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.180124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.180149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.180236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.180347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.180372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.180489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.180598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.180631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.748 qpair failed and we were unable to recover it. 00:30:50.748 [2024-11-18 16:17:14.180722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.748 [2024-11-18 16:17:14.180919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.180943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.181029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.181139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.181163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.181248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.181360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.181385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.181476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.181563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.181587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.181689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.181783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.181807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.181899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.181982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.182007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.182096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.182186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.182212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.182294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.182489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.182514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.182631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.182713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.182739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.182819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.183016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.183040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.183152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.183233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.183258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.183399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.183504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.183528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.183615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.183698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.183723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.183838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.183932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.183956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.184040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.184127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.184153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.184230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.184320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.184346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.184442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.184534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.184558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.184656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.184784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.184808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.184921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.185000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.185025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.185140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.185231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.185255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.185342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.185538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.185563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.185689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.185770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.185795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.185881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.185973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.185997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.186086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.186171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.186196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.186277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.186394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.186418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.186498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.186578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.186603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.749 qpair failed and we were unable to recover it. 00:30:50.749 [2024-11-18 16:17:14.186721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.749 [2024-11-18 16:17:14.186797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.186827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.186916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.186998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.187023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.187108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.187215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.187240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.187327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.187421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.187447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.187531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.187615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.187640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.187731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.187818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.187842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.187933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.188012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.188037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.188125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.188207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.188231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.188308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.188387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.188412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.188493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.188566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.188592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.188690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.188769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.188794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.188888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.189080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.189105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.189193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.189305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.189330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.189528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.189637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.189664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.189764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.189852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.189877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.189958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.190101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.190125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.190170] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:50.750 [2024-11-18 16:17:14.190209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.190239] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:50.750 [2024-11-18 16:17:14.190291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.190316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.190402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.190479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.190502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.190693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.190769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.190794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.190882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.191019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.191044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.191170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.191257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.191282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.191360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.191445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.191472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.191572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.191666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.191692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.191781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.191860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.191885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.191972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.192084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.192109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.192226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.192304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.192329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.192415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.192490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.192516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.192612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.192695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.192721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.192812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.192939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.192964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.750 qpair failed and we were unable to recover it. 00:30:50.750 [2024-11-18 16:17:14.193054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.750 [2024-11-18 16:17:14.193134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.193159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.193247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.193367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.193392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.193480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.193560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.193584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.193707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.193788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.193813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.193930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.194002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.194027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.194152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.194244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.194270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.194350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.194433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.194458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.194598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.194693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.194719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.194804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.194923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.194948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.195081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.195199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.195223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.195333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.195413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.195437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.195523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.195613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.195639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.195770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.195858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.195883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.195992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.196103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.196128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.196253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.196338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.196363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.196487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.196577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.196621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.196742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.196831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.196856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.196979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.197066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.197091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.197218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.197355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.197380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.197496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.197632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.197658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.197786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.197911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.197936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.198021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.198102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.198132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.198248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.198371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.198396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.198506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.198592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.198625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.198734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.198824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.198848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.198961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.199034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.199059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.199136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.199220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.199244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.199339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.199433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.199457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.199531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.199639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.199664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.199749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.199839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.199863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.199982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.200093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.200117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.751 qpair failed and we were unable to recover it. 00:30:50.751 [2024-11-18 16:17:14.200227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.200336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.751 [2024-11-18 16:17:14.200360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.200475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.200547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.200571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.200669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.200791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.200816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.200903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.201027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.201052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.201175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.201258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.201284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.201381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.201492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.201517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.201615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.201731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.201758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.201857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.201943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.201967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.202051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.202142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.202172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.202279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.202454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.202478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.202623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.202707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.202732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.202826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.202968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.202993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.203113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.203228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.203252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.203340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.203432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.203456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.203580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.203679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.203704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.203819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.203928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.203954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.204043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.204121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.204146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.204230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.204312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.204336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.204428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.204547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.204571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.204659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.204776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.204801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.204878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.204986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.205011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.205164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.205289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.205314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.205394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.205488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.205513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.205631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.205717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.205742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.205825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.205963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.205988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.206105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.206223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.206248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.206333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.206413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.206437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.206568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.206676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.206701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.206782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.206920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.206945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.207027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.207112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.207137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.207279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.207403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.207428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.752 qpair failed and we were unable to recover it. 00:30:50.752 [2024-11-18 16:17:14.207548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.207669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.752 [2024-11-18 16:17:14.207695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.207820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.207928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.207953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.208061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.208140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.208166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.208253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.208342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.208366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.208447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.208526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.208550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.208642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.208751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.208776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.208860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.208948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.208973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.209087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.209202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.209226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.209338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.209425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.209449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.209568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.209689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.209714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.209832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.209913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.209942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.210056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.210166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.210191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.210279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.210361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.210386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.210529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.210617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.210643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.210734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.210816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.210841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.210959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.211047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.211073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.211153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.211295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.211320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.211410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.211545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.211570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.211655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.211765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.211791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.211872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.211958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.211984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.212140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.212265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.212290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.212389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.212479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.212504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.212626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.212719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.212744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.212836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.212961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.212986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.213066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.213158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.213182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.213261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.213352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.213377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.213465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.213579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.213603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.213753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.213869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.753 [2024-11-18 16:17:14.213894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.753 qpair failed and we were unable to recover it. 00:30:50.753 [2024-11-18 16:17:14.214031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.214111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.214135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.214256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.214364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.214388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.214468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.214614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.214639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.214725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.214816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.214841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.214925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.215043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.215067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.215150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.215252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.215277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.215402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.215488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.215513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.215622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.215738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.215763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.215868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.215985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.216009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.216112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.216231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.216255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.216341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.216456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.216481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.216562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.216705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.216731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.216817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.216905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.216935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.217013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.217119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.217144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.217285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.217409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.217434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.217553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.217646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.217672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.217764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.217851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.217877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.218019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.218105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.218129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.218246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.218386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.218410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.218493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.218599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.218631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.218712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.218803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.218829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.218921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.219037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.219063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.219154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.219263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.219288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.219379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.219472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.219498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.219585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.219679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.219705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.219798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.219884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.219909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.219997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.220083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.220108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.220191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.220309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.220334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.220473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.220561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.220586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.220709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.220821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.220845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.220946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.221056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.754 [2024-11-18 16:17:14.221081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.754 qpair failed and we were unable to recover it. 00:30:50.754 [2024-11-18 16:17:14.221159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.221275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.221299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.221409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.221547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.221572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.221674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.221790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.221818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.221934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.222018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.222042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.222155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.222245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.222269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.222365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.222480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.222505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.222600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.222687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.222712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.222821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.222902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.222928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.223038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.223128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.223152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.223264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.223382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.223406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.223542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.223637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.223663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.223745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.223833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.223858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.224003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.224115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.224141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.224243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 EAL: No free 2048 kB hugepages reported on node 1 00:30:50.755 [2024-11-18 16:17:14.224356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.224380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.224492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.224615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.224640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.224781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.224897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.224930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.225017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.225098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.225123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.225215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.225296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.225320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.225436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.225543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.225568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.225682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.225757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.225782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.225896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.226019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.226044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.226157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.226247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.226273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.226388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.226466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.226491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.226583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.226710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.226736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.226877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.226960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.226984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.227059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.227197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.227223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.227316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.227393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.227418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.227504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.227579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.227604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.227724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.227814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.227838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.227913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.228024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.228049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.755 qpair failed and we were unable to recover it. 00:30:50.755 [2024-11-18 16:17:14.228155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.228232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.755 [2024-11-18 16:17:14.228256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.228398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.228490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.228517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.228638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.228754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.228780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.228900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.229043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.229068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.229164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.229306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.229330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.229416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.229508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.229532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.229689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.229813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.229838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.229958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.230066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.230090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.230198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.230305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.230330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.230455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.230542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.230567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.230688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.230827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.230851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.230945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.231062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.231086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.231178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.231316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.231340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.231439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.231518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.231543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.231667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.231750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.231775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.231859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.231966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.231990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.232103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.232208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.232233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.232344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.232459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.232484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.232572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.232672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.232697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.232780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.232886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.232911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.233007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.233172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.233196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.233279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.233352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.233376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.233495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.233599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.233642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.233731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.233816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.233841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.233935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.234031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.234055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.234169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.234279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.234303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.234432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.234535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.234559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.234646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.234724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.234749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.234899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.235001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.235025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.235113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.235209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.235233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.235352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.235465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.235490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.235587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.235667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.756 [2024-11-18 16:17:14.235692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.756 qpair failed and we were unable to recover it. 00:30:50.756 [2024-11-18 16:17:14.235804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.235922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.235946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.236036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.236124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.236153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.236332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.236423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.236448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.236539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.236708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.236734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.236857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.236944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.236969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.237114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.237252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.237276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.237394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.237501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.237526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.237637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.237722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.237749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.237895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.237986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.238011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.238104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.238221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.238246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.238327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.238443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.238469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.238579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.238664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.238690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.238804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.238876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.238900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.238994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.239068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.239092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.239187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.239298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.239322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.239438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.239550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.239575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.239699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.239806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.239831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.239952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.240041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.240065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.240154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.240273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.240298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.240417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.240530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.240554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.240657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.240735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.240759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.240868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.240956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.240980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.241127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.241270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.241295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.241380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.241496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.241520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.241665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.241755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.241780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.241873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.242017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.242041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.242163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.242243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.242268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.242374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.242490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.242514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.242595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.242689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.242715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.757 qpair failed and we were unable to recover it. 00:30:50.757 [2024-11-18 16:17:14.242834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.757 [2024-11-18 16:17:14.242924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.242948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.243068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.243142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.243166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.243282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.243361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.243385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.243466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.243587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.243618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.243729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.243838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.243862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.243956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.244045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.244070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.244220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.244339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.244363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.244460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.244567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.244591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.244707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.244821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.244845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.244941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.245029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.245054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.245171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.245283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.245307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.245400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.245512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.245536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.245641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.245748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.245772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.245855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.245946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.245972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.246046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.246153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.246178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.246296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.246380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.246405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.246489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.246564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.246588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.246680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.246786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.246811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.246895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.247008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.247034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.247153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.247242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.247266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.247382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.247471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.247495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.247623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.247713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.247739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.247835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.247958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.247982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.248104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.248185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.248214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.248337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.248442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.248466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.248578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.248690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.248716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.248824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.248932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.248957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.249096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.249239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.249263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.249346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.249466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.249490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.249629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.249708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.249732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.249871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.249958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.249983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.250121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.250230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.250254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.250342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.250423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.250448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.250556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.250659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.250689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.250834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.250967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.250992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.251085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.251236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.251261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.758 qpair failed and we were unable to recover it. 00:30:50.758 [2024-11-18 16:17:14.251359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.758 [2024-11-18 16:17:14.251437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.251462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.251573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.251689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.251714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.251800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.251915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.251940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.252022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.252105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.252130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.252208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.252327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.252352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.252438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.252545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.252570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.252653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.252797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.252822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.252913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.253027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.253052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.253170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.253284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.253308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.253401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.253485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.253509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.253594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.253727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.253752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.253870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.253981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.254006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.254104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.254211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.254235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.254353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.254465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.254489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.254594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.254687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.254712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.254808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.254920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.254944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.255060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.255177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.255202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.255323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.255400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.255425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.255539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.255685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.255711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.255796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.255876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.255901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.255977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.256089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.256114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.256226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.256307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.256331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.256471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.256575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.256599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.256680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.256784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.256809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.256928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.257046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.257071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.257154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.257295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.257320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.257432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.257521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.257545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.257646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.257767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.257791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.257879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.258002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.258027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.258131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.258219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.258244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.258335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.258413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.258437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.258513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.258632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.258657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.258748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.258852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.258877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.258994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.259080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.259105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.259194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.259299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.259324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.259440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.259516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.259540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.759 qpair failed and we were unable to recover it. 00:30:50.759 [2024-11-18 16:17:14.259634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.759 [2024-11-18 16:17:14.259750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.259775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.259864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.259973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.259997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.260114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.260199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.260223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.260341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.260419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.260443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.260532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.260631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.260657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.260765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.260881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.260906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.260988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.261074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.261098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.261189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.261274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.261298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.261422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.261533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.261558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.261674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.261761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.261786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.261896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.262001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.262025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.262139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.262247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.262271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.262386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.262498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.262526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.262640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.262721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.262746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.262859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.262964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.262989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.263099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.263189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.263215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.263323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.263399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.263424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.263541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.263622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.263648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.263732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.263817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.263841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.263936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.264062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.264086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.264199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.264296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.264321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.264445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.264539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.264564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.264726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.264812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.264837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.264948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.265028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.265055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.265151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.265239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.265264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.265372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.265460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.265484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.265601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.265726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.265751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.265838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.265930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.265955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.266050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.266165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.266190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.266286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.266365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.266391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.266487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.266578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.266603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.266728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.266812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.266837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.266926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.267012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.267036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.267159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.267249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.267273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.267393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.267469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.267494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.760 [2024-11-18 16:17:14.267629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.267745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.760 [2024-11-18 16:17:14.267769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.760 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.267914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.267989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.268014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.268152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.268245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.268270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.268356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.268433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.268458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.268604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.268693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.268717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.268827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.268918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.268943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.269031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.269111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.269136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.269255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.269335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.269360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.269449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.269569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.269593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.269701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.269786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.269811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.269960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.270080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.270104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.270246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.270401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.270426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.270515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.270628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.270654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.270771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.270859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.270883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.270972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.271084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.271109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.271216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.271302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.271328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.271438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.271529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.271554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.271646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.271734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.271759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.271864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.271982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.272007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.272088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.272169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.272193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.272307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.272398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.272424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.272536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.272671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.272697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.272790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.272874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.272898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.273011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.273100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.273125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.273266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.273379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.273404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.273487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.273570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.273595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.273680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.273791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.273815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.273909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.274007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.274032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.274141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.274221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.274250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.761 [2024-11-18 16:17:14.274326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.274440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.761 [2024-11-18 16:17:14.274464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.761 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.274579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.274691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.274717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.274807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.274889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.274924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.275003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.275110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.275134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.275217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.275310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.275336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.275456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.275547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.275571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.275673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.275788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.275813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.275913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.276003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.276028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.276124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.276235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.276260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.276264] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:50.762 [2024-11-18 16:17:14.276375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.276466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.276495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.276579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.276696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.276721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.276807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.276889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.276923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.277029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.277134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.277158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.277259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.277373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.277398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.277478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.277586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.277619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.277700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.277816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.277841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.277958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.278049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.278074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.278182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.278295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.278320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.278435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.278523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.278547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.278646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.278759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.278783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.278909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.279001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.279026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.279139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.279256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.279282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.279369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.279450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.279474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.279586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.279696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.279722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.279840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.279932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.279956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:50.762 [2024-11-18 16:17:14.280064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.280151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:50.762 [2024-11-18 16:17:14.280175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:50.762 qpair failed and we were unable to recover it. 00:30:51.040 [2024-11-18 16:17:14.280318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.040 [2024-11-18 16:17:14.280401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.040 [2024-11-18 16:17:14.280426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.040 qpair failed and we were unable to recover it. 00:30:51.040 [2024-11-18 16:17:14.280540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.040 [2024-11-18 16:17:14.280630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.040 [2024-11-18 16:17:14.280656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.040 qpair failed and we were unable to recover it. 00:30:51.040 [2024-11-18 16:17:14.280737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.040 [2024-11-18 16:17:14.280820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.040 [2024-11-18 16:17:14.280844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.040 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.280977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.281053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.281078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.281200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.281319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.281343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.281438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.281577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.281602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.281697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.281775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.281800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.281892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.281985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.282010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.282099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.282181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.282205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.282319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.282412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.282439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.282536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.282637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.282662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.282770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.282888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.282915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.282996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.283076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.283101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.283191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.283284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.283308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.283436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.283521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.283545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.283674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.283768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.283793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.283886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.284002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.284026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.284117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.284207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.284232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.284322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.284400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.284425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.284535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.284656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.284682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.284798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.284881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.284917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.285003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.285099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.285123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.285217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.285365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.285391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.285504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.285584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.285615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.285700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.285795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.285821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.285947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.286064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.286088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.286202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.286289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.286314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.286428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.286537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.286562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.286702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.286808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.286833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.286954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.287060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.287085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.287174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.287267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.041 [2024-11-18 16:17:14.287292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.041 qpair failed and we were unable to recover it. 00:30:51.041 [2024-11-18 16:17:14.287375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.287472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.287497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.287620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.287738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.287762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.287913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.287998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.288022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.288109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.288224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.288253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.288346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.288434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.288458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.288574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.288710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.288736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.288825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.288918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.288942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.289031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.289142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.289166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.289247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.289354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.289379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.289523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.289620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.289646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.289763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.289880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.289915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.290010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.290147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.290172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.290259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.290343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.290367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.290472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.290556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.290585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.290730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.290821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.290846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.290941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.291024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.291049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.291164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.291255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.291279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.291396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.291514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.291538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.291701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.291819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.291843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.291927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.292038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.292062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.292205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.292293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.292318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.292400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.292541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.292566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.292737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.292881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.292915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.293053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.293184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.293215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.293338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.293466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.293496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.293642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.293740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.293765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.293878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.293961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.293987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.294074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.294183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.294208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.042 [2024-11-18 16:17:14.294293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.294397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.042 [2024-11-18 16:17:14.294421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.042 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.294539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.294659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.294684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.294776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.294859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.294883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.294981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.295156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.295181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.295290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.295373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.295399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.295516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.295649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.295674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.295799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.295891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.295916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.296002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.296116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.296141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.296236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.296319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.296343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.296453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.296613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.296645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.296803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.296905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.296934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.297026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.297138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.297165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.297252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.297370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.297398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.297486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.297573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.297601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.297711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.297827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.297853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.297948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.298079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.298105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.298239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.298341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.298371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.298519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.298657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.298691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.298824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.298912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.298937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.299081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.299198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.299222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.299298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.299385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.299409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.299533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.299635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.299660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.299736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.299849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.299878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.299989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.300097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.300121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.300216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.300332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.300356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.300447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.300553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.300577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.300693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.300838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.300862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.300943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.301054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.301078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.301191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.301271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.301296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.043 qpair failed and we were unable to recover it. 00:30:51.043 [2024-11-18 16:17:14.301435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.043 [2024-11-18 16:17:14.301521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.301546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.301641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.301730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.301754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.301839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.301976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.302001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.302115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.302231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.302256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.302375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.302459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.302483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.302564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.302657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.302683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.302770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.302857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.302882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.302979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.303104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.303128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.303239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.303320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.303345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.303439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.303525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.303549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.303669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.303744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.303768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.303855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.303961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.303986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.304077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.304190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.304215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.304322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.304462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.304486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.304584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.304678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.304704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.304820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.304905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.304929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.305036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.305157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.305181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.305268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.305384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.305413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.305500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.305616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.305641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.305762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.305919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.305944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.306066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.306161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.306186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.306274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.306390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.306414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.306498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.306648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.306673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.306766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.306944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.306968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.307043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.307183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.307207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.307326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.307436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.307460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.307582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.307722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.307746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.307862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.307978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.308002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.308125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.308235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.308259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.044 qpair failed and we were unable to recover it. 00:30:51.044 [2024-11-18 16:17:14.308333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.044 [2024-11-18 16:17:14.308416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.308441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.308556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.308670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.308695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.308795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.308941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.308966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.309047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.309135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.309159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.309239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.309319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.309343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.309437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.309541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.309565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.309662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.309780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.309804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.309917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.310039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.310064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.310150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.310235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.310260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.310408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.310514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.310539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.310637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.310755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.310781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.310890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.311003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.311027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.311113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.311228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.311254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.311371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.311457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.311481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.311590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.311678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.311703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.311847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.311988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.312020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.312138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.312221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.312246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.312320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.312459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.312483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.312570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.312653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.312679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.312797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.312904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.312928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.313036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.313130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.313155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.313271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.313385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.313409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.313500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.313625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.313650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.313763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.313875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.313899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.045 qpair failed and we were unable to recover it. 00:30:51.045 [2024-11-18 16:17:14.313986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.045 [2024-11-18 16:17:14.314129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.314153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.314236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.314349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.314373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.314484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.314569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.314594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.314715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.314803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.314828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.314935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.315076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.315100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.315215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.315338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.315363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.315469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.315551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.315579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.315688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.315825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.315849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.315935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.316037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.316061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.316149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.316257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.316281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.316399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.316511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.316536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.316647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.316738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.316762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.316873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.316957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.316981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.317086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.317169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.317193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.317302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.317381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.317406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.317496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.317615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.317645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.317728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.317814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.317839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.317942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.318023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.318047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.318121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.318224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.318249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.318366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.318446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.318471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.318555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.318672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.318698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.318812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.318899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.318924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.319068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.319151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.319176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.319320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.319405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.319429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.319545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.319661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.319687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.319776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.319894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.319918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.320000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.320089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.320115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.320228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.320343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.320368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.320455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.320534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.046 [2024-11-18 16:17:14.320558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.046 qpair failed and we were unable to recover it. 00:30:51.046 [2024-11-18 16:17:14.320656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.320742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.320766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.320858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.320948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.320973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.321090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.321178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.321203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.321286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.321394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.321419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.321533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.321642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.321668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.321784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.321873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.321897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.322021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.322137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.322161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.322278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.322385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.322410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.322494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.322580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.322605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.322698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.322814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.322839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.322955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.323095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.323119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.323229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.323346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.323370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.323483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.323569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.323594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.323718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.323827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.323851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.323970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.324058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.324083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.324172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.324261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.324285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.324403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.324511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.324536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.324693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.324832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.324860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.324965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.325103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.325129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.325223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.325342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.325366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.325482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.325569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.325601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.325750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.325882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.325906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.326032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.326114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.326139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.326284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.326398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.326423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.326504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.326590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.326632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.326717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.326802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.326826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.326923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.327036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.327061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.327172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.327293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.327318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.047 qpair failed and we were unable to recover it. 00:30:51.047 [2024-11-18 16:17:14.327410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.327549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.047 [2024-11-18 16:17:14.327575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.327676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.327831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.327855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.327947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.328050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.328075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.328158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.328303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.328328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.328421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.328506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.328530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.328645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.328753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.328778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.328890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.328979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.329004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.329091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.329175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.329201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.329291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.329380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.329405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.329485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.329586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.329629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.329770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.329891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.329916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.330063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.330145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.330171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.330313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.330399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.330425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.330566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.330671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.330697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.330801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.330892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.330917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.331041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.331129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.331153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.331262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.331374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.331399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.331519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.331629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.331655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.331755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.331835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.331861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.331958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.332052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.332081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.332179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.332301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.332326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.332443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.332560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.332584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.332730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.332825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.332852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.332985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.333096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.333121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.333221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.333337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.333362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.333477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.333562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.333586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.333740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.333887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.333920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.334095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.334222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.334252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.334389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.334502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.334527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.048 qpair failed and we were unable to recover it. 00:30:51.048 [2024-11-18 16:17:14.334635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.048 [2024-11-18 16:17:14.334727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.334753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.334885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.335007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.335032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.335174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.335286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.335311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.335460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.335588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.335627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.335753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.335835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.335860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.335994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.336101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.336125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.336239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.336336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.336360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.336468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.336561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.336587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.336749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.336855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.336881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.337017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.337132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.337157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.337277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.337354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.337379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.337498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.337580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.337604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.337742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.337850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.337874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.337989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.338089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.338119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.338227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.338346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.338372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.338483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.338619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.338646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.338761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.338877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.338909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.339021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.339111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.339137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.339251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.339354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.339380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.339491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.339617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.339643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.339770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.339867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.339901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.340000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.340116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.340142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.340251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.340332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.340357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.340448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.340560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.340585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.340756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.340845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.340870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.341023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.341111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.341136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.341255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.341364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.341389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.341472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.341553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.341578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.341698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.341839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.049 [2024-11-18 16:17:14.341863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.049 qpair failed and we were unable to recover it. 00:30:51.049 [2024-11-18 16:17:14.342015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.342100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.342124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.342221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.342340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.342365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.342482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.342567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.342591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.342696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.342777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.342802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.342921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.343005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.343029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.343115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.343209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.343234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.343312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.343396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.343421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.343513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.343625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.343651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.343731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.343807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.343831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.343948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.344094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.344119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.344208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.344352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.344377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.344467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.344582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.344621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.344732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.344817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.344843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.344962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.345085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.345109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.345201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.345280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.345305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.345384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.345480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.345512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.345624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.345708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.345734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.345825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.345951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.345975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.346070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.346184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.346208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.346313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.346399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.346424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.346567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.346673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.346699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.346786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.346869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.346893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.347009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.347113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.347142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.347225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.347337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.347362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.347483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.347601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.347634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.050 qpair failed and we were unable to recover it. 00:30:51.050 [2024-11-18 16:17:14.347720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.347837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.050 [2024-11-18 16:17:14.347861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.347948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.348060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.348084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.348172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.348261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.348286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.348376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.348456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.348480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.348596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.348697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.348722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.348815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.348974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.348999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.349083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.349199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.349223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.349342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.349435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.349461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.349554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.349681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.349707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.349782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.349897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.349927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.350005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.350092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.350117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.350257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.350362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.350387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.350481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.350564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.350589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.350721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.350812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.350836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.350952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.351039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.351064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.351151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.351230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.351255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.351348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.351452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.351477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.351572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.351688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.351713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.351794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.351919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.351944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.352030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.352174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.352199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.352288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.352397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.352422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.352505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.352591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.352627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.352710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.352800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.352826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.352931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.353074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.353099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.353204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.353295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.353319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.353401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.353481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.353507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.353625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.353712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.353739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.353828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.353931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.353955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.354071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.354147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.354173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.051 qpair failed and we were unable to recover it. 00:30:51.051 [2024-11-18 16:17:14.354292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.051 [2024-11-18 16:17:14.354375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.354400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.354497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.354597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.354628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.354726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.354805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.354829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.354955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.355044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.355068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.355182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.355295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.355319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.355438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.355526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.355551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.355641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.355762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.355786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.355898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.356014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.356039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.356178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.356331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.356356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.356449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.356568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.356595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.356731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.356848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.356874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.356982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.357062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.357087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.357197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.357306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.357330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.357437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.357557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.357582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.357703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.357818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.357844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.357960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.358070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.358095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.358208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.358324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.358349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.358434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.358540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.358565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.358683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.358772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.358796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.358915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.359024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.359052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.359145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.359247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.359271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.359422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.359501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.359525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.359631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.359777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.359802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.359921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.360007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.360032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.360147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.360223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.360247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.360336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.360447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.360471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.360558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.360633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.360657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.360774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.360861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.360886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.361032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.361112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.052 [2024-11-18 16:17:14.361137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.052 qpair failed and we were unable to recover it. 00:30:51.052 [2024-11-18 16:17:14.361244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.361368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.361392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.361517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.361638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.361663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.361763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.361873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.361897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.361979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.362059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.362083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.362167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.362275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.362299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.362418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.362511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.362535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.362630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.362720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.362744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.362861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.363006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.363029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.363140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.363231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.363254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.363345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.363438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.363462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.363577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.363673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.363699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.363822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.363918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.363942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.364057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.364165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.364189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.364333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.364419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.364445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.364532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.364640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.364666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.364784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.364905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.364930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.365022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.365148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.365174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.365289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.365377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.365403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.365552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.365671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.365696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.365780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.365895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.365920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.366012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.366092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.366117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.366236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.366354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.366378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.366489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.366636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.366662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.366803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.366920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.366945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.367065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.367148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.367172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.367315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.367407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.367430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.367566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.367664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.367689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.053 [2024-11-18 16:17:14.367786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.367904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.053 [2024-11-18 16:17:14.367929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.053 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.368039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.368147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.368171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.368251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.368334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.368358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.368476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.368582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.368614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.368693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.368812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.368837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.368932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.369035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.369058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.369146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.369262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.369286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.369403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.369518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.369541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.369648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.369757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.369782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.369875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.369991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.370014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.370124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.370216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.370240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.370354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.370468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.370492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.370599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.370697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.370721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.370803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.370942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.370967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.371109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.371242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.371270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.371382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.371497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.371522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.371641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.371784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.371807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.371894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.371982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.372005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.372122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.372259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.372283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.372387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.372496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.372520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.372644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.372781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.372805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.372898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.373007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.373031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.373145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.373264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.373288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.373400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.373487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.373513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.373631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.373730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.373754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.054 qpair failed and we were unable to recover it. 00:30:51.054 [2024-11-18 16:17:14.373847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.373937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.054 [2024-11-18 16:17:14.373961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.374074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.374160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.374183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.374296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.374410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.374434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.374553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.374667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.374692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.374779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.374865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.374889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.375004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.375081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.375105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.375188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.375273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.375299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.375396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.375494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.375519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.375627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.375702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.375727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.375806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.375913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.375937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.376080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.376159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.376183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.376299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.376372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.376396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.376509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.376591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.376623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.376743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.376888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.376912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.376995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.377134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.377158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.377242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.377329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.377354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.377465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.377546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.377569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.377653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.377748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.377773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.377887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.377966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.377991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.378097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.378187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.378211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.378310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.378395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.378419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.378534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.378617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.378642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.378724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.378807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.378833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.378949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.379037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.379062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.379137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.379215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.379239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.379316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.379403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.379429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.379506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.379549] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:51.055 [2024-11-18 16:17:14.379578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.379603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.379694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.379726] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:51.055 [2024-11-18 16:17:14.379784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.055 [2024-11-18 16:17:14.379783] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:51.055 [2024-11-18 16:17:14.379811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.055 [2024-11-18 16:17:14.379815] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:51.055 qpair failed and we were unable to recover it. 00:30:51.055 [2024-11-18 16:17:14.379897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.379907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:51.056 [2024-11-18 16:17:14.380000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.380024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 wit[2024-11-18 16:17:14.379941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:51.056 h addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.379988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:51.056 [2024-11-18 16:17:14.379997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:51.056 [2024-11-18 16:17:14.380130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.380219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.380242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.380337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.380423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.380447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.380539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.380642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.380668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.380761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.380875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.380900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.380999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.381112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.381137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.381253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.381339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.381364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.381452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.381563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.381588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.381696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.381787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.381817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.381941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.382033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.382058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.382142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.382254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.382278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.382364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.382477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.382503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.382581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.382667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.382693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.382785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.382865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.382890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.382982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.383066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.383090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.383198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.383274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.383299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.383407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.383503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.383527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.383647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.383742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.383766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.383884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.383982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.384006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.384119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.384232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.384256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.384341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.384422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.384451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.384548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.384639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.384664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.384777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.384918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.384942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.385054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.385165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.385190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.385296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.385379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.385403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.385491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.385576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.385600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.385687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.385794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.385818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.056 qpair failed and we were unable to recover it. 00:30:51.056 [2024-11-18 16:17:14.385926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.386032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.056 [2024-11-18 16:17:14.386055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.386167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.386241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.386265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.386377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.386494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.386518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.386630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.386723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.386752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.386831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.386924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.386949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.387064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.387143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.387167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.387248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.387325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.387350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.387427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.387512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.387535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.387644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.387722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.387745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.387823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.387913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.387937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.388016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.388135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.388160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.388277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.388385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.388409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.388483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.388570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.388594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.388769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.388863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.388887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.388985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.389111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.389135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.389218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.389300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.389324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.389414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.389490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.389514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.389620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.389733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.389758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.389839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.389951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.389976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.390058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.390167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.390191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.390270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.390393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.390417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.390499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.390613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.390638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.390750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.390827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.390851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.390968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.391052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.391076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.391162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.391260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.391284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.391406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.391492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.391517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.391596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.391697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.391721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.391810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.391893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.391918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.392012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.392117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.392142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.057 qpair failed and we were unable to recover it. 00:30:51.057 [2024-11-18 16:17:14.392262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.057 [2024-11-18 16:17:14.392349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.392373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.392468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.392559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.392584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.392730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.392892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.392921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.393039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.393130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.393156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.393272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.393358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.393383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.393471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.393564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.393589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.393686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.393770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.393794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.393889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.393969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.393995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.394081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.394196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.394221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.394311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.394396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.394420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.394503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.394626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.394653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.394745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.394827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.394852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.394967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.395044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.395068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.395150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.395243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.395268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.395351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.395432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.395456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.395537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.395664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.395689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.395781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.395867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.395891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.396014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.396124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.396148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.396254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.396334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.396358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.396468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.396547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.396571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.396726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.396807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.396832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.396959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.397045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.397069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.397153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.397240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.397263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.397355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.397457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.397482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.397560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.397651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.397676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.397761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.397839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.397867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.397979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.398087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.398111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.398216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.398314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.398339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.058 qpair failed and we were unable to recover it. 00:30:51.058 [2024-11-18 16:17:14.398422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.058 [2024-11-18 16:17:14.398503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.398527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.398619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.398739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.398764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.398880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.398959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.398983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.399069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.399157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.399182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.399258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.399372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.399397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.399508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.399594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.399629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.399720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.399796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.399820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.399933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.400050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.400074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.400167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.400247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.400272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.400384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.400469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.400494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.400644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.400750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.400775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.400887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.400964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.400989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.401098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.401199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.401224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.401306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.401382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.401406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.401514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.401599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.401630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.401709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.401793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.401817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.401934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.402032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.402057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.402142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.402247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.402270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.402387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.402472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.402496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.402613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.402701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.402725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.402836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.403001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.403025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.403119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.403211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.403235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.403342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.403426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.403450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.403535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.403621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.403646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.403726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.403817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.059 [2024-11-18 16:17:14.403842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.059 qpair failed and we were unable to recover it. 00:30:51.059 [2024-11-18 16:17:14.403930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.404023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.404048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.404131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.404214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.404239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.404355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.404433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.404457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.404545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.404637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.404663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.404774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.404852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.404877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.404968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.405057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.405081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.405175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.405253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.405277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.405357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.405435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.405460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.405556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.405689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.405714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.405797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.405884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.405908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.406019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.406107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.406131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.406221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.406331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.406356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.406436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.406516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.406540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.406644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.406738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.406762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.406849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.406963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.406987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.407083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.407157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.407181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.407270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.407383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.407408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.407521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.407632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.407657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.407748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.407836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.407860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.407959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.408070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.408095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.408185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.408297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.408320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.408405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.408518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.408542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.408649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.408731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.408755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.408858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.408945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.408974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.409082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.409160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.409184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.409298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.409382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.409409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.409491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.409654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.409681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.409797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.409878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.409903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.060 qpair failed and we were unable to recover it. 00:30:51.060 [2024-11-18 16:17:14.409995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.060 [2024-11-18 16:17:14.410095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.410119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.410256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.410346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.410372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.410456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.410569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.410593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.410684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.410768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.410793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.410889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.410966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.410990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.411082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.411174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.411198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.411295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.411380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.411404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.411493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.411599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.411629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.411718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.411799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.411822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.411934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.412042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.412066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.412149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.412235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.412259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.412349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.412463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.412488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.412574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.412714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.412740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.412825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.412933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.412958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.413050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.413137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.413162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.413279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.413360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.413385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.413471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.413555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.413579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.413709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.413789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.413814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.413929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.414020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.414045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.414123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.414260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.414284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.414391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.414504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.414528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.414626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.414742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.414766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.414849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.414948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.414972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.415065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.415151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.415175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.415267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.415373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.415398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.415488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.415568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.415602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.415717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.415824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.415853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.415957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.416052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.416078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.416212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.416294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.061 [2024-11-18 16:17:14.416320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.061 qpair failed and we were unable to recover it. 00:30:51.061 [2024-11-18 16:17:14.416405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.416481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.416507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.416593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.416708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.416734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.416822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.416961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.416986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.417110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.417193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.417218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.417317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.417422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.417447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.417532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.417641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.417667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.417752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.417845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.417871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.417980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.418055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.418080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.418206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.418298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.418322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.418425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.418547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.418573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.418670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.418753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.418794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.418877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.418971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.418995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.419082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.419196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.419221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.419315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.419432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.419457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.419574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.419660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.419697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.419797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.419874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.419898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.419980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.420058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.420083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.420201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.420291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.420316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.420415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.420526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.420553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.420645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.420744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.420769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.420850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.420984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.421008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.421130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.421236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.421261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.421348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.421431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.421456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.421537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.421644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.421669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.421772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.421860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.421894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.421977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.422090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.422115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b4000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.422230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.422373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.422405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.422522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.422672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.422704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.062 qpair failed and we were unable to recover it. 00:30:51.062 [2024-11-18 16:17:14.422816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.422914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.062 [2024-11-18 16:17:14.422943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.423113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.423208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.423237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.423372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.423493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.423523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.423664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.423758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.423787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.423897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.423993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.424023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.424127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.424220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.424248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.424364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.424466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.424494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.424619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.424713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.424741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.424855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.424952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.424980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.425101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.425209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.425238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.425356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.425446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.425475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.425577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.425689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.425725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.425832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.425971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.426000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.426104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.426234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.426263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.426384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.426474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.426501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.426587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.426712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.426740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.426820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.426906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.426932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.427031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.427131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.427157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.427266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.427343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.427367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.427461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.427548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.427574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.427692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.427785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.427810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.427899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.427972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.427996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.428112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.428220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.428244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.428327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.428409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.428433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.428513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.428593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.428625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.428743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.428825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.063 [2024-11-18 16:17:14.428848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.063 qpair failed and we were unable to recover it. 00:30:51.063 [2024-11-18 16:17:14.428925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.429006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.429031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.429120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.429234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.429259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.429338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.429422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.429445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.429522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.429599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.429638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.429721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.429796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.429821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.429911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.429992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.430016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.430129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.430224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.430250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.430341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.430424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.430449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.430540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.430627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.430653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.430735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.430813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.430840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.430948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.431068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.431094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.431176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.431250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.431275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.431361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.431436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.431462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.431554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.431637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.431667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.431767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.431844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.431869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.431967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.432054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.432080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.432194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.432278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.432302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.432385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.432479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.432505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.432587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.432707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.432733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.432820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.432900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.432927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.433005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.433078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.433103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.433185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.433264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.433289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.433402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.433483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.433508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.433597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.433698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.433728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.433817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.433908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.433933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.434020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.434105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.434131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.434243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.434323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.434347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.434432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.434575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.064 [2024-11-18 16:17:14.434601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.064 qpair failed and we were unable to recover it. 00:30:51.064 [2024-11-18 16:17:14.434703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.434804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.434829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.434914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.434994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.435018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.435100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.435216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.435242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.435324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.435408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.435433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.435523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.435605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.435637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.435719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.435814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.435844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.435957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.436082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.436109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.436212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.436296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.436322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.436411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.436521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.436546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.436645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.436735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.436760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.436850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.436945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.436971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.437051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.437202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.437227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.437306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.437444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.437470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.437590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.437708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.437734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.437817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.437935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.437961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.438043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.438122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.438148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.438231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.438346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.438371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.438482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.438615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.438640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.438724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.438801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.438825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.438934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.439073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.439099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.439189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.439278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.439302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.439387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.439467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.439492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.439571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.439653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.439677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.439765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.439843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.439869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.439945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.440034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.440059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.440149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.440253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.440278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.440369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.440449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.440473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.440560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.440651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.440676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.065 qpair failed and we were unable to recover it. 00:30:51.065 [2024-11-18 16:17:14.440767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.065 [2024-11-18 16:17:14.440849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.440873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.440993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.441077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.441102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.441194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.441279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.441304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.441385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.441463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.441487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.441613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.441692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.441716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.441806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.441891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.441916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.442010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.442093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.442117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.442233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.442334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.442359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.442482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.442559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.442584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.442707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.442818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.442843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.442961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.443037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.443061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.443141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.443232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.443259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.443351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.443460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.443485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.443582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.443702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.443727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.443811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.443895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.443921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.444005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.444129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.444154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.444296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.444386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.444412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.444490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.444613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.444638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.444724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.444813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.444838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.444953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.445028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.445052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.445136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.445246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.445271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.445362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.445494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.445520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.445642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.445724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.445748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.445835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.445927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.445952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.446035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.446113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.446137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.446217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.446304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.446329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.446423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.446513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.446539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.446653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.446742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.446767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.446855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.446937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.066 [2024-11-18 16:17:14.446964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.066 qpair failed and we were unable to recover it. 00:30:51.066 [2024-11-18 16:17:14.447067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.447147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.447172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.447260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.447345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.447370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.447465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.447571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.447597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.447695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.447783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.447808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.447890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.448036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.448062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.448174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.448289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.448313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.448439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.448525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.448550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.448632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.448719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.448745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.448834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.448927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.448952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.449056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.449189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.449217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.449339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.449417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.449442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.449538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.449647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.449675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.449796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.449894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.449918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.449999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.450079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.450106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.450197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.450279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.450303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.450382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.450457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.450482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.450572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.450692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.450718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.450804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.450885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.450909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.451016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.451134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.451158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.451250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.451333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.451358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.451442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.451527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.451551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.451632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.451710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.451733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.451843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.451926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.451952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.452042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.452127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.452154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.452294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.452380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.452405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.452493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.452571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.452596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.452683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.452769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.452794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.452884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.452976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.453001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.067 qpair failed and we were unable to recover it. 00:30:51.067 [2024-11-18 16:17:14.453109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.067 [2024-11-18 16:17:14.453183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.453208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.453294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.453411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.453438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.453528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.453614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.453639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.453745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.453831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.453855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.453972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.454052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.454077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.454162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.454233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.454256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.454346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.454453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.454478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.454571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.454667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.454693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.454779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.454868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.454892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.454981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.455059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.455083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.455203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.455280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.455303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.455383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.455466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.455494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.455580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.455684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.455710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.455819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.455933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.455958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.456042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.456137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.456166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.456251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.456329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.456354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.456437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.456517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.456542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.456641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.456726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.456751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.456838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.456921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.456945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.457036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.457121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.457145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.457230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.457321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.457345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.457424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.457535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.457560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.457665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.457751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.457776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.457865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.457941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.457966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.458045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.458135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.068 [2024-11-18 16:17:14.458159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.068 qpair failed and we were unable to recover it. 00:30:51.068 [2024-11-18 16:17:14.458239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.458336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.458360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1601f20 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.458467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.458907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.458939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.459042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.459140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.459166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.459263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.459349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.459374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.459500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.459579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.459603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.459690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.459778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.459803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.459891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.459975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.460001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.460115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.460194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.460220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.460301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.460375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.460399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.460477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.460579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.460613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.460703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.460795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.460820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.460902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.460977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.461001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.461090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.461183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.461209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.461300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.461384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.461409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.461496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.461589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.461621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.461714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.461795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.461821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.461907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.461996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.462021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.462122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.462218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.462243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.462333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.462422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.462447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.462541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.462642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.462669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.462759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.462849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.462875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.462960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.463034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.463058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.463142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.463223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.463248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.463325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.463404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.463429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.463545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.463639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.463664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.463748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.463835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.463860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.463934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.464020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.464045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.464130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.464208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.464232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.069 qpair failed and we were unable to recover it. 00:30:51.069 [2024-11-18 16:17:14.464313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.464401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.069 [2024-11-18 16:17:14.464426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.464509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.464590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.464622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.464709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.464784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.464809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.464901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.464987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.465011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.465096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.465189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.465214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.465329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.465416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.465441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.465527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.465619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.465644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.465736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.465822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.465846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.465935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.466015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.466039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.466166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.466249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.466275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.466365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.466452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.466476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.466567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.466662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.466688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.466782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.466893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.466919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.467004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.467114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.467139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.467217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.467324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.467349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.467443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.467556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.467582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.467682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.467762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.467787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.467876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.467984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.468009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.468104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.468190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.468217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.468322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.468473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.468498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.468574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.468672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.468697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.468804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.468918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.468944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.469058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.469179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.469202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.469289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.469364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.469388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.469464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.469541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.469566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.469696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.469816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.469842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.469925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.470002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.470028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.470108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.470196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.470222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.470306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.470426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.070 [2024-11-18 16:17:14.470451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.070 qpair failed and we were unable to recover it. 00:30:51.070 [2024-11-18 16:17:14.470558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.470667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.470694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.470777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.470868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.470893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.470977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.471090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.471117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.471201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.471280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.471305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.471450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.471543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.471569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.471660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.471752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.471776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.471859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.471932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.471956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.472041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.472119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.472144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.472232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.472306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.472330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.472419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.472501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.472526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.472616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.472699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.472724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.472803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.472883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.472906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.472986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.473064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.473089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.473175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.473259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.473283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.473374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.473461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.473486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.473563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.473654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.473681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.473766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.473868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.473892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.473978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.474071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.474096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.474187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.474268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.474292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.474411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.474505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.474529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.474622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.474705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.474731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.474831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.474936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.474960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.475058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.475145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.475169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.475298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.475375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.475400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.475479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.475562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.475586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.475679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.475759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.475784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.475862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.475962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.475986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.476096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.476173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.476197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.071 qpair failed and we were unable to recover it. 00:30:51.071 [2024-11-18 16:17:14.476301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.071 [2024-11-18 16:17:14.476382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.476406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.476491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.476567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.476600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.476699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.476791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.476817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.476904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.477020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.477045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.477127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.477211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.477236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.477320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.477402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.477428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.477539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.477647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.477674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.477757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.477840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.477866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.477955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.478060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.478085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.478192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.478300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.478325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.478416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.478510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.478536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.478645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.478732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.478757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.478850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.478935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.478965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.479422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.479512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.479538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.479655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.479735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.479760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.479845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.479933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.479957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.480038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.480174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.480199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.480288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.480367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.480391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.480505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.480603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.480634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.480730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.480838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.480863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.480945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.481440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.481468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.481590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.481690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.481716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.072 qpair failed and we were unable to recover it. 00:30:51.072 [2024-11-18 16:17:14.481802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.072 [2024-11-18 16:17:14.481892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.481923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.482040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.482121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.482145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.482230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.482304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.482328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.482413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.482525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.482550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.482641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.482726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.482749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.482836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.482914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.482940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.483031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.483115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.483139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.483233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.483348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.483373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.483470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.483554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.483578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.483679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.483762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.483786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.483872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.484010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.484043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.484156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.484243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.484268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.484357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.484445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.484469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.484581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.484665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.484690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.484782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.484866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.484890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.485042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.485126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.485151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.485242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.485350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.485375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.485467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.485551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.485575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.485667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.485765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.485789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.485876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.485970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.485995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.486083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.486167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.486196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.486344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.486430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.486455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.486538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.486660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.486687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.486805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.486891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.486916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.487012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.487102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.487127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.487274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.487392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.487417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.487505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.487597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.487629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.487741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.487824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.487850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.073 qpair failed and we were unable to recover it. 00:30:51.073 [2024-11-18 16:17:14.487963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.488050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.073 [2024-11-18 16:17:14.488075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.488160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.488272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.488297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.488379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.488469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.488494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.488577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.488670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.488696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.488773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.488862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.488888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.488985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.489125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.489150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.489243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.489323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.489348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.489440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.489523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.489548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.489641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.489754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.489778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.489871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.489970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.489997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.490077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.490193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.490217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.490329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.490419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.490443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.490529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.490614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.490639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.490726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.490841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.490866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.490954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.491038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.491062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.491149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.491237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.491262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.491352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.491436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.491460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.491558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.491670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.491697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.491810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.491890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.491915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.491999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.492118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.492143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.492261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.492342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.492366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.492456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.492534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.492559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.492642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.492739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.492763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.492847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.492937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.492962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.493049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.493130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.493155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.493276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.493360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.493385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.493475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.493583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.493620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.493712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.493826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.493851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.493938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.494095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.074 [2024-11-18 16:17:14.494120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.074 qpair failed and we were unable to recover it. 00:30:51.074 [2024-11-18 16:17:14.494199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.494338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.494363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.494452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.494538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.494563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.494647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.494730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.494756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.494866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.494960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.494985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.495081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.495187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.495211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.495331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.495417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.495441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.495531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.495617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.495643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.495737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.495826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.495850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.495936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.496017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.496042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.496122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.496199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.496224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.496302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.496386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.496410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.496493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.496574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.496600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.496699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.496823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.496848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.496937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.497029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.497054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.497169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.497281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.497307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.497394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.497534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.497559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.497643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.497729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.497754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.497841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.497949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.497974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.498063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.498153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.498178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.498294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.498376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.498401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.498499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.498621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.498648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.498762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.498848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.498874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.498958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.499034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.499058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.499146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.499242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.499267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.499365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.499474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.499499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.499584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.499669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.499694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.499776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.499886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.499911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.499998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.500086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.500110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.075 qpair failed and we were unable to recover it. 00:30:51.075 [2024-11-18 16:17:14.500195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.075 [2024-11-18 16:17:14.500287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.500312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.500406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.500518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.500543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.500656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.500736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.500761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.500845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.500922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.500947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.501035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.501126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.501150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.501236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.501362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.501387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96c0000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 A controller has encountered a failure and is being reset. 00:30:51.076 [2024-11-18 16:17:14.501526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.501646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.501675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.501779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.501870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.501896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.501989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.502074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.502100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.502214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.502308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.502333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.502423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.502502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.502528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.502628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.502718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.502746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.502831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.502918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.502944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.503031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.503176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.503202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.503286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.503430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.503455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.503574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.503664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.503691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.503811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.503904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.503930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.504020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.504113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.504137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.504226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.504312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.504338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.504456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.504544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.504569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.504661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.504754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.504779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.504864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.504943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.504968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.505051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.505130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.505155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.505255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.505341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.505366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.505449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.505524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.505548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.505630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.505713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.505738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f96b8000b90 with addr=10.0.0.2, port=4420 00:30:51.076 qpair failed and we were unable to recover it. 00:30:51.076 [2024-11-18 16:17:14.505864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.506007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:51.076 [2024-11-18 16:17:14.506036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x160f980 with addr=10.0.0.2, port=4420 00:30:51.076 [2024-11-18 16:17:14.506055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x160f980 is same with the state(5) to be set 00:30:51.076 [2024-11-18 16:17:14.506080] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x160f980 (9): Bad file descriptor 00:30:51.076 [2024-11-18 16:17:14.506099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:51.076 [2024-11-18 16:17:14.506113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:51.076 [2024-11-18 16:17:14.506130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:51.076 Unable to reset the controller. 00:30:51.076 16:17:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:51.077 16:17:14 -- common/autotest_common.sh@862 -- # return 0 00:30:51.077 16:17:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:51.077 16:17:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:51.077 16:17:14 -- common/autotest_common.sh@10 -- # set +x 00:30:51.077 16:17:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:51.077 16:17:14 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:51.077 16:17:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:51.077 16:17:14 -- common/autotest_common.sh@10 -- # set +x 00:30:51.335 Malloc0 00:30:51.335 16:17:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:51.335 16:17:14 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:51.335 16:17:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:51.335 16:17:14 -- common/autotest_common.sh@10 -- # set +x 00:30:51.335 [2024-11-18 16:17:14.628151] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:51.335 16:17:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:51.335 16:17:14 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:51.335 16:17:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:51.335 16:17:14 -- common/autotest_common.sh@10 -- # set +x 00:30:51.335 16:17:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:51.335 16:17:14 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:51.335 16:17:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:51.335 16:17:14 -- common/autotest_common.sh@10 -- # set +x 00:30:51.335 16:17:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:51.335 16:17:14 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:51.335 16:17:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:51.335 16:17:14 -- common/autotest_common.sh@10 -- # set +x 00:30:51.335 [2024-11-18 16:17:14.656444] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:51.335 16:17:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:51.335 16:17:14 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:51.335 16:17:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:51.335 16:17:14 -- common/autotest_common.sh@10 -- # set +x 00:30:51.335 16:17:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:51.335 16:17:14 -- host/target_disconnect.sh@58 -- # wait 1717268 00:30:52.268 Controller properly reset. 00:30:57.526 Initializing NVMe Controllers 00:30:57.526 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:57.526 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:57.526 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:57.526 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:57.526 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:57.526 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:57.526 Initialization complete. Launching workers. 00:30:57.526 Starting thread on core 1 00:30:57.526 Starting thread on core 2 00:30:57.526 Starting thread on core 3 00:30:57.526 Starting thread on core 0 00:30:57.526 16:17:20 -- host/target_disconnect.sh@59 -- # sync 00:30:57.526 00:30:57.526 real 0m11.480s 00:30:57.526 user 0m36.201s 00:30:57.526 sys 0m7.611s 00:30:57.526 16:17:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:57.526 16:17:20 -- common/autotest_common.sh@10 -- # set +x 00:30:57.526 ************************************ 00:30:57.526 END TEST nvmf_target_disconnect_tc2 00:30:57.526 ************************************ 00:30:57.526 16:17:20 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:57.526 16:17:20 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:57.526 16:17:20 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:57.526 16:17:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:57.526 16:17:20 -- nvmf/common.sh@116 -- # sync 00:30:57.526 16:17:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:57.526 16:17:20 -- nvmf/common.sh@119 -- # set +e 00:30:57.526 16:17:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:57.526 16:17:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:57.526 rmmod nvme_tcp 00:30:57.526 rmmod nvme_fabrics 00:30:57.527 rmmod nvme_keyring 00:30:57.527 16:17:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:57.527 16:17:20 -- nvmf/common.sh@123 -- # set -e 00:30:57.527 16:17:20 -- nvmf/common.sh@124 -- # return 0 00:30:57.527 16:17:20 -- nvmf/common.sh@477 -- # '[' -n 1717811 ']' 00:30:57.527 16:17:20 -- nvmf/common.sh@478 -- # killprocess 1717811 00:30:57.527 16:17:20 -- common/autotest_common.sh@936 -- # '[' -z 1717811 ']' 00:30:57.527 16:17:20 -- common/autotest_common.sh@940 -- # kill -0 1717811 00:30:57.527 16:17:20 -- common/autotest_common.sh@941 -- # uname 00:30:57.527 16:17:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:57.527 16:17:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1717811 00:30:57.527 16:17:20 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:57.527 16:17:20 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:57.527 16:17:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1717811' 00:30:57.527 killing process with pid 1717811 00:30:57.527 16:17:20 -- common/autotest_common.sh@955 -- # kill 1717811 00:30:57.527 16:17:20 -- common/autotest_common.sh@960 -- # wait 1717811 00:30:57.527 16:17:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:57.527 16:17:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:57.527 16:17:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:57.527 16:17:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:57.527 16:17:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:57.527 16:17:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:57.527 16:17:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:57.527 16:17:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:59.429 16:17:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:59.429 00:30:59.429 real 0m16.510s 00:30:59.429 user 1m2.382s 00:30:59.429 sys 0m10.061s 00:30:59.429 16:17:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:59.429 16:17:22 -- common/autotest_common.sh@10 -- # set +x 00:30:59.429 ************************************ 00:30:59.429 END TEST nvmf_target_disconnect 00:30:59.429 ************************************ 00:30:59.429 16:17:22 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:59.429 16:17:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:59.429 16:17:22 -- common/autotest_common.sh@10 -- # set +x 00:30:59.429 16:17:22 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:59.429 00:30:59.429 real 22m59.253s 00:30:59.429 user 67m12.392s 00:30:59.429 sys 5m25.714s 00:30:59.429 16:17:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:59.429 16:17:22 -- common/autotest_common.sh@10 -- # set +x 00:30:59.429 ************************************ 00:30:59.429 END TEST nvmf_tcp 00:30:59.429 ************************************ 00:30:59.429 16:17:23 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:59.429 16:17:23 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:59.429 16:17:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:59.429 16:17:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:59.429 16:17:23 -- common/autotest_common.sh@10 -- # set +x 00:30:59.429 ************************************ 00:30:59.429 START TEST spdkcli_nvmf_tcp 00:30:59.429 ************************************ 00:30:59.429 16:17:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:59.688 * Looking for test storage... 00:30:59.688 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:59.688 16:17:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:59.688 16:17:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:59.688 16:17:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:59.688 16:17:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:59.688 16:17:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:59.688 16:17:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:59.688 16:17:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:59.688 16:17:23 -- scripts/common.sh@335 -- # IFS=.-: 00:30:59.688 16:17:23 -- scripts/common.sh@335 -- # read -ra ver1 00:30:59.688 16:17:23 -- scripts/common.sh@336 -- # IFS=.-: 00:30:59.688 16:17:23 -- scripts/common.sh@336 -- # read -ra ver2 00:30:59.688 16:17:23 -- scripts/common.sh@337 -- # local 'op=<' 00:30:59.689 16:17:23 -- scripts/common.sh@339 -- # ver1_l=2 00:30:59.689 16:17:23 -- scripts/common.sh@340 -- # ver2_l=1 00:30:59.689 16:17:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:59.689 16:17:23 -- scripts/common.sh@343 -- # case "$op" in 00:30:59.689 16:17:23 -- scripts/common.sh@344 -- # : 1 00:30:59.689 16:17:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:59.689 16:17:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:59.689 16:17:23 -- scripts/common.sh@364 -- # decimal 1 00:30:59.689 16:17:23 -- scripts/common.sh@352 -- # local d=1 00:30:59.689 16:17:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:59.689 16:17:23 -- scripts/common.sh@354 -- # echo 1 00:30:59.689 16:17:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:59.689 16:17:23 -- scripts/common.sh@365 -- # decimal 2 00:30:59.689 16:17:23 -- scripts/common.sh@352 -- # local d=2 00:30:59.689 16:17:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:59.689 16:17:23 -- scripts/common.sh@354 -- # echo 2 00:30:59.689 16:17:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:59.689 16:17:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:59.689 16:17:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:59.689 16:17:23 -- scripts/common.sh@367 -- # return 0 00:30:59.689 16:17:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:59.689 16:17:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:59.689 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:59.689 --rc genhtml_branch_coverage=1 00:30:59.689 --rc genhtml_function_coverage=1 00:30:59.689 --rc genhtml_legend=1 00:30:59.689 --rc geninfo_all_blocks=1 00:30:59.689 --rc geninfo_unexecuted_blocks=1 00:30:59.689 00:30:59.689 ' 00:30:59.689 16:17:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:59.689 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:59.689 --rc genhtml_branch_coverage=1 00:30:59.689 --rc genhtml_function_coverage=1 00:30:59.689 --rc genhtml_legend=1 00:30:59.689 --rc geninfo_all_blocks=1 00:30:59.689 --rc geninfo_unexecuted_blocks=1 00:30:59.689 00:30:59.689 ' 00:30:59.689 16:17:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:59.689 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:59.689 --rc genhtml_branch_coverage=1 00:30:59.689 --rc genhtml_function_coverage=1 00:30:59.689 --rc genhtml_legend=1 00:30:59.689 --rc geninfo_all_blocks=1 00:30:59.689 --rc geninfo_unexecuted_blocks=1 00:30:59.689 00:30:59.689 ' 00:30:59.689 16:17:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:59.689 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:59.689 --rc genhtml_branch_coverage=1 00:30:59.689 --rc genhtml_function_coverage=1 00:30:59.689 --rc genhtml_legend=1 00:30:59.689 --rc geninfo_all_blocks=1 00:30:59.689 --rc geninfo_unexecuted_blocks=1 00:30:59.689 00:30:59.689 ' 00:30:59.689 16:17:23 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:59.689 16:17:23 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:59.689 16:17:23 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:59.689 16:17:23 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:59.689 16:17:23 -- nvmf/common.sh@7 -- # uname -s 00:30:59.689 16:17:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:59.689 16:17:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:59.689 16:17:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:59.689 16:17:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:59.689 16:17:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:59.689 16:17:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:59.689 16:17:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:59.689 16:17:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:59.689 16:17:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:59.689 16:17:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:59.689 16:17:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:59.689 16:17:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:59.689 16:17:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:59.689 16:17:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:59.689 16:17:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:59.689 16:17:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:59.689 16:17:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:59.689 16:17:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:59.689 16:17:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:59.689 16:17:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:59.689 16:17:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:59.689 16:17:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:59.689 16:17:23 -- paths/export.sh@5 -- # export PATH 00:30:59.689 16:17:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:59.689 16:17:23 -- nvmf/common.sh@46 -- # : 0 00:30:59.689 16:17:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:59.689 16:17:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:59.689 16:17:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:59.689 16:17:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:59.689 16:17:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:59.689 16:17:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:59.689 16:17:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:59.689 16:17:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:59.689 16:17:23 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:59.689 16:17:23 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:59.689 16:17:23 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:59.689 16:17:23 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:59.689 16:17:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:59.689 16:17:23 -- common/autotest_common.sh@10 -- # set +x 00:30:59.689 16:17:23 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:59.689 16:17:23 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1719040 00:30:59.689 16:17:23 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:59.690 16:17:23 -- spdkcli/common.sh@34 -- # waitforlisten 1719040 00:30:59.690 16:17:23 -- common/autotest_common.sh@829 -- # '[' -z 1719040 ']' 00:30:59.690 16:17:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:59.690 16:17:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:59.690 16:17:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:59.690 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:59.690 16:17:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:59.690 16:17:23 -- common/autotest_common.sh@10 -- # set +x 00:30:59.690 [2024-11-18 16:17:23.218216] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:59.690 [2024-11-18 16:17:23.218318] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1719040 ] 00:30:59.690 EAL: No free 2048 kB hugepages reported on node 1 00:30:59.690 [2024-11-18 16:17:23.276240] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:59.948 [2024-11-18 16:17:23.360717] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:59.948 [2024-11-18 16:17:23.360907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:59.948 [2024-11-18 16:17:23.360912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:00.884 16:17:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:00.884 16:17:24 -- common/autotest_common.sh@862 -- # return 0 00:31:00.884 16:17:24 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:31:00.884 16:17:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:00.884 16:17:24 -- common/autotest_common.sh@10 -- # set +x 00:31:00.884 16:17:24 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:31:00.884 16:17:24 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:31:00.884 16:17:24 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:31:00.884 16:17:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:00.884 16:17:24 -- common/autotest_common.sh@10 -- # set +x 00:31:00.884 16:17:24 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:31:00.884 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:31:00.884 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:31:00.884 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:31:00.884 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:31:00.884 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:31:00.884 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:31:00.884 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:00.884 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:00.884 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:31:00.884 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:31:00.884 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:31:00.884 ' 00:31:01.143 [2024-11-18 16:17:24.594730] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:03.670 [2024-11-18 16:17:26.752744] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:04.604 [2024-11-18 16:17:27.993216] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:31:07.130 [2024-11-18 16:17:30.280896] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:31:09.027 [2024-11-18 16:17:32.259304] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:31:10.400 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:31:10.400 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:31:10.400 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:31:10.400 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:31:10.400 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:31:10.400 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:31:10.400 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:31:10.400 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:10.400 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:10.400 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:31:10.400 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:31:10.400 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:31:10.400 16:17:33 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:31:10.400 16:17:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:10.400 16:17:33 -- common/autotest_common.sh@10 -- # set +x 00:31:10.400 16:17:33 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:31:10.400 16:17:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:10.400 16:17:33 -- common/autotest_common.sh@10 -- # set +x 00:31:10.400 16:17:33 -- spdkcli/nvmf.sh@69 -- # check_match 00:31:10.400 16:17:33 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:31:10.966 16:17:34 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:31:10.966 16:17:34 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:31:10.966 16:17:34 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:31:10.966 16:17:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:10.966 16:17:34 -- common/autotest_common.sh@10 -- # set +x 00:31:10.966 16:17:34 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:31:10.966 16:17:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:10.966 16:17:34 -- common/autotest_common.sh@10 -- # set +x 00:31:10.966 16:17:34 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:31:10.966 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:31:10.966 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:10.966 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:31:10.966 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:31:10.966 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:31:10.966 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:31:10.966 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:10.966 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:31:10.966 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:31:10.966 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:31:10.966 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:31:10.966 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:31:10.966 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:31:10.966 ' 00:31:16.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:16.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:16.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:16.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:16.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:16.229 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:16.229 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:16.229 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:16.229 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:16.229 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:16.229 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:16.229 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:16.229 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:16.229 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:16.229 16:17:39 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:16.229 16:17:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:16.229 16:17:39 -- common/autotest_common.sh@10 -- # set +x 00:31:16.229 16:17:39 -- spdkcli/nvmf.sh@90 -- # killprocess 1719040 00:31:16.229 16:17:39 -- common/autotest_common.sh@936 -- # '[' -z 1719040 ']' 00:31:16.229 16:17:39 -- common/autotest_common.sh@940 -- # kill -0 1719040 00:31:16.229 16:17:39 -- common/autotest_common.sh@941 -- # uname 00:31:16.229 16:17:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:16.229 16:17:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1719040 00:31:16.229 16:17:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:16.229 16:17:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:16.229 16:17:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1719040' 00:31:16.229 killing process with pid 1719040 00:31:16.229 16:17:39 -- common/autotest_common.sh@955 -- # kill 1719040 00:31:16.229 [2024-11-18 16:17:39.747184] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:16.229 16:17:39 -- common/autotest_common.sh@960 -- # wait 1719040 00:31:16.487 16:17:39 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:16.487 16:17:39 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:16.487 16:17:39 -- spdkcli/common.sh@13 -- # '[' -n 1719040 ']' 00:31:16.487 16:17:39 -- spdkcli/common.sh@14 -- # killprocess 1719040 00:31:16.487 16:17:39 -- common/autotest_common.sh@936 -- # '[' -z 1719040 ']' 00:31:16.487 16:17:39 -- common/autotest_common.sh@940 -- # kill -0 1719040 00:31:16.487 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1719040) - No such process 00:31:16.487 16:17:39 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1719040 is not found' 00:31:16.487 Process with pid 1719040 is not found 00:31:16.487 16:17:39 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:16.487 16:17:39 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:16.487 16:17:39 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:16.487 00:31:16.487 real 0m16.957s 00:31:16.487 user 0m36.142s 00:31:16.487 sys 0m0.774s 00:31:16.487 16:17:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:16.487 16:17:39 -- common/autotest_common.sh@10 -- # set +x 00:31:16.487 ************************************ 00:31:16.487 END TEST spdkcli_nvmf_tcp 00:31:16.487 ************************************ 00:31:16.487 16:17:39 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:16.487 16:17:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:16.487 16:17:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:16.487 16:17:39 -- common/autotest_common.sh@10 -- # set +x 00:31:16.487 ************************************ 00:31:16.487 START TEST nvmf_identify_passthru 00:31:16.487 ************************************ 00:31:16.487 16:17:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:16.487 * Looking for test storage... 00:31:16.487 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:16.487 16:17:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:16.487 16:17:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:16.487 16:17:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:16.746 16:17:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:16.746 16:17:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:16.746 16:17:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:16.746 16:17:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:16.746 16:17:40 -- scripts/common.sh@335 -- # IFS=.-: 00:31:16.746 16:17:40 -- scripts/common.sh@335 -- # read -ra ver1 00:31:16.746 16:17:40 -- scripts/common.sh@336 -- # IFS=.-: 00:31:16.746 16:17:40 -- scripts/common.sh@336 -- # read -ra ver2 00:31:16.746 16:17:40 -- scripts/common.sh@337 -- # local 'op=<' 00:31:16.746 16:17:40 -- scripts/common.sh@339 -- # ver1_l=2 00:31:16.746 16:17:40 -- scripts/common.sh@340 -- # ver2_l=1 00:31:16.746 16:17:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:16.746 16:17:40 -- scripts/common.sh@343 -- # case "$op" in 00:31:16.746 16:17:40 -- scripts/common.sh@344 -- # : 1 00:31:16.746 16:17:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:16.746 16:17:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:16.746 16:17:40 -- scripts/common.sh@364 -- # decimal 1 00:31:16.746 16:17:40 -- scripts/common.sh@352 -- # local d=1 00:31:16.746 16:17:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:16.746 16:17:40 -- scripts/common.sh@354 -- # echo 1 00:31:16.746 16:17:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:16.746 16:17:40 -- scripts/common.sh@365 -- # decimal 2 00:31:16.746 16:17:40 -- scripts/common.sh@352 -- # local d=2 00:31:16.746 16:17:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:16.746 16:17:40 -- scripts/common.sh@354 -- # echo 2 00:31:16.746 16:17:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:16.746 16:17:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:16.746 16:17:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:16.746 16:17:40 -- scripts/common.sh@367 -- # return 0 00:31:16.746 16:17:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:16.746 16:17:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:16.746 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:16.746 --rc genhtml_branch_coverage=1 00:31:16.746 --rc genhtml_function_coverage=1 00:31:16.746 --rc genhtml_legend=1 00:31:16.746 --rc geninfo_all_blocks=1 00:31:16.746 --rc geninfo_unexecuted_blocks=1 00:31:16.746 00:31:16.746 ' 00:31:16.746 16:17:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:16.746 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:16.746 --rc genhtml_branch_coverage=1 00:31:16.746 --rc genhtml_function_coverage=1 00:31:16.746 --rc genhtml_legend=1 00:31:16.746 --rc geninfo_all_blocks=1 00:31:16.746 --rc geninfo_unexecuted_blocks=1 00:31:16.746 00:31:16.746 ' 00:31:16.746 16:17:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:16.746 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:16.746 --rc genhtml_branch_coverage=1 00:31:16.746 --rc genhtml_function_coverage=1 00:31:16.746 --rc genhtml_legend=1 00:31:16.746 --rc geninfo_all_blocks=1 00:31:16.746 --rc geninfo_unexecuted_blocks=1 00:31:16.746 00:31:16.746 ' 00:31:16.746 16:17:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:16.746 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:16.746 --rc genhtml_branch_coverage=1 00:31:16.746 --rc genhtml_function_coverage=1 00:31:16.746 --rc genhtml_legend=1 00:31:16.746 --rc geninfo_all_blocks=1 00:31:16.746 --rc geninfo_unexecuted_blocks=1 00:31:16.746 00:31:16.746 ' 00:31:16.746 16:17:40 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:16.746 16:17:40 -- nvmf/common.sh@7 -- # uname -s 00:31:16.746 16:17:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:16.746 16:17:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:16.746 16:17:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:16.746 16:17:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:16.746 16:17:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:16.746 16:17:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:16.746 16:17:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:16.746 16:17:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:16.746 16:17:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:16.746 16:17:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:16.746 16:17:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:16.746 16:17:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:16.746 16:17:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:16.746 16:17:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:16.746 16:17:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:16.746 16:17:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:16.746 16:17:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:16.746 16:17:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:16.746 16:17:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:16.746 16:17:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:16.746 16:17:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:16.746 16:17:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:16.746 16:17:40 -- paths/export.sh@5 -- # export PATH 00:31:16.746 16:17:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:16.746 16:17:40 -- nvmf/common.sh@46 -- # : 0 00:31:16.746 16:17:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:16.746 16:17:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:16.746 16:17:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:16.746 16:17:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:16.746 16:17:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:16.746 16:17:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:16.746 16:17:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:16.746 16:17:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:16.746 16:17:40 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:16.746 16:17:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:16.746 16:17:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:16.746 16:17:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:16.746 16:17:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:16.747 16:17:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:16.747 16:17:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:16.747 16:17:40 -- paths/export.sh@5 -- # export PATH 00:31:16.747 16:17:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:16.747 16:17:40 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:16.747 16:17:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:16.747 16:17:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:16.747 16:17:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:16.747 16:17:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:16.747 16:17:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:16.747 16:17:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:16.747 16:17:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:16.747 16:17:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:16.747 16:17:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:16.747 16:17:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:16.747 16:17:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:16.747 16:17:40 -- common/autotest_common.sh@10 -- # set +x 00:31:18.649 16:17:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:18.649 16:17:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:18.649 16:17:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:18.649 16:17:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:18.649 16:17:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:18.649 16:17:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:18.649 16:17:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:18.649 16:17:42 -- nvmf/common.sh@294 -- # net_devs=() 00:31:18.649 16:17:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:18.649 16:17:42 -- nvmf/common.sh@295 -- # e810=() 00:31:18.649 16:17:42 -- nvmf/common.sh@295 -- # local -ga e810 00:31:18.649 16:17:42 -- nvmf/common.sh@296 -- # x722=() 00:31:18.649 16:17:42 -- nvmf/common.sh@296 -- # local -ga x722 00:31:18.649 16:17:42 -- nvmf/common.sh@297 -- # mlx=() 00:31:18.649 16:17:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:18.649 16:17:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:18.649 16:17:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:18.649 16:17:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:18.649 16:17:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:18.649 16:17:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:18.649 16:17:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:18.649 16:17:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:18.649 16:17:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:18.649 16:17:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:18.649 16:17:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:18.649 16:17:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:18.649 16:17:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:18.649 16:17:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:18.649 16:17:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:18.649 16:17:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:18.649 16:17:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:18.649 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:18.649 16:17:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:18.649 16:17:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:18.649 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:18.649 16:17:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:18.649 16:17:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:18.649 16:17:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:18.649 16:17:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:18.649 16:17:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:18.649 16:17:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:18.649 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:18.649 16:17:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:18.649 16:17:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:18.649 16:17:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:18.649 16:17:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:18.649 16:17:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:18.649 16:17:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:18.649 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:18.649 16:17:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:18.649 16:17:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:18.649 16:17:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:18.649 16:17:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:18.649 16:17:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:18.649 16:17:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:18.649 16:17:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:18.649 16:17:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:18.649 16:17:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:18.649 16:17:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:18.649 16:17:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:18.649 16:17:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:18.649 16:17:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:18.649 16:17:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:18.649 16:17:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:18.649 16:17:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:18.649 16:17:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:18.649 16:17:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:18.649 16:17:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:18.649 16:17:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:18.649 16:17:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:18.649 16:17:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:18.908 16:17:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:18.908 16:17:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:18.908 16:17:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:18.908 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:18.908 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:31:18.908 00:31:18.908 --- 10.0.0.2 ping statistics --- 00:31:18.908 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:18.908 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:31:18.908 16:17:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:18.908 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:18.908 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:31:18.908 00:31:18.908 --- 10.0.0.1 ping statistics --- 00:31:18.908 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:18.908 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:31:18.908 16:17:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:18.908 16:17:42 -- nvmf/common.sh@410 -- # return 0 00:31:18.908 16:17:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:18.908 16:17:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:18.908 16:17:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:18.908 16:17:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:18.908 16:17:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:18.908 16:17:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:18.908 16:17:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:18.908 16:17:42 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:18.908 16:17:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:18.908 16:17:42 -- common/autotest_common.sh@10 -- # set +x 00:31:18.908 16:17:42 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:18.908 16:17:42 -- common/autotest_common.sh@1519 -- # bdfs=() 00:31:18.908 16:17:42 -- common/autotest_common.sh@1519 -- # local bdfs 00:31:18.908 16:17:42 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:31:18.908 16:17:42 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:31:18.908 16:17:42 -- common/autotest_common.sh@1508 -- # bdfs=() 00:31:18.908 16:17:42 -- common/autotest_common.sh@1508 -- # local bdfs 00:31:18.908 16:17:42 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:18.908 16:17:42 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:18.908 16:17:42 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:31:18.908 16:17:42 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:31:18.908 16:17:42 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:31:18.908 16:17:42 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:31:18.908 16:17:42 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:31:18.908 16:17:42 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:31:18.908 16:17:42 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:18.908 16:17:42 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:18.908 16:17:42 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:18.908 EAL: No free 2048 kB hugepages reported on node 1 00:31:23.094 16:17:46 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:23.094 16:17:46 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:23.094 16:17:46 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:23.094 16:17:46 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:23.094 EAL: No free 2048 kB hugepages reported on node 1 00:31:27.277 16:17:50 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:27.277 16:17:50 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:27.277 16:17:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:27.277 16:17:50 -- common/autotest_common.sh@10 -- # set +x 00:31:27.277 16:17:50 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:27.277 16:17:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:27.277 16:17:50 -- common/autotest_common.sh@10 -- # set +x 00:31:27.277 16:17:50 -- target/identify_passthru.sh@31 -- # nvmfpid=1723775 00:31:27.277 16:17:50 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:27.562 16:17:50 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:27.562 16:17:50 -- target/identify_passthru.sh@35 -- # waitforlisten 1723775 00:31:27.562 16:17:50 -- common/autotest_common.sh@829 -- # '[' -z 1723775 ']' 00:31:27.562 16:17:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:27.562 16:17:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:27.562 16:17:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:27.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:27.562 16:17:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:27.562 16:17:50 -- common/autotest_common.sh@10 -- # set +x 00:31:27.562 [2024-11-18 16:17:50.910147] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:27.562 [2024-11-18 16:17:50.910222] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:27.562 EAL: No free 2048 kB hugepages reported on node 1 00:31:27.562 [2024-11-18 16:17:50.976648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:27.562 [2024-11-18 16:17:51.062086] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:27.562 [2024-11-18 16:17:51.062225] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:27.562 [2024-11-18 16:17:51.062241] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:27.562 [2024-11-18 16:17:51.062253] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:27.562 [2024-11-18 16:17:51.062319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:27.562 [2024-11-18 16:17:51.062379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:27.562 [2024-11-18 16:17:51.062446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:27.562 [2024-11-18 16:17:51.062449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:27.844 16:17:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:27.844 16:17:51 -- common/autotest_common.sh@862 -- # return 0 00:31:27.844 16:17:51 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:27.844 16:17:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.844 16:17:51 -- common/autotest_common.sh@10 -- # set +x 00:31:27.844 INFO: Log level set to 20 00:31:27.844 INFO: Requests: 00:31:27.844 { 00:31:27.844 "jsonrpc": "2.0", 00:31:27.844 "method": "nvmf_set_config", 00:31:27.844 "id": 1, 00:31:27.844 "params": { 00:31:27.844 "admin_cmd_passthru": { 00:31:27.844 "identify_ctrlr": true 00:31:27.844 } 00:31:27.844 } 00:31:27.844 } 00:31:27.844 00:31:27.844 INFO: response: 00:31:27.844 { 00:31:27.844 "jsonrpc": "2.0", 00:31:27.844 "id": 1, 00:31:27.844 "result": true 00:31:27.844 } 00:31:27.844 00:31:27.844 16:17:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.844 16:17:51 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:27.844 16:17:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.844 16:17:51 -- common/autotest_common.sh@10 -- # set +x 00:31:27.844 INFO: Setting log level to 20 00:31:27.844 INFO: Setting log level to 20 00:31:27.844 INFO: Log level set to 20 00:31:27.844 INFO: Log level set to 20 00:31:27.844 INFO: Requests: 00:31:27.844 { 00:31:27.844 "jsonrpc": "2.0", 00:31:27.844 "method": "framework_start_init", 00:31:27.844 "id": 1 00:31:27.844 } 00:31:27.844 00:31:27.844 INFO: Requests: 00:31:27.844 { 00:31:27.844 "jsonrpc": "2.0", 00:31:27.844 "method": "framework_start_init", 00:31:27.844 "id": 1 00:31:27.844 } 00:31:27.844 00:31:27.844 [2024-11-18 16:17:51.245854] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:27.844 INFO: response: 00:31:27.844 { 00:31:27.844 "jsonrpc": "2.0", 00:31:27.844 "id": 1, 00:31:27.844 "result": true 00:31:27.844 } 00:31:27.844 00:31:27.844 INFO: response: 00:31:27.844 { 00:31:27.844 "jsonrpc": "2.0", 00:31:27.844 "id": 1, 00:31:27.844 "result": true 00:31:27.844 } 00:31:27.844 00:31:27.844 16:17:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.844 16:17:51 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:27.844 16:17:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.844 16:17:51 -- common/autotest_common.sh@10 -- # set +x 00:31:27.844 INFO: Setting log level to 40 00:31:27.844 INFO: Setting log level to 40 00:31:27.844 INFO: Setting log level to 40 00:31:27.844 [2024-11-18 16:17:51.255781] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:27.844 16:17:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:27.844 16:17:51 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:27.844 16:17:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:27.844 16:17:51 -- common/autotest_common.sh@10 -- # set +x 00:31:27.844 16:17:51 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:27.844 16:17:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:27.844 16:17:51 -- common/autotest_common.sh@10 -- # set +x 00:31:31.121 Nvme0n1 00:31:31.121 16:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.121 16:17:54 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:31.121 16:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.121 16:17:54 -- common/autotest_common.sh@10 -- # set +x 00:31:31.121 16:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.121 16:17:54 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:31.121 16:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.121 16:17:54 -- common/autotest_common.sh@10 -- # set +x 00:31:31.121 16:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.121 16:17:54 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:31.121 16:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.121 16:17:54 -- common/autotest_common.sh@10 -- # set +x 00:31:31.122 [2024-11-18 16:17:54.146142] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:31.122 16:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.122 16:17:54 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:31.122 16:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.122 16:17:54 -- common/autotest_common.sh@10 -- # set +x 00:31:31.122 [2024-11-18 16:17:54.153817] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:31.122 [ 00:31:31.122 { 00:31:31.122 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:31.122 "subtype": "Discovery", 00:31:31.122 "listen_addresses": [], 00:31:31.122 "allow_any_host": true, 00:31:31.122 "hosts": [] 00:31:31.122 }, 00:31:31.122 { 00:31:31.122 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:31.122 "subtype": "NVMe", 00:31:31.122 "listen_addresses": [ 00:31:31.122 { 00:31:31.122 "transport": "TCP", 00:31:31.122 "trtype": "TCP", 00:31:31.122 "adrfam": "IPv4", 00:31:31.122 "traddr": "10.0.0.2", 00:31:31.122 "trsvcid": "4420" 00:31:31.122 } 00:31:31.122 ], 00:31:31.122 "allow_any_host": true, 00:31:31.122 "hosts": [], 00:31:31.122 "serial_number": "SPDK00000000000001", 00:31:31.122 "model_number": "SPDK bdev Controller", 00:31:31.122 "max_namespaces": 1, 00:31:31.122 "min_cntlid": 1, 00:31:31.122 "max_cntlid": 65519, 00:31:31.122 "namespaces": [ 00:31:31.122 { 00:31:31.122 "nsid": 1, 00:31:31.122 "bdev_name": "Nvme0n1", 00:31:31.122 "name": "Nvme0n1", 00:31:31.122 "nguid": "3B59A55659A74CB3A5EE1BBBA8B855AC", 00:31:31.122 "uuid": "3b59a556-59a7-4cb3-a5ee-1bbba8b855ac" 00:31:31.122 } 00:31:31.122 ] 00:31:31.122 } 00:31:31.122 ] 00:31:31.122 16:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.122 16:17:54 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:31.122 16:17:54 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:31.122 16:17:54 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:31.122 EAL: No free 2048 kB hugepages reported on node 1 00:31:31.122 16:17:54 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:31.122 16:17:54 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:31.122 16:17:54 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:31.122 16:17:54 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:31.122 EAL: No free 2048 kB hugepages reported on node 1 00:31:31.122 16:17:54 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:31.122 16:17:54 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:31.122 16:17:54 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:31.122 16:17:54 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:31.122 16:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.122 16:17:54 -- common/autotest_common.sh@10 -- # set +x 00:31:31.122 16:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.122 16:17:54 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:31.122 16:17:54 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:31.122 16:17:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:31.122 16:17:54 -- nvmf/common.sh@116 -- # sync 00:31:31.122 16:17:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:31.122 16:17:54 -- nvmf/common.sh@119 -- # set +e 00:31:31.122 16:17:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:31.122 16:17:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:31.122 rmmod nvme_tcp 00:31:31.122 rmmod nvme_fabrics 00:31:31.122 rmmod nvme_keyring 00:31:31.122 16:17:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:31.122 16:17:54 -- nvmf/common.sh@123 -- # set -e 00:31:31.122 16:17:54 -- nvmf/common.sh@124 -- # return 0 00:31:31.122 16:17:54 -- nvmf/common.sh@477 -- # '[' -n 1723775 ']' 00:31:31.122 16:17:54 -- nvmf/common.sh@478 -- # killprocess 1723775 00:31:31.122 16:17:54 -- common/autotest_common.sh@936 -- # '[' -z 1723775 ']' 00:31:31.122 16:17:54 -- common/autotest_common.sh@940 -- # kill -0 1723775 00:31:31.122 16:17:54 -- common/autotest_common.sh@941 -- # uname 00:31:31.122 16:17:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:31.122 16:17:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1723775 00:31:31.122 16:17:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:31.122 16:17:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:31.122 16:17:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1723775' 00:31:31.122 killing process with pid 1723775 00:31:31.122 16:17:54 -- common/autotest_common.sh@955 -- # kill 1723775 00:31:31.122 [2024-11-18 16:17:54.542173] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:31.122 16:17:54 -- common/autotest_common.sh@960 -- # wait 1723775 00:31:33.023 16:17:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:33.023 16:17:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:33.023 16:17:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:33.023 16:17:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:33.023 16:17:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:33.023 16:17:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:33.023 16:17:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:33.023 16:17:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:34.927 16:17:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:34.927 00:31:34.927 real 0m18.197s 00:31:34.927 user 0m26.839s 00:31:34.927 sys 0m2.347s 00:31:34.927 16:17:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:34.927 16:17:58 -- common/autotest_common.sh@10 -- # set +x 00:31:34.927 ************************************ 00:31:34.927 END TEST nvmf_identify_passthru 00:31:34.927 ************************************ 00:31:34.927 16:17:58 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:34.927 16:17:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:34.927 16:17:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:34.927 16:17:58 -- common/autotest_common.sh@10 -- # set +x 00:31:34.927 ************************************ 00:31:34.927 START TEST nvmf_dif 00:31:34.927 ************************************ 00:31:34.927 16:17:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:34.927 * Looking for test storage... 00:31:34.927 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:34.927 16:17:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:34.927 16:17:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:34.927 16:17:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:34.927 16:17:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:34.927 16:17:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:34.927 16:17:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:34.927 16:17:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:34.927 16:17:58 -- scripts/common.sh@335 -- # IFS=.-: 00:31:34.927 16:17:58 -- scripts/common.sh@335 -- # read -ra ver1 00:31:34.927 16:17:58 -- scripts/common.sh@336 -- # IFS=.-: 00:31:34.927 16:17:58 -- scripts/common.sh@336 -- # read -ra ver2 00:31:34.927 16:17:58 -- scripts/common.sh@337 -- # local 'op=<' 00:31:34.927 16:17:58 -- scripts/common.sh@339 -- # ver1_l=2 00:31:34.927 16:17:58 -- scripts/common.sh@340 -- # ver2_l=1 00:31:34.927 16:17:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:34.927 16:17:58 -- scripts/common.sh@343 -- # case "$op" in 00:31:34.927 16:17:58 -- scripts/common.sh@344 -- # : 1 00:31:34.927 16:17:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:34.927 16:17:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:34.927 16:17:58 -- scripts/common.sh@364 -- # decimal 1 00:31:34.927 16:17:58 -- scripts/common.sh@352 -- # local d=1 00:31:34.927 16:17:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:34.927 16:17:58 -- scripts/common.sh@354 -- # echo 1 00:31:34.927 16:17:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:34.927 16:17:58 -- scripts/common.sh@365 -- # decimal 2 00:31:34.927 16:17:58 -- scripts/common.sh@352 -- # local d=2 00:31:34.927 16:17:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:34.927 16:17:58 -- scripts/common.sh@354 -- # echo 2 00:31:34.927 16:17:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:34.927 16:17:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:34.927 16:17:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:34.927 16:17:58 -- scripts/common.sh@367 -- # return 0 00:31:34.927 16:17:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:34.927 16:17:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:34.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:34.927 --rc genhtml_branch_coverage=1 00:31:34.927 --rc genhtml_function_coverage=1 00:31:34.927 --rc genhtml_legend=1 00:31:34.927 --rc geninfo_all_blocks=1 00:31:34.927 --rc geninfo_unexecuted_blocks=1 00:31:34.927 00:31:34.927 ' 00:31:34.927 16:17:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:34.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:34.927 --rc genhtml_branch_coverage=1 00:31:34.927 --rc genhtml_function_coverage=1 00:31:34.927 --rc genhtml_legend=1 00:31:34.927 --rc geninfo_all_blocks=1 00:31:34.927 --rc geninfo_unexecuted_blocks=1 00:31:34.927 00:31:34.927 ' 00:31:34.927 16:17:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:34.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:34.927 --rc genhtml_branch_coverage=1 00:31:34.927 --rc genhtml_function_coverage=1 00:31:34.927 --rc genhtml_legend=1 00:31:34.927 --rc geninfo_all_blocks=1 00:31:34.927 --rc geninfo_unexecuted_blocks=1 00:31:34.927 00:31:34.927 ' 00:31:34.927 16:17:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:34.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:34.927 --rc genhtml_branch_coverage=1 00:31:34.927 --rc genhtml_function_coverage=1 00:31:34.927 --rc genhtml_legend=1 00:31:34.927 --rc geninfo_all_blocks=1 00:31:34.927 --rc geninfo_unexecuted_blocks=1 00:31:34.927 00:31:34.927 ' 00:31:34.927 16:17:58 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:34.927 16:17:58 -- nvmf/common.sh@7 -- # uname -s 00:31:34.927 16:17:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:34.927 16:17:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:34.927 16:17:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:34.927 16:17:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:34.927 16:17:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:34.927 16:17:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:34.927 16:17:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:34.927 16:17:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:34.927 16:17:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:34.927 16:17:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:34.927 16:17:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:34.927 16:17:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:34.927 16:17:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:34.927 16:17:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:34.927 16:17:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:34.927 16:17:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:34.927 16:17:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:34.927 16:17:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:34.927 16:17:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:34.927 16:17:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:34.927 16:17:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:34.927 16:17:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:34.927 16:17:58 -- paths/export.sh@5 -- # export PATH 00:31:34.927 16:17:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:34.927 16:17:58 -- nvmf/common.sh@46 -- # : 0 00:31:34.927 16:17:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:34.927 16:17:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:34.927 16:17:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:34.927 16:17:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:34.927 16:17:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:34.927 16:17:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:34.927 16:17:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:34.927 16:17:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:34.927 16:17:58 -- target/dif.sh@15 -- # NULL_META=16 00:31:34.927 16:17:58 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:34.927 16:17:58 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:34.928 16:17:58 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:34.928 16:17:58 -- target/dif.sh@135 -- # nvmftestinit 00:31:34.928 16:17:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:34.928 16:17:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:34.928 16:17:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:34.928 16:17:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:34.928 16:17:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:34.928 16:17:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:34.928 16:17:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:34.928 16:17:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:34.928 16:17:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:34.928 16:17:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:34.928 16:17:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:34.928 16:17:58 -- common/autotest_common.sh@10 -- # set +x 00:31:36.827 16:18:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:36.827 16:18:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:36.827 16:18:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:36.827 16:18:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:36.827 16:18:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:36.827 16:18:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:36.827 16:18:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:36.827 16:18:00 -- nvmf/common.sh@294 -- # net_devs=() 00:31:36.827 16:18:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:36.827 16:18:00 -- nvmf/common.sh@295 -- # e810=() 00:31:36.827 16:18:00 -- nvmf/common.sh@295 -- # local -ga e810 00:31:36.827 16:18:00 -- nvmf/common.sh@296 -- # x722=() 00:31:36.827 16:18:00 -- nvmf/common.sh@296 -- # local -ga x722 00:31:36.827 16:18:00 -- nvmf/common.sh@297 -- # mlx=() 00:31:36.827 16:18:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:36.827 16:18:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:36.827 16:18:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:36.827 16:18:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:36.827 16:18:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:36.827 16:18:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:36.827 16:18:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:36.827 16:18:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:36.827 16:18:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:36.827 16:18:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:36.827 16:18:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:36.827 16:18:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:36.827 16:18:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:36.827 16:18:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:36.827 16:18:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:36.827 16:18:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:36.828 16:18:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:36.828 16:18:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:36.828 16:18:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:36.828 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:36.828 16:18:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:36.828 16:18:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:36.828 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:36.828 16:18:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:36.828 16:18:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:36.828 16:18:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:36.828 16:18:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:36.828 16:18:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:36.828 16:18:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:36.828 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:36.828 16:18:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:36.828 16:18:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:36.828 16:18:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:36.828 16:18:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:36.828 16:18:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:36.828 16:18:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:36.828 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:36.828 16:18:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:36.828 16:18:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:36.828 16:18:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:36.828 16:18:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:36.828 16:18:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:36.828 16:18:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:36.828 16:18:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:36.828 16:18:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:36.828 16:18:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:36.828 16:18:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:36.828 16:18:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:36.828 16:18:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:36.828 16:18:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:36.828 16:18:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:36.828 16:18:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:36.828 16:18:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:36.828 16:18:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:36.828 16:18:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:36.828 16:18:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:36.828 16:18:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:36.828 16:18:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:36.828 16:18:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:36.828 16:18:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:36.828 16:18:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:36.828 16:18:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:36.828 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:36.828 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:31:36.828 00:31:36.828 --- 10.0.0.2 ping statistics --- 00:31:36.828 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:36.828 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:31:36.828 16:18:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:37.086 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:37.086 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:31:37.086 00:31:37.086 --- 10.0.0.1 ping statistics --- 00:31:37.086 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:37.086 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:31:37.086 16:18:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:37.086 16:18:00 -- nvmf/common.sh@410 -- # return 0 00:31:37.086 16:18:00 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:37.086 16:18:00 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:38.020 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:38.020 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:38.020 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:38.020 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:38.020 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:38.020 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:38.020 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:38.020 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:38.020 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:38.020 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:38.020 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:38.020 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:38.020 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:38.020 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:38.020 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:38.020 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:38.020 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:38.278 16:18:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:38.278 16:18:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:38.278 16:18:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:38.278 16:18:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:38.278 16:18:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:38.278 16:18:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:38.278 16:18:01 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:38.278 16:18:01 -- target/dif.sh@137 -- # nvmfappstart 00:31:38.278 16:18:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:38.278 16:18:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:38.278 16:18:01 -- common/autotest_common.sh@10 -- # set +x 00:31:38.278 16:18:01 -- nvmf/common.sh@469 -- # nvmfpid=1727196 00:31:38.278 16:18:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:38.278 16:18:01 -- nvmf/common.sh@470 -- # waitforlisten 1727196 00:31:38.278 16:18:01 -- common/autotest_common.sh@829 -- # '[' -z 1727196 ']' 00:31:38.278 16:18:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:38.278 16:18:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:38.278 16:18:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:38.278 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:38.278 16:18:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:38.278 16:18:01 -- common/autotest_common.sh@10 -- # set +x 00:31:38.278 [2024-11-18 16:18:01.797925] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:38.278 [2024-11-18 16:18:01.797998] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:38.278 EAL: No free 2048 kB hugepages reported on node 1 00:31:38.278 [2024-11-18 16:18:01.863728] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:38.536 [2024-11-18 16:18:01.950691] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:38.536 [2024-11-18 16:18:01.950847] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:38.536 [2024-11-18 16:18:01.950865] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:38.536 [2024-11-18 16:18:01.950879] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:38.536 [2024-11-18 16:18:01.950908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:39.470 16:18:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:39.470 16:18:02 -- common/autotest_common.sh@862 -- # return 0 00:31:39.470 16:18:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:39.470 16:18:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:39.470 16:18:02 -- common/autotest_common.sh@10 -- # set +x 00:31:39.470 16:18:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:39.470 16:18:02 -- target/dif.sh@139 -- # create_transport 00:31:39.470 16:18:02 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:39.470 16:18:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.470 16:18:02 -- common/autotest_common.sh@10 -- # set +x 00:31:39.470 [2024-11-18 16:18:02.806411] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:39.470 16:18:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.470 16:18:02 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:39.470 16:18:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:39.470 16:18:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:39.470 16:18:02 -- common/autotest_common.sh@10 -- # set +x 00:31:39.470 ************************************ 00:31:39.470 START TEST fio_dif_1_default 00:31:39.470 ************************************ 00:31:39.470 16:18:02 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:39.470 16:18:02 -- target/dif.sh@86 -- # create_subsystems 0 00:31:39.470 16:18:02 -- target/dif.sh@28 -- # local sub 00:31:39.470 16:18:02 -- target/dif.sh@30 -- # for sub in "$@" 00:31:39.470 16:18:02 -- target/dif.sh@31 -- # create_subsystem 0 00:31:39.470 16:18:02 -- target/dif.sh@18 -- # local sub_id=0 00:31:39.470 16:18:02 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:39.470 16:18:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.470 16:18:02 -- common/autotest_common.sh@10 -- # set +x 00:31:39.470 bdev_null0 00:31:39.470 16:18:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.470 16:18:02 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:39.470 16:18:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.470 16:18:02 -- common/autotest_common.sh@10 -- # set +x 00:31:39.470 16:18:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.470 16:18:02 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:39.470 16:18:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.470 16:18:02 -- common/autotest_common.sh@10 -- # set +x 00:31:39.470 16:18:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.470 16:18:02 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:39.470 16:18:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.470 16:18:02 -- common/autotest_common.sh@10 -- # set +x 00:31:39.470 [2024-11-18 16:18:02.842698] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:39.470 16:18:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.470 16:18:02 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:39.470 16:18:02 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:39.470 16:18:02 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:39.470 16:18:02 -- nvmf/common.sh@520 -- # config=() 00:31:39.470 16:18:02 -- nvmf/common.sh@520 -- # local subsystem config 00:31:39.470 16:18:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:39.470 16:18:02 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:39.470 16:18:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:39.470 { 00:31:39.470 "params": { 00:31:39.470 "name": "Nvme$subsystem", 00:31:39.470 "trtype": "$TEST_TRANSPORT", 00:31:39.470 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:39.470 "adrfam": "ipv4", 00:31:39.470 "trsvcid": "$NVMF_PORT", 00:31:39.470 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:39.470 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:39.470 "hdgst": ${hdgst:-false}, 00:31:39.470 "ddgst": ${ddgst:-false} 00:31:39.470 }, 00:31:39.470 "method": "bdev_nvme_attach_controller" 00:31:39.470 } 00:31:39.470 EOF 00:31:39.470 )") 00:31:39.470 16:18:02 -- target/dif.sh@82 -- # gen_fio_conf 00:31:39.470 16:18:02 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:39.470 16:18:02 -- target/dif.sh@54 -- # local file 00:31:39.470 16:18:02 -- target/dif.sh@56 -- # cat 00:31:39.470 16:18:02 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:39.470 16:18:02 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:39.470 16:18:02 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:39.470 16:18:02 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:39.470 16:18:02 -- common/autotest_common.sh@1330 -- # shift 00:31:39.470 16:18:02 -- nvmf/common.sh@542 -- # cat 00:31:39.470 16:18:02 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:39.470 16:18:02 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:39.470 16:18:02 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:39.470 16:18:02 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:39.470 16:18:02 -- target/dif.sh@72 -- # (( file <= files )) 00:31:39.470 16:18:02 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:39.470 16:18:02 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:39.470 16:18:02 -- nvmf/common.sh@544 -- # jq . 00:31:39.470 16:18:02 -- nvmf/common.sh@545 -- # IFS=, 00:31:39.470 16:18:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:39.470 "params": { 00:31:39.470 "name": "Nvme0", 00:31:39.470 "trtype": "tcp", 00:31:39.470 "traddr": "10.0.0.2", 00:31:39.470 "adrfam": "ipv4", 00:31:39.470 "trsvcid": "4420", 00:31:39.470 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:39.470 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:39.470 "hdgst": false, 00:31:39.470 "ddgst": false 00:31:39.470 }, 00:31:39.470 "method": "bdev_nvme_attach_controller" 00:31:39.470 }' 00:31:39.470 16:18:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:39.470 16:18:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:39.470 16:18:02 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:39.470 16:18:02 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:39.470 16:18:02 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:39.470 16:18:02 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:39.470 16:18:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:39.470 16:18:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:39.470 16:18:02 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:39.470 16:18:02 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:39.729 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:39.729 fio-3.35 00:31:39.729 Starting 1 thread 00:31:39.729 EAL: No free 2048 kB hugepages reported on node 1 00:31:39.988 [2024-11-18 16:18:03.462475] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:39.988 [2024-11-18 16:18:03.462551] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:52.182 00:31:52.182 filename0: (groupid=0, jobs=1): err= 0: pid=1727450: Mon Nov 18 16:18:13 2024 00:31:52.182 read: IOPS=184, BW=738KiB/s (755kB/s)(7392KiB/10021msec) 00:31:52.182 slat (nsec): min=4076, max=33440, avg=8990.03, stdev=2150.27 00:31:52.182 clat (usec): min=534, max=47699, avg=21662.09, stdev=20392.27 00:31:52.182 lat (usec): min=541, max=47713, avg=21671.08, stdev=20392.20 00:31:52.182 clat percentiles (usec): 00:31:52.182 | 1.00th=[ 562], 5.00th=[ 578], 10.00th=[ 586], 20.00th=[ 627], 00:31:52.182 | 30.00th=[ 676], 40.00th=[ 725], 50.00th=[41157], 60.00th=[41157], 00:31:52.182 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:31:52.182 | 99.00th=[42206], 99.50th=[42206], 99.90th=[47449], 99.95th=[47449], 00:31:52.183 | 99.99th=[47449] 00:31:52.183 bw ( KiB/s): min= 576, max= 768, per=99.91%, avg=737.60, stdev=54.42, samples=20 00:31:52.183 iops : min= 144, max= 192, avg=184.40, stdev=13.60, samples=20 00:31:52.183 lat (usec) : 750=46.37%, 1000=2.11% 00:31:52.183 lat (msec) : 50=51.52% 00:31:52.183 cpu : usr=91.51%, sys=8.19%, ctx=15, majf=0, minf=272 00:31:52.183 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:52.183 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.183 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.183 issued rwts: total=1848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:52.183 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:52.183 00:31:52.183 Run status group 0 (all jobs): 00:31:52.183 READ: bw=738KiB/s (755kB/s), 738KiB/s-738KiB/s (755kB/s-755kB/s), io=7392KiB (7569kB), run=10021-10021msec 00:31:52.183 16:18:13 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:52.183 16:18:13 -- target/dif.sh@43 -- # local sub 00:31:52.183 16:18:13 -- target/dif.sh@45 -- # for sub in "$@" 00:31:52.183 16:18:13 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:52.183 16:18:13 -- target/dif.sh@36 -- # local sub_id=0 00:31:52.183 16:18:13 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:52.183 16:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 16:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.183 16:18:13 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:52.183 16:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 16:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.183 00:31:52.183 real 0m11.003s 00:31:52.183 user 0m10.217s 00:31:52.183 sys 0m1.082s 00:31:52.183 16:18:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 ************************************ 00:31:52.183 END TEST fio_dif_1_default 00:31:52.183 ************************************ 00:31:52.183 16:18:13 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:52.183 16:18:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:52.183 16:18:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 ************************************ 00:31:52.183 START TEST fio_dif_1_multi_subsystems 00:31:52.183 ************************************ 00:31:52.183 16:18:13 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:52.183 16:18:13 -- target/dif.sh@92 -- # local files=1 00:31:52.183 16:18:13 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:52.183 16:18:13 -- target/dif.sh@28 -- # local sub 00:31:52.183 16:18:13 -- target/dif.sh@30 -- # for sub in "$@" 00:31:52.183 16:18:13 -- target/dif.sh@31 -- # create_subsystem 0 00:31:52.183 16:18:13 -- target/dif.sh@18 -- # local sub_id=0 00:31:52.183 16:18:13 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:52.183 16:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 bdev_null0 00:31:52.183 16:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.183 16:18:13 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:52.183 16:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 16:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.183 16:18:13 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:52.183 16:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 16:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.183 16:18:13 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:52.183 16:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 [2024-11-18 16:18:13.877257] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:52.183 16:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.183 16:18:13 -- target/dif.sh@30 -- # for sub in "$@" 00:31:52.183 16:18:13 -- target/dif.sh@31 -- # create_subsystem 1 00:31:52.183 16:18:13 -- target/dif.sh@18 -- # local sub_id=1 00:31:52.183 16:18:13 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:52.183 16:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 bdev_null1 00:31:52.183 16:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.183 16:18:13 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:52.183 16:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 16:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.183 16:18:13 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:52.183 16:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 16:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.183 16:18:13 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:52.183 16:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.183 16:18:13 -- common/autotest_common.sh@10 -- # set +x 00:31:52.183 16:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.183 16:18:13 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:52.183 16:18:13 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:52.183 16:18:13 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:52.183 16:18:13 -- nvmf/common.sh@520 -- # config=() 00:31:52.183 16:18:13 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.183 16:18:13 -- nvmf/common.sh@520 -- # local subsystem config 00:31:52.183 16:18:13 -- target/dif.sh@82 -- # gen_fio_conf 00:31:52.183 16:18:13 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.183 16:18:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:52.183 16:18:13 -- target/dif.sh@54 -- # local file 00:31:52.183 16:18:13 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:52.183 16:18:13 -- target/dif.sh@56 -- # cat 00:31:52.183 16:18:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:52.183 { 00:31:52.183 "params": { 00:31:52.183 "name": "Nvme$subsystem", 00:31:52.183 "trtype": "$TEST_TRANSPORT", 00:31:52.183 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:52.183 "adrfam": "ipv4", 00:31:52.183 "trsvcid": "$NVMF_PORT", 00:31:52.183 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:52.183 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:52.183 "hdgst": ${hdgst:-false}, 00:31:52.183 "ddgst": ${ddgst:-false} 00:31:52.183 }, 00:31:52.183 "method": "bdev_nvme_attach_controller" 00:31:52.183 } 00:31:52.183 EOF 00:31:52.183 )") 00:31:52.183 16:18:13 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:52.183 16:18:13 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:52.183 16:18:13 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.183 16:18:13 -- common/autotest_common.sh@1330 -- # shift 00:31:52.183 16:18:13 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:52.183 16:18:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:52.183 16:18:13 -- nvmf/common.sh@542 -- # cat 00:31:52.183 16:18:13 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:52.183 16:18:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.183 16:18:13 -- target/dif.sh@72 -- # (( file <= files )) 00:31:52.183 16:18:13 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:52.183 16:18:13 -- target/dif.sh@73 -- # cat 00:31:52.183 16:18:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:52.183 16:18:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:52.183 16:18:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:52.183 { 00:31:52.183 "params": { 00:31:52.183 "name": "Nvme$subsystem", 00:31:52.183 "trtype": "$TEST_TRANSPORT", 00:31:52.183 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:52.183 "adrfam": "ipv4", 00:31:52.183 "trsvcid": "$NVMF_PORT", 00:31:52.183 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:52.183 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:52.183 "hdgst": ${hdgst:-false}, 00:31:52.183 "ddgst": ${ddgst:-false} 00:31:52.183 }, 00:31:52.183 "method": "bdev_nvme_attach_controller" 00:31:52.183 } 00:31:52.183 EOF 00:31:52.183 )") 00:31:52.183 16:18:13 -- target/dif.sh@72 -- # (( file++ )) 00:31:52.183 16:18:13 -- target/dif.sh@72 -- # (( file <= files )) 00:31:52.183 16:18:13 -- nvmf/common.sh@542 -- # cat 00:31:52.183 16:18:13 -- nvmf/common.sh@544 -- # jq . 00:31:52.183 16:18:13 -- nvmf/common.sh@545 -- # IFS=, 00:31:52.183 16:18:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:52.183 "params": { 00:31:52.183 "name": "Nvme0", 00:31:52.183 "trtype": "tcp", 00:31:52.183 "traddr": "10.0.0.2", 00:31:52.183 "adrfam": "ipv4", 00:31:52.183 "trsvcid": "4420", 00:31:52.183 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:52.183 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:52.183 "hdgst": false, 00:31:52.183 "ddgst": false 00:31:52.183 }, 00:31:52.183 "method": "bdev_nvme_attach_controller" 00:31:52.183 },{ 00:31:52.183 "params": { 00:31:52.183 "name": "Nvme1", 00:31:52.183 "trtype": "tcp", 00:31:52.183 "traddr": "10.0.0.2", 00:31:52.183 "adrfam": "ipv4", 00:31:52.183 "trsvcid": "4420", 00:31:52.183 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:52.183 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:52.183 "hdgst": false, 00:31:52.183 "ddgst": false 00:31:52.183 }, 00:31:52.183 "method": "bdev_nvme_attach_controller" 00:31:52.183 }' 00:31:52.183 16:18:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:52.183 16:18:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:52.183 16:18:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:52.183 16:18:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.183 16:18:13 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:52.183 16:18:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:52.183 16:18:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:52.183 16:18:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:52.183 16:18:13 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:52.183 16:18:13 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.183 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:52.183 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:52.183 fio-3.35 00:31:52.183 Starting 2 threads 00:31:52.183 EAL: No free 2048 kB hugepages reported on node 1 00:31:52.183 [2024-11-18 16:18:14.706042] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:52.183 [2024-11-18 16:18:14.706111] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:02.151 00:32:02.151 filename0: (groupid=0, jobs=1): err= 0: pid=1729396: Mon Nov 18 16:18:24 2024 00:32:02.151 read: IOPS=97, BW=392KiB/s (401kB/s)(3920KiB/10010msec) 00:32:02.151 slat (nsec): min=7054, max=30396, avg=8597.37, stdev=2284.76 00:32:02.151 clat (usec): min=573, max=45295, avg=40827.75, stdev=2592.36 00:32:02.151 lat (usec): min=581, max=45326, avg=40836.35, stdev=2592.40 00:32:02.151 clat percentiles (usec): 00:32:02.151 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:32:02.151 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:32:02.151 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:32:02.151 | 99.00th=[41157], 99.50th=[41157], 99.90th=[45351], 99.95th=[45351], 00:32:02.151 | 99.99th=[45351] 00:32:02.151 bw ( KiB/s): min= 384, max= 416, per=49.90%, avg=390.40, stdev=13.13, samples=20 00:32:02.151 iops : min= 96, max= 104, avg=97.60, stdev= 3.28, samples=20 00:32:02.151 lat (usec) : 750=0.41% 00:32:02.151 lat (msec) : 50=99.59% 00:32:02.151 cpu : usr=95.57%, sys=4.13%, ctx=23, majf=0, minf=84 00:32:02.151 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:02.151 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:02.151 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:02.151 issued rwts: total=980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:02.151 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:02.151 filename1: (groupid=0, jobs=1): err= 0: pid=1729397: Mon Nov 18 16:18:24 2024 00:32:02.151 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10007msec) 00:32:02.151 slat (nsec): min=6487, max=64075, avg=8717.90, stdev=3251.66 00:32:02.151 clat (usec): min=40773, max=43302, avg=40982.35, stdev=151.11 00:32:02.151 lat (usec): min=40780, max=43329, avg=40991.07, stdev=151.32 00:32:02.151 clat percentiles (usec): 00:32:02.151 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:32:02.152 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:32:02.152 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:32:02.152 | 99.00th=[41157], 99.50th=[41157], 99.90th=[43254], 99.95th=[43254], 00:32:02.152 | 99.99th=[43254] 00:32:02.152 bw ( KiB/s): min= 384, max= 416, per=49.64%, avg=388.80, stdev=11.72, samples=20 00:32:02.152 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:32:02.152 lat (msec) : 50=100.00% 00:32:02.152 cpu : usr=95.80%, sys=3.90%, ctx=18, majf=0, minf=290 00:32:02.152 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:02.152 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:02.152 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:02.152 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:02.152 latency : target=0, window=0, percentile=100.00%, depth=4 00:32:02.152 00:32:02.152 Run status group 0 (all jobs): 00:32:02.152 READ: bw=782KiB/s (800kB/s), 390KiB/s-392KiB/s (399kB/s-401kB/s), io=7824KiB (8012kB), run=10007-10010msec 00:32:02.152 16:18:25 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:32:02.152 16:18:25 -- target/dif.sh@43 -- # local sub 00:32:02.152 16:18:25 -- target/dif.sh@45 -- # for sub in "$@" 00:32:02.152 16:18:25 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:02.152 16:18:25 -- target/dif.sh@36 -- # local sub_id=0 00:32:02.152 16:18:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:02.152 16:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.152 16:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:02.152 16:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.152 16:18:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:02.152 16:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.152 16:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:02.152 16:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.152 16:18:25 -- target/dif.sh@45 -- # for sub in "$@" 00:32:02.152 16:18:25 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:02.152 16:18:25 -- target/dif.sh@36 -- # local sub_id=1 00:32:02.152 16:18:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:02.152 16:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.152 16:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:02.152 16:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.152 16:18:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:02.152 16:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.152 16:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:02.152 16:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.152 00:32:02.152 real 0m11.226s 00:32:02.152 user 0m20.504s 00:32:02.152 sys 0m1.095s 00:32:02.152 16:18:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:02.152 16:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:02.152 ************************************ 00:32:02.152 END TEST fio_dif_1_multi_subsystems 00:32:02.152 ************************************ 00:32:02.152 16:18:25 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:32:02.152 16:18:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:02.152 16:18:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:02.152 16:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:02.152 ************************************ 00:32:02.152 START TEST fio_dif_rand_params 00:32:02.152 ************************************ 00:32:02.152 16:18:25 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:32:02.152 16:18:25 -- target/dif.sh@100 -- # local NULL_DIF 00:32:02.152 16:18:25 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:32:02.152 16:18:25 -- target/dif.sh@103 -- # NULL_DIF=3 00:32:02.152 16:18:25 -- target/dif.sh@103 -- # bs=128k 00:32:02.152 16:18:25 -- target/dif.sh@103 -- # numjobs=3 00:32:02.152 16:18:25 -- target/dif.sh@103 -- # iodepth=3 00:32:02.152 16:18:25 -- target/dif.sh@103 -- # runtime=5 00:32:02.152 16:18:25 -- target/dif.sh@105 -- # create_subsystems 0 00:32:02.152 16:18:25 -- target/dif.sh@28 -- # local sub 00:32:02.152 16:18:25 -- target/dif.sh@30 -- # for sub in "$@" 00:32:02.152 16:18:25 -- target/dif.sh@31 -- # create_subsystem 0 00:32:02.152 16:18:25 -- target/dif.sh@18 -- # local sub_id=0 00:32:02.152 16:18:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:02.152 16:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.152 16:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:02.152 bdev_null0 00:32:02.152 16:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.152 16:18:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:02.152 16:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.152 16:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:02.152 16:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.152 16:18:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:02.152 16:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.152 16:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:02.152 16:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.152 16:18:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:02.152 16:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:02.152 16:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:02.152 [2024-11-18 16:18:25.137172] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:02.152 16:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:02.152 16:18:25 -- target/dif.sh@106 -- # fio /dev/fd/62 00:32:02.152 16:18:25 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:32:02.152 16:18:25 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:02.152 16:18:25 -- nvmf/common.sh@520 -- # config=() 00:32:02.152 16:18:25 -- nvmf/common.sh@520 -- # local subsystem config 00:32:02.152 16:18:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:02.152 16:18:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:02.152 { 00:32:02.152 "params": { 00:32:02.152 "name": "Nvme$subsystem", 00:32:02.152 "trtype": "$TEST_TRANSPORT", 00:32:02.152 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:02.152 "adrfam": "ipv4", 00:32:02.152 "trsvcid": "$NVMF_PORT", 00:32:02.152 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:02.152 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:02.152 "hdgst": ${hdgst:-false}, 00:32:02.152 "ddgst": ${ddgst:-false} 00:32:02.152 }, 00:32:02.152 "method": "bdev_nvme_attach_controller" 00:32:02.152 } 00:32:02.152 EOF 00:32:02.152 )") 00:32:02.152 16:18:25 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:02.152 16:18:25 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:02.152 16:18:25 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:02.152 16:18:25 -- target/dif.sh@82 -- # gen_fio_conf 00:32:02.152 16:18:25 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:02.152 16:18:25 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:02.152 16:18:25 -- target/dif.sh@54 -- # local file 00:32:02.152 16:18:25 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:02.152 16:18:25 -- target/dif.sh@56 -- # cat 00:32:02.152 16:18:25 -- common/autotest_common.sh@1330 -- # shift 00:32:02.152 16:18:25 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:02.152 16:18:25 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:02.152 16:18:25 -- nvmf/common.sh@542 -- # cat 00:32:02.152 16:18:25 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:02.152 16:18:25 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:02.152 16:18:25 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:02.152 16:18:25 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:02.152 16:18:25 -- target/dif.sh@72 -- # (( file <= files )) 00:32:02.152 16:18:25 -- nvmf/common.sh@544 -- # jq . 00:32:02.152 16:18:25 -- nvmf/common.sh@545 -- # IFS=, 00:32:02.152 16:18:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:02.152 "params": { 00:32:02.152 "name": "Nvme0", 00:32:02.152 "trtype": "tcp", 00:32:02.152 "traddr": "10.0.0.2", 00:32:02.152 "adrfam": "ipv4", 00:32:02.152 "trsvcid": "4420", 00:32:02.152 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:02.152 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:02.152 "hdgst": false, 00:32:02.152 "ddgst": false 00:32:02.152 }, 00:32:02.152 "method": "bdev_nvme_attach_controller" 00:32:02.152 }' 00:32:02.152 16:18:25 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:02.152 16:18:25 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:02.152 16:18:25 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:02.152 16:18:25 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:02.152 16:18:25 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:02.152 16:18:25 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:02.152 16:18:25 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:02.152 16:18:25 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:02.152 16:18:25 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:02.152 16:18:25 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:02.152 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:02.152 ... 00:32:02.152 fio-3.35 00:32:02.152 Starting 3 threads 00:32:02.152 EAL: No free 2048 kB hugepages reported on node 1 00:32:02.410 [2024-11-18 16:18:25.862736] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:02.410 [2024-11-18 16:18:25.862791] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:07.671 00:32:07.671 filename0: (groupid=0, jobs=1): err= 0: pid=1730831: Mon Nov 18 16:18:31 2024 00:32:07.671 read: IOPS=212, BW=26.6MiB/s (27.9MB/s)(134MiB/5045msec) 00:32:07.671 slat (nsec): min=4656, max=33298, avg=13666.07, stdev=2381.81 00:32:07.671 clat (usec): min=4717, max=93663, avg=14047.12, stdev=10260.23 00:32:07.671 lat (usec): min=4730, max=93677, avg=14060.79, stdev=10260.01 00:32:07.671 clat percentiles (usec): 00:32:07.671 | 1.00th=[ 4948], 5.00th=[ 7111], 10.00th=[ 8225], 20.00th=[ 9765], 00:32:07.671 | 30.00th=[11076], 40.00th=[11731], 50.00th=[12256], 60.00th=[12649], 00:32:07.671 | 70.00th=[13173], 80.00th=[14091], 90.00th=[15139], 95.00th=[46924], 00:32:07.671 | 99.00th=[54264], 99.50th=[56886], 99.90th=[93848], 99.95th=[93848], 00:32:07.671 | 99.99th=[93848] 00:32:07.671 bw ( KiB/s): min=23040, max=31488, per=31.71%, avg=27417.60, stdev=3108.41, samples=10 00:32:07.671 iops : min= 180, max= 246, avg=214.20, stdev=24.28, samples=10 00:32:07.671 lat (msec) : 10=21.16%, 20=73.07%, 50=2.05%, 100=3.73% 00:32:07.671 cpu : usr=93.89%, sys=5.61%, ctx=18, majf=0, minf=85 00:32:07.671 IO depths : 1=0.8%, 2=99.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:07.671 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:07.671 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:07.671 issued rwts: total=1073,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:07.671 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:07.671 filename0: (groupid=0, jobs=1): err= 0: pid=1730832: Mon Nov 18 16:18:31 2024 00:32:07.671 read: IOPS=232, BW=29.0MiB/s (30.4MB/s)(146MiB/5045msec) 00:32:07.671 slat (nsec): min=4563, max=68357, avg=16053.42, stdev=3269.23 00:32:07.671 clat (usec): min=4721, max=89812, avg=12866.92, stdev=8221.59 00:32:07.671 lat (usec): min=4749, max=89826, avg=12882.98, stdev=8221.43 00:32:07.671 clat percentiles (usec): 00:32:07.671 | 1.00th=[ 5407], 5.00th=[ 7504], 10.00th=[ 8225], 20.00th=[ 9110], 00:32:07.671 | 30.00th=[10552], 40.00th=[11207], 50.00th=[11731], 60.00th=[12125], 00:32:07.671 | 70.00th=[12649], 80.00th=[13304], 90.00th=[14222], 95.00th=[15664], 00:32:07.671 | 99.00th=[52167], 99.50th=[52691], 99.90th=[55837], 99.95th=[89654], 00:32:07.671 | 99.99th=[89654] 00:32:07.671 bw ( KiB/s): min=24064, max=32512, per=34.59%, avg=29906.10, stdev=2704.88, samples=10 00:32:07.671 iops : min= 188, max= 254, avg=233.60, stdev=21.18, samples=10 00:32:07.671 lat (msec) : 10=25.70%, 20=70.11%, 50=2.48%, 100=1.71% 00:32:07.671 cpu : usr=94.07%, sys=5.35%, ctx=9, majf=0, minf=115 00:32:07.671 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:07.671 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:07.671 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:07.671 issued rwts: total=1171,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:07.671 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:07.671 filename0: (groupid=0, jobs=1): err= 0: pid=1730833: Mon Nov 18 16:18:31 2024 00:32:07.671 read: IOPS=230, BW=28.8MiB/s (30.2MB/s)(146MiB/5046msec) 00:32:07.671 slat (nsec): min=4343, max=46045, avg=15233.68, stdev=3801.73 00:32:07.671 clat (usec): min=4363, max=56228, avg=12948.65, stdev=8869.15 00:32:07.671 lat (usec): min=4375, max=56254, avg=12963.89, stdev=8869.11 00:32:07.671 clat percentiles (usec): 00:32:07.671 | 1.00th=[ 5014], 5.00th=[ 6521], 10.00th=[ 7701], 20.00th=[ 8848], 00:32:07.671 | 30.00th=[10421], 40.00th=[11076], 50.00th=[11600], 60.00th=[11994], 00:32:07.671 | 70.00th=[12518], 80.00th=[13173], 90.00th=[14091], 95.00th=[45876], 00:32:07.671 | 99.00th=[52167], 99.50th=[52691], 99.90th=[56361], 99.95th=[56361], 00:32:07.671 | 99.99th=[56361] 00:32:07.671 bw ( KiB/s): min=19456, max=34816, per=34.38%, avg=29721.60, stdev=4691.70, samples=10 00:32:07.671 iops : min= 152, max= 272, avg=232.20, stdev=36.65, samples=10 00:32:07.671 lat (msec) : 10=26.37%, 20=68.56%, 50=2.49%, 100=2.58% 00:32:07.671 cpu : usr=90.98%, sys=6.94%, ctx=235, majf=0, minf=135 00:32:07.671 IO depths : 1=0.4%, 2=99.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:07.671 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:07.671 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:07.671 issued rwts: total=1164,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:07.671 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:07.671 00:32:07.671 Run status group 0 (all jobs): 00:32:07.671 READ: bw=84.4MiB/s (88.5MB/s), 26.6MiB/s-29.0MiB/s (27.9MB/s-30.4MB/s), io=426MiB (447MB), run=5045-5046msec 00:32:07.930 16:18:31 -- target/dif.sh@107 -- # destroy_subsystems 0 00:32:07.930 16:18:31 -- target/dif.sh@43 -- # local sub 00:32:07.930 16:18:31 -- target/dif.sh@45 -- # for sub in "$@" 00:32:07.930 16:18:31 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:07.930 16:18:31 -- target/dif.sh@36 -- # local sub_id=0 00:32:07.930 16:18:31 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@109 -- # NULL_DIF=2 00:32:07.930 16:18:31 -- target/dif.sh@109 -- # bs=4k 00:32:07.930 16:18:31 -- target/dif.sh@109 -- # numjobs=8 00:32:07.930 16:18:31 -- target/dif.sh@109 -- # iodepth=16 00:32:07.930 16:18:31 -- target/dif.sh@109 -- # runtime= 00:32:07.930 16:18:31 -- target/dif.sh@109 -- # files=2 00:32:07.930 16:18:31 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:32:07.930 16:18:31 -- target/dif.sh@28 -- # local sub 00:32:07.930 16:18:31 -- target/dif.sh@30 -- # for sub in "$@" 00:32:07.930 16:18:31 -- target/dif.sh@31 -- # create_subsystem 0 00:32:07.930 16:18:31 -- target/dif.sh@18 -- # local sub_id=0 00:32:07.930 16:18:31 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 bdev_null0 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 [2024-11-18 16:18:31.336782] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@30 -- # for sub in "$@" 00:32:07.930 16:18:31 -- target/dif.sh@31 -- # create_subsystem 1 00:32:07.930 16:18:31 -- target/dif.sh@18 -- # local sub_id=1 00:32:07.930 16:18:31 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 bdev_null1 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@30 -- # for sub in "$@" 00:32:07.930 16:18:31 -- target/dif.sh@31 -- # create_subsystem 2 00:32:07.930 16:18:31 -- target/dif.sh@18 -- # local sub_id=2 00:32:07.930 16:18:31 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 bdev_null2 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:32:07.930 16:18:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:07.930 16:18:31 -- common/autotest_common.sh@10 -- # set +x 00:32:07.930 16:18:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:07.930 16:18:31 -- target/dif.sh@112 -- # fio /dev/fd/62 00:32:07.930 16:18:31 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:32:07.930 16:18:31 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:32:07.930 16:18:31 -- nvmf/common.sh@520 -- # config=() 00:32:07.930 16:18:31 -- nvmf/common.sh@520 -- # local subsystem config 00:32:07.930 16:18:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:07.930 16:18:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:07.930 { 00:32:07.930 "params": { 00:32:07.930 "name": "Nvme$subsystem", 00:32:07.930 "trtype": "$TEST_TRANSPORT", 00:32:07.930 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:07.930 "adrfam": "ipv4", 00:32:07.930 "trsvcid": "$NVMF_PORT", 00:32:07.930 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:07.930 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:07.930 "hdgst": ${hdgst:-false}, 00:32:07.930 "ddgst": ${ddgst:-false} 00:32:07.930 }, 00:32:07.930 "method": "bdev_nvme_attach_controller" 00:32:07.930 } 00:32:07.930 EOF 00:32:07.930 )") 00:32:07.930 16:18:31 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:07.930 16:18:31 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:07.930 16:18:31 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:07.930 16:18:31 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:07.930 16:18:31 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:07.930 16:18:31 -- target/dif.sh@82 -- # gen_fio_conf 00:32:07.930 16:18:31 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:07.930 16:18:31 -- common/autotest_common.sh@1330 -- # shift 00:32:07.930 16:18:31 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:07.930 16:18:31 -- target/dif.sh@54 -- # local file 00:32:07.930 16:18:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:07.930 16:18:31 -- target/dif.sh@56 -- # cat 00:32:07.931 16:18:31 -- nvmf/common.sh@542 -- # cat 00:32:07.931 16:18:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:07.931 16:18:31 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:07.931 16:18:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:07.931 16:18:31 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:07.931 16:18:31 -- target/dif.sh@72 -- # (( file <= files )) 00:32:07.931 16:18:31 -- target/dif.sh@73 -- # cat 00:32:07.931 16:18:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:07.931 16:18:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:07.931 { 00:32:07.931 "params": { 00:32:07.931 "name": "Nvme$subsystem", 00:32:07.931 "trtype": "$TEST_TRANSPORT", 00:32:07.931 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:07.931 "adrfam": "ipv4", 00:32:07.931 "trsvcid": "$NVMF_PORT", 00:32:07.931 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:07.931 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:07.931 "hdgst": ${hdgst:-false}, 00:32:07.931 "ddgst": ${ddgst:-false} 00:32:07.931 }, 00:32:07.931 "method": "bdev_nvme_attach_controller" 00:32:07.931 } 00:32:07.931 EOF 00:32:07.931 )") 00:32:07.931 16:18:31 -- nvmf/common.sh@542 -- # cat 00:32:07.931 16:18:31 -- target/dif.sh@72 -- # (( file++ )) 00:32:07.931 16:18:31 -- target/dif.sh@72 -- # (( file <= files )) 00:32:07.931 16:18:31 -- target/dif.sh@73 -- # cat 00:32:07.931 16:18:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:07.931 16:18:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:07.931 { 00:32:07.931 "params": { 00:32:07.931 "name": "Nvme$subsystem", 00:32:07.931 "trtype": "$TEST_TRANSPORT", 00:32:07.931 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:07.931 "adrfam": "ipv4", 00:32:07.931 "trsvcid": "$NVMF_PORT", 00:32:07.931 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:07.931 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:07.931 "hdgst": ${hdgst:-false}, 00:32:07.931 "ddgst": ${ddgst:-false} 00:32:07.931 }, 00:32:07.931 "method": "bdev_nvme_attach_controller" 00:32:07.931 } 00:32:07.931 EOF 00:32:07.931 )") 00:32:07.931 16:18:31 -- target/dif.sh@72 -- # (( file++ )) 00:32:07.931 16:18:31 -- target/dif.sh@72 -- # (( file <= files )) 00:32:07.931 16:18:31 -- nvmf/common.sh@542 -- # cat 00:32:07.931 16:18:31 -- nvmf/common.sh@544 -- # jq . 00:32:07.931 16:18:31 -- nvmf/common.sh@545 -- # IFS=, 00:32:07.931 16:18:31 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:07.931 "params": { 00:32:07.931 "name": "Nvme0", 00:32:07.931 "trtype": "tcp", 00:32:07.931 "traddr": "10.0.0.2", 00:32:07.931 "adrfam": "ipv4", 00:32:07.931 "trsvcid": "4420", 00:32:07.931 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:07.931 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:07.931 "hdgst": false, 00:32:07.931 "ddgst": false 00:32:07.931 }, 00:32:07.931 "method": "bdev_nvme_attach_controller" 00:32:07.931 },{ 00:32:07.931 "params": { 00:32:07.931 "name": "Nvme1", 00:32:07.931 "trtype": "tcp", 00:32:07.931 "traddr": "10.0.0.2", 00:32:07.931 "adrfam": "ipv4", 00:32:07.931 "trsvcid": "4420", 00:32:07.931 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:07.931 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:07.931 "hdgst": false, 00:32:07.931 "ddgst": false 00:32:07.931 }, 00:32:07.931 "method": "bdev_nvme_attach_controller" 00:32:07.931 },{ 00:32:07.931 "params": { 00:32:07.931 "name": "Nvme2", 00:32:07.931 "trtype": "tcp", 00:32:07.931 "traddr": "10.0.0.2", 00:32:07.931 "adrfam": "ipv4", 00:32:07.931 "trsvcid": "4420", 00:32:07.931 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:32:07.931 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:32:07.931 "hdgst": false, 00:32:07.931 "ddgst": false 00:32:07.931 }, 00:32:07.931 "method": "bdev_nvme_attach_controller" 00:32:07.931 }' 00:32:07.931 16:18:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:07.931 16:18:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:07.931 16:18:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:07.931 16:18:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:07.931 16:18:31 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:07.931 16:18:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:07.931 16:18:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:07.931 16:18:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:07.931 16:18:31 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:07.931 16:18:31 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:08.189 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:08.189 ... 00:32:08.189 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:08.189 ... 00:32:08.189 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:08.189 ... 00:32:08.189 fio-3.35 00:32:08.189 Starting 24 threads 00:32:08.189 EAL: No free 2048 kB hugepages reported on node 1 00:32:09.123 [2024-11-18 16:18:32.385197] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:09.123 [2024-11-18 16:18:32.385269] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:19.097 00:32:19.097 filename0: (groupid=0, jobs=1): err= 0: pid=1731713: Mon Nov 18 16:18:42 2024 00:32:19.097 read: IOPS=33, BW=133KiB/s (136kB/s)(1344KiB/10096msec) 00:32:19.097 slat (nsec): min=6238, max=38283, avg=12406.29, stdev=5528.72 00:32:19.097 clat (msec): min=296, max=771, avg=480.60, stdev=111.12 00:32:19.097 lat (msec): min=296, max=771, avg=480.62, stdev=111.12 00:32:19.097 clat percentiles (msec): 00:32:19.097 | 1.00th=[ 317], 5.00th=[ 321], 10.00th=[ 330], 20.00th=[ 355], 00:32:19.097 | 30.00th=[ 376], 40.00th=[ 493], 50.00th=[ 498], 60.00th=[ 506], 00:32:19.097 | 70.00th=[ 531], 80.00th=[ 550], 90.00th=[ 558], 95.00th=[ 735], 00:32:19.097 | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], 00:32:19.097 | 99.99th=[ 768] 00:32:19.097 bw ( KiB/s): min= 128, max= 240, per=3.54%, avg=142.22, stdev=35.94, samples=18 00:32:19.097 iops : min= 32, max= 60, avg=35.56, stdev= 8.99, samples=18 00:32:19.097 lat (msec) : 500=57.14%, 750=38.10%, 1000=4.76% 00:32:19.097 cpu : usr=99.03%, sys=0.57%, ctx=14, majf=0, minf=29 00:32:19.097 IO depths : 1=3.9%, 2=10.1%, 4=25.0%, 8=52.4%, 16=8.6%, 32=0.0%, >=64=0.0% 00:32:19.097 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.097 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.097 issued rwts: total=336,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.097 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.097 filename0: (groupid=0, jobs=1): err= 0: pid=1731714: Mon Nov 18 16:18:42 2024 00:32:19.097 read: IOPS=30, BW=120KiB/s (123kB/s)(1216KiB/10094msec) 00:32:19.097 slat (nsec): min=4167, max=48541, avg=27063.79, stdev=9555.97 00:32:19.097 clat (msec): min=323, max=770, avg=531.03, stdev=71.30 00:32:19.097 lat (msec): min=323, max=770, avg=531.06, stdev=71.30 00:32:19.097 clat percentiles (msec): 00:32:19.097 | 1.00th=[ 368], 5.00th=[ 447], 10.00th=[ 464], 20.00th=[ 493], 00:32:19.097 | 30.00th=[ 502], 40.00th=[ 514], 50.00th=[ 527], 60.00th=[ 531], 00:32:19.097 | 70.00th=[ 542], 80.00th=[ 550], 90.00th=[ 558], 95.00th=[ 768], 00:32:19.097 | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], 00:32:19.097 | 99.99th=[ 768] 00:32:19.097 bw ( KiB/s): min= 128, max= 128, per=3.19%, avg=128.00, stdev= 0.00, samples=18 00:32:19.097 iops : min= 32, max= 32, avg=32.00, stdev= 0.00, samples=18 00:32:19.097 lat (msec) : 500=27.63%, 750=67.11%, 1000=5.26% 00:32:19.097 cpu : usr=99.08%, sys=0.54%, ctx=13, majf=0, minf=28 00:32:19.097 IO depths : 1=4.6%, 2=10.9%, 4=25.0%, 8=51.6%, 16=7.9%, 32=0.0%, >=64=0.0% 00:32:19.097 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.097 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.097 issued rwts: total=304,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.097 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.097 filename0: (groupid=0, jobs=1): err= 0: pid=1731715: Mon Nov 18 16:18:42 2024 00:32:19.097 read: IOPS=49, BW=196KiB/s (201kB/s)(1984KiB/10122msec) 00:32:19.097 slat (nsec): min=8080, max=73354, avg=12482.87, stdev=7044.02 00:32:19.097 clat (msec): min=13, max=386, avg=323.76, stdev=79.70 00:32:19.097 lat (msec): min=13, max=386, avg=323.77, stdev=79.70 00:32:19.097 clat percentiles (msec): 00:32:19.098 | 1.00th=[ 14], 5.00th=[ 72], 10.00th=[ 296], 20.00th=[ 326], 00:32:19.098 | 30.00th=[ 326], 40.00th=[ 338], 50.00th=[ 351], 60.00th=[ 355], 00:32:19.098 | 70.00th=[ 359], 80.00th=[ 368], 90.00th=[ 372], 95.00th=[ 376], 00:32:19.098 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:32:19.098 | 99.99th=[ 388] 00:32:19.098 bw ( KiB/s): min= 128, max= 384, per=4.76%, avg=192.00, stdev=70.03, samples=20 00:32:19.098 iops : min= 32, max= 96, avg=48.00, stdev=17.51, samples=20 00:32:19.098 lat (msec) : 20=2.82%, 50=0.40%, 100=2.82%, 250=3.63%, 500=90.32% 00:32:19.098 cpu : usr=99.19%, sys=0.41%, ctx=17, majf=0, minf=43 00:32:19.098 IO depths : 1=0.2%, 2=6.5%, 4=25.0%, 8=56.0%, 16=12.3%, 32=0.0%, >=64=0.0% 00:32:19.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.098 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.098 filename0: (groupid=0, jobs=1): err= 0: pid=1731716: Mon Nov 18 16:18:42 2024 00:32:19.098 read: IOPS=44, BW=178KiB/s (182kB/s)(1792KiB/10092msec) 00:32:19.098 slat (nsec): min=8047, max=64249, avg=14419.11, stdev=8040.76 00:32:19.098 clat (msec): min=166, max=764, avg=360.20, stdev=81.72 00:32:19.098 lat (msec): min=166, max=764, avg=360.21, stdev=81.73 00:32:19.098 clat percentiles (msec): 00:32:19.098 | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 317], 20.00th=[ 326], 00:32:19.098 | 30.00th=[ 330], 40.00th=[ 334], 50.00th=[ 347], 60.00th=[ 355], 00:32:19.098 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 376], 00:32:19.098 | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], 00:32:19.098 | 99.99th=[ 768] 00:32:19.098 bw ( KiB/s): min= 128, max= 256, per=4.51%, avg=181.89, stdev=53.12, samples=19 00:32:19.098 iops : min= 32, max= 64, avg=45.47, stdev=13.28, samples=19 00:32:19.098 lat (msec) : 250=0.45%, 500=95.98%, 1000=3.57% 00:32:19.098 cpu : usr=98.86%, sys=0.69%, ctx=59, majf=0, minf=36 00:32:19.098 IO depths : 1=1.3%, 2=7.6%, 4=25.0%, 8=54.9%, 16=11.2%, 32=0.0%, >=64=0.0% 00:32:19.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 issued rwts: total=448,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.098 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.098 filename0: (groupid=0, jobs=1): err= 0: pid=1731717: Mon Nov 18 16:18:42 2024 00:32:19.098 read: IOPS=45, BW=184KiB/s (188kB/s)(1856KiB/10112msec) 00:32:19.098 slat (usec): min=11, max=141, avg=37.86, stdev=32.09 00:32:19.098 clat (msec): min=188, max=502, avg=348.41, stdev=37.59 00:32:19.098 lat (msec): min=188, max=502, avg=348.45, stdev=37.59 00:32:19.098 clat percentiles (msec): 00:32:19.098 | 1.00th=[ 284], 5.00th=[ 313], 10.00th=[ 317], 20.00th=[ 326], 00:32:19.098 | 30.00th=[ 330], 40.00th=[ 334], 50.00th=[ 347], 60.00th=[ 355], 00:32:19.098 | 70.00th=[ 363], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 376], 00:32:19.098 | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], 00:32:19.098 | 99.99th=[ 502] 00:32:19.098 bw ( KiB/s): min= 128, max= 256, per=4.46%, avg=179.20, stdev=54.84, samples=20 00:32:19.098 iops : min= 32, max= 64, avg=44.80, stdev=13.71, samples=20 00:32:19.098 lat (msec) : 250=0.43%, 500=96.55%, 750=3.02% 00:32:19.098 cpu : usr=98.38%, sys=0.89%, ctx=56, majf=0, minf=42 00:32:19.098 IO depths : 1=0.4%, 2=6.7%, 4=25.0%, 8=55.8%, 16=12.1%, 32=0.0%, >=64=0.0% 00:32:19.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.098 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.098 filename0: (groupid=0, jobs=1): err= 0: pid=1731718: Mon Nov 18 16:18:42 2024 00:32:19.098 read: IOPS=47, BW=190KiB/s (194kB/s)(1920KiB/10123msec) 00:32:19.098 slat (nsec): min=6139, max=43912, avg=11462.33, stdev=5505.85 00:32:19.098 clat (msec): min=27, max=386, avg=334.57, stdev=58.48 00:32:19.098 lat (msec): min=27, max=386, avg=334.58, stdev=58.48 00:32:19.098 clat percentiles (msec): 00:32:19.098 | 1.00th=[ 28], 5.00th=[ 268], 10.00th=[ 309], 20.00th=[ 326], 00:32:19.098 | 30.00th=[ 330], 40.00th=[ 342], 50.00th=[ 351], 60.00th=[ 351], 00:32:19.098 | 70.00th=[ 359], 80.00th=[ 368], 90.00th=[ 372], 95.00th=[ 376], 00:32:19.098 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:32:19.098 | 99.99th=[ 388] 00:32:19.098 bw ( KiB/s): min= 128, max= 256, per=4.61%, avg=185.60, stdev=57.67, samples=20 00:32:19.098 iops : min= 32, max= 64, avg=46.40, stdev=14.42, samples=20 00:32:19.098 lat (msec) : 50=1.46%, 100=1.88%, 250=1.46%, 500=95.21% 00:32:19.098 cpu : usr=98.90%, sys=0.60%, ctx=29, majf=0, minf=68 00:32:19.098 IO depths : 1=0.2%, 2=6.2%, 4=24.2%, 8=57.1%, 16=12.3%, 32=0.0%, >=64=0.0% 00:32:19.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 complete : 0=0.0%, 4=94.3%, 8=0.2%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.098 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.098 filename0: (groupid=0, jobs=1): err= 0: pid=1731719: Mon Nov 18 16:18:42 2024 00:32:19.098 read: IOPS=48, BW=196KiB/s (201kB/s)(1984KiB/10123msec) 00:32:19.098 slat (nsec): min=7773, max=40424, avg=11611.50, stdev=5260.90 00:32:19.098 clat (msec): min=13, max=386, avg=323.76, stdev=79.75 00:32:19.098 lat (msec): min=13, max=386, avg=323.77, stdev=79.74 00:32:19.098 clat percentiles (msec): 00:32:19.098 | 1.00th=[ 14], 5.00th=[ 73], 10.00th=[ 296], 20.00th=[ 326], 00:32:19.098 | 30.00th=[ 326], 40.00th=[ 338], 50.00th=[ 351], 60.00th=[ 351], 00:32:19.098 | 70.00th=[ 359], 80.00th=[ 368], 90.00th=[ 372], 95.00th=[ 376], 00:32:19.098 | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:32:19.098 | 99.99th=[ 388] 00:32:19.098 bw ( KiB/s): min= 128, max= 384, per=4.76%, avg=192.00, stdev=70.03, samples=20 00:32:19.098 iops : min= 32, max= 96, avg=48.00, stdev=17.51, samples=20 00:32:19.098 lat (msec) : 20=3.23%, 100=2.82%, 250=3.63%, 500=90.32% 00:32:19.098 cpu : usr=98.85%, sys=0.63%, ctx=33, majf=0, minf=55 00:32:19.098 IO depths : 1=0.2%, 2=6.5%, 4=25.0%, 8=56.0%, 16=12.3%, 32=0.0%, >=64=0.0% 00:32:19.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.098 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.098 filename0: (groupid=0, jobs=1): err= 0: pid=1731720: Mon Nov 18 16:18:42 2024 00:32:19.098 read: IOPS=46, BW=186KiB/s (190kB/s)(1880KiB/10112msec) 00:32:19.098 slat (nsec): min=8111, max=28867, avg=10721.84, stdev=4419.44 00:32:19.098 clat (msec): min=196, max=513, avg=343.66, stdev=37.70 00:32:19.098 lat (msec): min=196, max=513, avg=343.67, stdev=37.70 00:32:19.098 clat percentiles (msec): 00:32:19.098 | 1.00th=[ 197], 5.00th=[ 284], 10.00th=[ 313], 20.00th=[ 326], 00:32:19.098 | 30.00th=[ 330], 40.00th=[ 338], 50.00th=[ 351], 60.00th=[ 351], 00:32:19.098 | 70.00th=[ 359], 80.00th=[ 368], 90.00th=[ 376], 95.00th=[ 376], 00:32:19.098 | 99.00th=[ 439], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], 00:32:19.098 | 99.99th=[ 514] 00:32:19.098 bw ( KiB/s): min= 128, max= 256, per=4.51%, avg=181.60, stdev=47.37, samples=20 00:32:19.098 iops : min= 32, max= 64, avg=45.40, stdev=11.84, samples=20 00:32:19.098 lat (msec) : 250=2.13%, 500=97.02%, 750=0.85% 00:32:19.098 cpu : usr=98.69%, sys=0.79%, ctx=44, majf=0, minf=37 00:32:19.098 IO depths : 1=0.2%, 2=4.7%, 4=19.6%, 8=63.2%, 16=12.3%, 32=0.0%, >=64=0.0% 00:32:19.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 complete : 0=0.0%, 4=92.6%, 8=1.9%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 issued rwts: total=470,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.098 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.098 filename1: (groupid=0, jobs=1): err= 0: pid=1731721: Mon Nov 18 16:18:42 2024 00:32:19.098 read: IOPS=42, BW=171KiB/s (175kB/s)(1728KiB/10104msec) 00:32:19.098 slat (nsec): min=3761, max=29293, avg=10364.17, stdev=3929.09 00:32:19.098 clat (msec): min=296, max=702, avg=371.04, stdev=74.49 00:32:19.098 lat (msec): min=296, max=702, avg=371.05, stdev=74.49 00:32:19.098 clat percentiles (msec): 00:32:19.098 | 1.00th=[ 296], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 330], 00:32:19.098 | 30.00th=[ 330], 40.00th=[ 351], 50.00th=[ 355], 60.00th=[ 359], 00:32:19.098 | 70.00th=[ 372], 80.00th=[ 376], 90.00th=[ 518], 95.00th=[ 531], 00:32:19.098 | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 701], 99.95th=[ 701], 00:32:19.098 | 99.99th=[ 701] 00:32:19.098 bw ( KiB/s): min= 112, max= 256, per=4.51%, avg=181.05, stdev=57.70, samples=19 00:32:19.098 iops : min= 28, max= 64, avg=45.26, stdev=14.43, samples=19 00:32:19.098 lat (msec) : 500=89.35%, 750=10.65% 00:32:19.098 cpu : usr=98.66%, sys=0.82%, ctx=51, majf=0, minf=57 00:32:19.098 IO depths : 1=2.3%, 2=8.6%, 4=25.0%, 8=53.9%, 16=10.2%, 32=0.0%, >=64=0.0% 00:32:19.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.098 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.098 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.098 filename1: (groupid=0, jobs=1): err= 0: pid=1731722: Mon Nov 18 16:18:42 2024 00:32:19.098 read: IOPS=42, BW=169KiB/s (174kB/s)(1712KiB/10103msec) 00:32:19.098 slat (nsec): min=3607, max=43329, avg=10809.64, stdev=5267.76 00:32:19.098 clat (msec): min=143, max=776, avg=377.26, stdev=105.24 00:32:19.098 lat (msec): min=143, max=777, avg=377.27, stdev=105.24 00:32:19.098 clat percentiles (msec): 00:32:19.098 | 1.00th=[ 144], 5.00th=[ 309], 10.00th=[ 313], 20.00th=[ 330], 00:32:19.098 | 30.00th=[ 338], 40.00th=[ 347], 50.00th=[ 351], 60.00th=[ 355], 00:32:19.098 | 70.00th=[ 368], 80.00th=[ 376], 90.00th=[ 510], 95.00th=[ 531], 00:32:19.098 | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], 00:32:19.098 | 99.99th=[ 776] 00:32:19.098 bw ( KiB/s): min= 112, max= 256, per=4.31%, avg=173.47, stdev=45.65, samples=19 00:32:19.098 iops : min= 28, max= 64, avg=43.37, stdev=11.41, samples=19 00:32:19.098 lat (msec) : 250=2.34%, 500=84.58%, 750=9.35%, 1000=3.74% 00:32:19.098 cpu : usr=98.76%, sys=0.69%, ctx=110, majf=0, minf=53 00:32:19.098 IO depths : 1=1.2%, 2=3.5%, 4=13.1%, 8=70.8%, 16=11.4%, 32=0.0%, >=64=0.0% 00:32:19.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 complete : 0=0.0%, 4=90.6%, 8=4.0%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 issued rwts: total=428,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.099 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.099 filename1: (groupid=0, jobs=1): err= 0: pid=1731723: Mon Nov 18 16:18:42 2024 00:32:19.099 read: IOPS=45, BW=184KiB/s (188kB/s)(1856KiB/10110msec) 00:32:19.099 slat (nsec): min=8436, max=50893, avg=15392.29, stdev=5523.21 00:32:19.099 clat (msec): min=282, max=502, avg=348.46, stdev=37.14 00:32:19.099 lat (msec): min=282, max=502, avg=348.48, stdev=37.15 00:32:19.099 clat percentiles (msec): 00:32:19.099 | 1.00th=[ 284], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 326], 00:32:19.099 | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 347], 60.00th=[ 355], 00:32:19.099 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 376], 00:32:19.099 | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], 00:32:19.099 | 99.99th=[ 502] 00:32:19.099 bw ( KiB/s): min= 128, max= 256, per=4.46%, avg=179.20, stdev=64.34, samples=20 00:32:19.099 iops : min= 32, max= 64, avg=44.80, stdev=16.08, samples=20 00:32:19.099 lat (msec) : 500=96.55%, 750=3.45% 00:32:19.099 cpu : usr=98.63%, sys=0.86%, ctx=27, majf=0, minf=43 00:32:19.099 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:19.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.099 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.099 filename1: (groupid=0, jobs=1): err= 0: pid=1731724: Mon Nov 18 16:18:42 2024 00:32:19.099 read: IOPS=46, BW=184KiB/s (189kB/s)(1864KiB/10113msec) 00:32:19.099 slat (nsec): min=8029, max=21750, avg=9936.72, stdev=2840.25 00:32:19.099 clat (msec): min=193, max=514, avg=346.69, stdev=45.86 00:32:19.099 lat (msec): min=193, max=514, avg=346.70, stdev=45.86 00:32:19.099 clat percentiles (msec): 00:32:19.099 | 1.00th=[ 194], 5.00th=[ 284], 10.00th=[ 305], 20.00th=[ 326], 00:32:19.099 | 30.00th=[ 338], 40.00th=[ 342], 50.00th=[ 347], 60.00th=[ 351], 00:32:19.099 | 70.00th=[ 363], 80.00th=[ 368], 90.00th=[ 376], 95.00th=[ 384], 00:32:19.099 | 99.00th=[ 510], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], 00:32:19.099 | 99.99th=[ 514] 00:32:19.099 bw ( KiB/s): min= 128, max= 240, per=4.49%, avg=180.00, stdev=37.03, samples=20 00:32:19.099 iops : min= 32, max= 60, avg=45.00, stdev= 9.26, samples=20 00:32:19.099 lat (msec) : 250=3.43%, 500=94.85%, 750=1.72% 00:32:19.099 cpu : usr=98.92%, sys=0.66%, ctx=26, majf=0, minf=54 00:32:19.099 IO depths : 1=0.4%, 2=2.8%, 4=13.1%, 8=71.5%, 16=12.2%, 32=0.0%, >=64=0.0% 00:32:19.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 complete : 0=0.0%, 4=90.6%, 8=4.0%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 issued rwts: total=466,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.099 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.099 filename1: (groupid=0, jobs=1): err= 0: pid=1731725: Mon Nov 18 16:18:42 2024 00:32:19.099 read: IOPS=45, BW=184KiB/s (188kB/s)(1856KiB/10112msec) 00:32:19.099 slat (usec): min=8, max=139, avg=13.39, stdev=15.22 00:32:19.099 clat (msec): min=181, max=501, avg=348.48, stdev=37.70 00:32:19.099 lat (msec): min=181, max=501, avg=348.50, stdev=37.71 00:32:19.099 clat percentiles (msec): 00:32:19.099 | 1.00th=[ 284], 5.00th=[ 313], 10.00th=[ 317], 20.00th=[ 326], 00:32:19.099 | 30.00th=[ 330], 40.00th=[ 334], 50.00th=[ 347], 60.00th=[ 355], 00:32:19.099 | 70.00th=[ 363], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 376], 00:32:19.099 | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], 00:32:19.099 | 99.99th=[ 502] 00:32:19.099 bw ( KiB/s): min= 128, max= 256, per=4.46%, avg=179.20, stdev=53.09, samples=20 00:32:19.099 iops : min= 32, max= 64, avg=44.80, stdev=13.27, samples=20 00:32:19.099 lat (msec) : 250=0.43%, 500=96.55%, 750=3.02% 00:32:19.099 cpu : usr=99.01%, sys=0.59%, ctx=19, majf=0, minf=59 00:32:19.099 IO depths : 1=0.4%, 2=6.7%, 4=25.0%, 8=55.8%, 16=12.1%, 32=0.0%, >=64=0.0% 00:32:19.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.099 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.099 filename1: (groupid=0, jobs=1): err= 0: pid=1731726: Mon Nov 18 16:18:42 2024 00:32:19.099 read: IOPS=30, BW=120KiB/s (123kB/s)(1216KiB/10096msec) 00:32:19.099 slat (nsec): min=7928, max=53204, avg=34220.24, stdev=8966.31 00:32:19.099 clat (msec): min=358, max=933, avg=531.07, stdev=83.93 00:32:19.099 lat (msec): min=358, max=933, avg=531.10, stdev=83.93 00:32:19.099 clat percentiles (msec): 00:32:19.099 | 1.00th=[ 363], 5.00th=[ 388], 10.00th=[ 447], 20.00th=[ 493], 00:32:19.099 | 30.00th=[ 502], 40.00th=[ 514], 50.00th=[ 527], 60.00th=[ 531], 00:32:19.099 | 70.00th=[ 542], 80.00th=[ 550], 90.00th=[ 558], 95.00th=[ 768], 00:32:19.099 | 99.00th=[ 776], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], 00:32:19.099 | 99.99th=[ 936] 00:32:19.099 bw ( KiB/s): min= 112, max= 144, per=3.19%, avg=128.00, stdev= 9.51, samples=18 00:32:19.099 iops : min= 28, max= 36, avg=32.00, stdev= 2.38, samples=18 00:32:19.099 lat (msec) : 500=29.61%, 750=65.13%, 1000=5.26% 00:32:19.099 cpu : usr=98.39%, sys=1.04%, ctx=11, majf=0, minf=38 00:32:19.099 IO depths : 1=3.6%, 2=9.9%, 4=25.0%, 8=52.6%, 16=8.9%, 32=0.0%, >=64=0.0% 00:32:19.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 issued rwts: total=304,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.099 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.099 filename1: (groupid=0, jobs=1): err= 0: pid=1731727: Mon Nov 18 16:18:42 2024 00:32:19.099 read: IOPS=50, BW=202KiB/s (207kB/s)(2048KiB/10128msec) 00:32:19.099 slat (nsec): min=5225, max=48539, avg=10891.55, stdev=5314.00 00:32:19.099 clat (msec): min=6, max=379, avg=316.31, stdev=88.87 00:32:19.099 lat (msec): min=6, max=379, avg=316.32, stdev=88.87 00:32:19.099 clat percentiles (msec): 00:32:19.099 | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 224], 20.00th=[ 317], 00:32:19.099 | 30.00th=[ 326], 40.00th=[ 330], 50.00th=[ 342], 60.00th=[ 351], 00:32:19.099 | 70.00th=[ 355], 80.00th=[ 368], 90.00th=[ 376], 95.00th=[ 376], 00:32:19.099 | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], 00:32:19.099 | 99.99th=[ 380] 00:32:19.099 bw ( KiB/s): min= 128, max= 496, per=4.94%, avg=198.40, stdev=87.70, samples=20 00:32:19.099 iops : min= 32, max= 124, avg=49.60, stdev=21.92, samples=20 00:32:19.099 lat (msec) : 10=4.49%, 20=1.37%, 50=0.39%, 250=6.25%, 500=87.50% 00:32:19.099 cpu : usr=98.80%, sys=0.75%, ctx=28, majf=0, minf=84 00:32:19.099 IO depths : 1=0.2%, 2=6.2%, 4=24.2%, 8=57.0%, 16=12.3%, 32=0.0%, >=64=0.0% 00:32:19.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 complete : 0=0.0%, 4=94.3%, 8=0.2%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.099 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.099 filename1: (groupid=0, jobs=1): err= 0: pid=1731728: Mon Nov 18 16:18:42 2024 00:32:19.099 read: IOPS=49, BW=197KiB/s (202kB/s)(2000KiB/10127msec) 00:32:19.099 slat (nsec): min=3660, max=39518, avg=10184.02, stdev=4179.87 00:32:19.099 clat (msec): min=3, max=538, avg=323.48, stdev=100.50 00:32:19.099 lat (msec): min=3, max=538, avg=323.49, stdev=100.50 00:32:19.099 clat percentiles (msec): 00:32:19.099 | 1.00th=[ 4], 5.00th=[ 13], 10.00th=[ 224], 20.00th=[ 305], 00:32:19.099 | 30.00th=[ 330], 40.00th=[ 342], 50.00th=[ 347], 60.00th=[ 347], 00:32:19.099 | 70.00th=[ 351], 80.00th=[ 363], 90.00th=[ 388], 95.00th=[ 435], 00:32:19.099 | 99.00th=[ 535], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], 00:32:19.099 | 99.99th=[ 542] 00:32:19.099 bw ( KiB/s): min= 128, max= 432, per=4.81%, avg=193.60, stdev=63.98, samples=20 00:32:19.099 iops : min= 32, max= 108, avg=48.40, stdev=15.99, samples=20 00:32:19.099 lat (msec) : 4=1.80%, 10=2.80%, 20=1.80%, 250=6.00%, 500=83.60% 00:32:19.099 lat (msec) : 750=4.00% 00:32:19.099 cpu : usr=98.76%, sys=0.70%, ctx=25, majf=0, minf=42 00:32:19.099 IO depths : 1=0.4%, 2=1.0%, 4=7.4%, 8=78.8%, 16=12.4%, 32=0.0%, >=64=0.0% 00:32:19.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 complete : 0=0.0%, 4=89.0%, 8=5.9%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 issued rwts: total=500,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.099 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.099 filename2: (groupid=0, jobs=1): err= 0: pid=1731729: Mon Nov 18 16:18:42 2024 00:32:19.099 read: IOPS=45, BW=184KiB/s (188kB/s)(1856KiB/10110msec) 00:32:19.099 slat (usec): min=11, max=110, avg=27.82, stdev=12.75 00:32:19.099 clat (msec): min=282, max=502, avg=348.34, stdev=37.14 00:32:19.099 lat (msec): min=282, max=502, avg=348.37, stdev=37.15 00:32:19.099 clat percentiles (msec): 00:32:19.099 | 1.00th=[ 284], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 326], 00:32:19.099 | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 347], 60.00th=[ 355], 00:32:19.099 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 376], 00:32:19.099 | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], 00:32:19.099 | 99.99th=[ 502] 00:32:19.099 bw ( KiB/s): min= 128, max= 256, per=4.46%, avg=179.20, stdev=64.34, samples=20 00:32:19.099 iops : min= 32, max= 64, avg=44.80, stdev=16.08, samples=20 00:32:19.099 lat (msec) : 500=96.55%, 750=3.45% 00:32:19.099 cpu : usr=98.26%, sys=1.02%, ctx=64, majf=0, minf=48 00:32:19.099 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:19.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.099 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.099 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.099 filename2: (groupid=0, jobs=1): err= 0: pid=1731730: Mon Nov 18 16:18:42 2024 00:32:19.099 read: IOPS=48, BW=196KiB/s (201kB/s)(1984KiB/10126msec) 00:32:19.099 slat (nsec): min=7159, max=73405, avg=11816.55, stdev=6517.18 00:32:19.099 clat (msec): min=13, max=464, avg=326.44, stdev=78.58 00:32:19.099 lat (msec): min=13, max=464, avg=326.45, stdev=78.58 00:32:19.099 clat percentiles (msec): 00:32:19.099 | 1.00th=[ 14], 5.00th=[ 73], 10.00th=[ 313], 20.00th=[ 326], 00:32:19.099 | 30.00th=[ 330], 40.00th=[ 334], 50.00th=[ 342], 60.00th=[ 355], 00:32:19.100 | 70.00th=[ 355], 80.00th=[ 372], 90.00th=[ 376], 95.00th=[ 376], 00:32:19.100 | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 464], 99.95th=[ 464], 00:32:19.100 | 99.99th=[ 464] 00:32:19.100 bw ( KiB/s): min= 128, max= 384, per=4.79%, avg=192.00, stdev=68.67, samples=20 00:32:19.100 iops : min= 32, max= 96, avg=48.00, stdev=17.17, samples=20 00:32:19.100 lat (msec) : 20=3.23%, 100=3.23%, 250=0.40%, 500=93.15% 00:32:19.100 cpu : usr=99.12%, sys=0.48%, ctx=13, majf=0, minf=50 00:32:19.100 IO depths : 1=1.6%, 2=7.9%, 4=25.0%, 8=54.6%, 16=10.9%, 32=0.0%, >=64=0.0% 00:32:19.100 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.100 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.100 filename2: (groupid=0, jobs=1): err= 0: pid=1731731: Mon Nov 18 16:18:42 2024 00:32:19.100 read: IOPS=43, BW=176KiB/s (180kB/s)(1776KiB/10104msec) 00:32:19.100 slat (nsec): min=4370, max=28247, avg=10979.35, stdev=4530.13 00:32:19.100 clat (msec): min=139, max=627, avg=363.58, stdev=71.87 00:32:19.100 lat (msec): min=139, max=627, avg=363.59, stdev=71.87 00:32:19.100 clat percentiles (msec): 00:32:19.100 | 1.00th=[ 140], 5.00th=[ 309], 10.00th=[ 313], 20.00th=[ 330], 00:32:19.100 | 30.00th=[ 338], 40.00th=[ 342], 50.00th=[ 351], 60.00th=[ 355], 00:32:19.100 | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 464], 95.00th=[ 535], 00:32:19.100 | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], 00:32:19.100 | 99.99th=[ 625] 00:32:19.100 bw ( KiB/s): min= 128, max= 256, per=4.49%, avg=180.21, stdev=47.66, samples=19 00:32:19.100 iops : min= 32, max= 64, avg=45.05, stdev=11.91, samples=19 00:32:19.100 lat (msec) : 250=1.35%, 500=92.79%, 750=5.86% 00:32:19.100 cpu : usr=99.14%, sys=0.48%, ctx=15, majf=0, minf=36 00:32:19.100 IO depths : 1=2.5%, 2=5.6%, 4=15.5%, 8=66.2%, 16=10.1%, 32=0.0%, >=64=0.0% 00:32:19.100 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 complete : 0=0.0%, 4=91.2%, 8=3.3%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 issued rwts: total=444,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.100 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.100 filename2: (groupid=0, jobs=1): err= 0: pid=1731732: Mon Nov 18 16:18:42 2024 00:32:19.100 read: IOPS=30, BW=120KiB/s (123kB/s)(1216KiB/10095msec) 00:32:19.100 slat (nsec): min=4065, max=25961, avg=9637.27, stdev=3165.32 00:32:19.100 clat (msec): min=311, max=931, avg=531.21, stdev=116.23 00:32:19.100 lat (msec): min=311, max=931, avg=531.22, stdev=116.23 00:32:19.100 clat percentiles (msec): 00:32:19.100 | 1.00th=[ 313], 5.00th=[ 326], 10.00th=[ 489], 20.00th=[ 493], 00:32:19.100 | 30.00th=[ 498], 40.00th=[ 510], 50.00th=[ 518], 60.00th=[ 531], 00:32:19.100 | 70.00th=[ 542], 80.00th=[ 550], 90.00th=[ 558], 95.00th=[ 936], 00:32:19.100 | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], 00:32:19.100 | 99.99th=[ 936] 00:32:19.100 bw ( KiB/s): min= 128, max= 128, per=3.19%, avg=128.00, stdev= 0.00, samples=18 00:32:19.100 iops : min= 32, max= 32, avg=32.00, stdev= 0.00, samples=18 00:32:19.100 lat (msec) : 500=37.50%, 750=57.24%, 1000=5.26% 00:32:19.100 cpu : usr=99.11%, sys=0.50%, ctx=21, majf=0, minf=54 00:32:19.100 IO depths : 1=4.9%, 2=11.2%, 4=25.0%, 8=51.3%, 16=7.6%, 32=0.0%, >=64=0.0% 00:32:19.100 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 issued rwts: total=304,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.100 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.100 filename2: (groupid=0, jobs=1): err= 0: pid=1731733: Mon Nov 18 16:18:42 2024 00:32:19.100 read: IOPS=31, BW=126KiB/s (129kB/s)(1272KiB/10100msec) 00:32:19.100 slat (nsec): min=4138, max=26483, avg=10688.42, stdev=4180.58 00:32:19.100 clat (msec): min=324, max=773, avg=507.43, stdev=105.33 00:32:19.100 lat (msec): min=324, max=773, avg=507.44, stdev=105.33 00:32:19.100 clat percentiles (msec): 00:32:19.100 | 1.00th=[ 326], 5.00th=[ 330], 10.00th=[ 351], 20.00th=[ 456], 00:32:19.100 | 30.00th=[ 493], 40.00th=[ 506], 50.00th=[ 514], 60.00th=[ 531], 00:32:19.100 | 70.00th=[ 542], 80.00th=[ 550], 90.00th=[ 659], 95.00th=[ 776], 00:32:19.100 | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], 00:32:19.100 | 99.99th=[ 776] 00:32:19.100 bw ( KiB/s): min= 112, max= 144, per=3.19%, avg=128.00, stdev=10.67, samples=19 00:32:19.100 iops : min= 28, max= 36, avg=32.00, stdev= 2.67, samples=19 00:32:19.100 lat (msec) : 500=36.48%, 750=58.49%, 1000=5.03% 00:32:19.100 cpu : usr=99.19%, sys=0.42%, ctx=14, majf=0, minf=51 00:32:19.100 IO depths : 1=2.8%, 2=9.1%, 4=25.2%, 8=53.5%, 16=9.4%, 32=0.0%, >=64=0.0% 00:32:19.100 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 issued rwts: total=318,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.100 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.100 filename2: (groupid=0, jobs=1): err= 0: pid=1731734: Mon Nov 18 16:18:42 2024 00:32:19.100 read: IOPS=45, BW=180KiB/s (185kB/s)(1824KiB/10109msec) 00:32:19.100 slat (nsec): min=8124, max=42026, avg=11663.37, stdev=5360.61 00:32:19.100 clat (msec): min=247, max=534, avg=353.36, stdev=45.86 00:32:19.100 lat (msec): min=247, max=534, avg=353.37, stdev=45.86 00:32:19.100 clat percentiles (msec): 00:32:19.100 | 1.00th=[ 249], 5.00th=[ 292], 10.00th=[ 313], 20.00th=[ 330], 00:32:19.100 | 30.00th=[ 334], 40.00th=[ 342], 50.00th=[ 351], 60.00th=[ 355], 00:32:19.100 | 70.00th=[ 363], 80.00th=[ 372], 90.00th=[ 380], 95.00th=[ 460], 00:32:19.100 | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], 00:32:19.100 | 99.99th=[ 535] 00:32:19.100 bw ( KiB/s): min= 128, max= 240, per=4.39%, avg=176.00, stdev=40.87, samples=20 00:32:19.100 iops : min= 32, max= 60, avg=44.00, stdev=10.22, samples=20 00:32:19.100 lat (msec) : 250=1.32%, 500=95.18%, 750=3.51% 00:32:19.100 cpu : usr=99.13%, sys=0.47%, ctx=16, majf=0, minf=50 00:32:19.100 IO depths : 1=0.4%, 2=3.5%, 4=15.1%, 8=68.6%, 16=12.3%, 32=0.0%, >=64=0.0% 00:32:19.100 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 complete : 0=0.0%, 4=91.2%, 8=3.5%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 issued rwts: total=456,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.100 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.100 filename2: (groupid=0, jobs=1): err= 0: pid=1731735: Mon Nov 18 16:18:42 2024 00:32:19.100 read: IOPS=30, BW=120KiB/s (123kB/s)(1216KiB/10093msec) 00:32:19.100 slat (nsec): min=3973, max=54955, avg=24026.08, stdev=11298.81 00:32:19.100 clat (msec): min=323, max=768, avg=531.01, stdev=82.49 00:32:19.100 lat (msec): min=323, max=768, avg=531.03, stdev=82.49 00:32:19.100 clat percentiles (msec): 00:32:19.100 | 1.00th=[ 342], 5.00th=[ 376], 10.00th=[ 447], 20.00th=[ 493], 00:32:19.100 | 30.00th=[ 502], 40.00th=[ 514], 50.00th=[ 527], 60.00th=[ 531], 00:32:19.100 | 70.00th=[ 542], 80.00th=[ 558], 90.00th=[ 659], 95.00th=[ 768], 00:32:19.100 | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], 00:32:19.100 | 99.99th=[ 768] 00:32:19.100 bw ( KiB/s): min= 112, max= 144, per=3.19%, avg=128.00, stdev= 9.51, samples=18 00:32:19.100 iops : min= 28, max= 36, avg=32.00, stdev= 2.38, samples=18 00:32:19.100 lat (msec) : 500=28.95%, 750=65.79%, 1000=5.26% 00:32:19.100 cpu : usr=99.07%, sys=0.54%, ctx=9, majf=0, minf=51 00:32:19.100 IO depths : 1=3.3%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:32:19.100 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 issued rwts: total=304,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.100 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.100 filename2: (groupid=0, jobs=1): err= 0: pid=1731736: Mon Nov 18 16:18:42 2024 00:32:19.100 read: IOPS=30, BW=120KiB/s (123kB/s)(1216KiB/10095msec) 00:32:19.100 slat (nsec): min=5099, max=55177, avg=27498.91, stdev=9607.59 00:32:19.100 clat (msec): min=323, max=769, avg=530.98, stdev=82.55 00:32:19.100 lat (msec): min=323, max=769, avg=531.01, stdev=82.55 00:32:19.100 clat percentiles (msec): 00:32:19.100 | 1.00th=[ 342], 5.00th=[ 376], 10.00th=[ 447], 20.00th=[ 493], 00:32:19.100 | 30.00th=[ 502], 40.00th=[ 514], 50.00th=[ 527], 60.00th=[ 531], 00:32:19.100 | 70.00th=[ 542], 80.00th=[ 558], 90.00th=[ 659], 95.00th=[ 768], 00:32:19.100 | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], 00:32:19.100 | 99.99th=[ 768] 00:32:19.100 bw ( KiB/s): min= 112, max= 144, per=3.19%, avg=128.00, stdev= 9.51, samples=18 00:32:19.100 iops : min= 28, max= 36, avg=32.00, stdev= 2.38, samples=18 00:32:19.100 lat (msec) : 500=28.95%, 750=65.79%, 1000=5.26% 00:32:19.100 cpu : usr=99.08%, sys=0.52%, ctx=14, majf=0, minf=49 00:32:19.100 IO depths : 1=3.3%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:32:19.100 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:19.100 issued rwts: total=304,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:19.100 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:19.100 00:32:19.100 Run status group 0 (all jobs): 00:32:19.100 READ: bw=4010KiB/s (4107kB/s), 120KiB/s-202KiB/s (123kB/s-207kB/s), io=39.7MiB (41.6MB), run=10092-10128msec 00:32:19.359 16:18:42 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:19.359 16:18:42 -- target/dif.sh@43 -- # local sub 00:32:19.359 16:18:42 -- target/dif.sh@45 -- # for sub in "$@" 00:32:19.359 16:18:42 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:19.359 16:18:42 -- target/dif.sh@36 -- # local sub_id=0 00:32:19.359 16:18:42 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:19.359 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.359 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.359 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.359 16:18:42 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:19.359 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.359 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.359 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.359 16:18:42 -- target/dif.sh@45 -- # for sub in "$@" 00:32:19.359 16:18:42 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:19.359 16:18:42 -- target/dif.sh@36 -- # local sub_id=1 00:32:19.359 16:18:42 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:19.359 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.359 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.359 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.359 16:18:42 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:19.359 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.359 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.359 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.359 16:18:42 -- target/dif.sh@45 -- # for sub in "$@" 00:32:19.359 16:18:42 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:19.359 16:18:42 -- target/dif.sh@36 -- # local sub_id=2 00:32:19.359 16:18:42 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:19.359 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.359 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.359 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.359 16:18:42 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:19.359 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.359 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.359 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.359 16:18:42 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:19.359 16:18:42 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:19.359 16:18:42 -- target/dif.sh@115 -- # numjobs=2 00:32:19.359 16:18:42 -- target/dif.sh@115 -- # iodepth=8 00:32:19.359 16:18:42 -- target/dif.sh@115 -- # runtime=5 00:32:19.359 16:18:42 -- target/dif.sh@115 -- # files=1 00:32:19.359 16:18:42 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:19.359 16:18:42 -- target/dif.sh@28 -- # local sub 00:32:19.359 16:18:42 -- target/dif.sh@30 -- # for sub in "$@" 00:32:19.359 16:18:42 -- target/dif.sh@31 -- # create_subsystem 0 00:32:19.359 16:18:42 -- target/dif.sh@18 -- # local sub_id=0 00:32:19.359 16:18:42 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:19.359 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.359 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.359 bdev_null0 00:32:19.359 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.359 16:18:42 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:19.359 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.359 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.359 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.359 16:18:42 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:19.359 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.359 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.359 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.359 16:18:42 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:19.359 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.359 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.359 [2024-11-18 16:18:42.938070] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:19.359 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.359 16:18:42 -- target/dif.sh@30 -- # for sub in "$@" 00:32:19.359 16:18:42 -- target/dif.sh@31 -- # create_subsystem 1 00:32:19.359 16:18:42 -- target/dif.sh@18 -- # local sub_id=1 00:32:19.359 16:18:42 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:19.359 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.359 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.617 bdev_null1 00:32:19.617 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.617 16:18:42 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:19.617 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.617 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.617 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.617 16:18:42 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:19.617 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.617 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.617 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.617 16:18:42 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:19.617 16:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.617 16:18:42 -- common/autotest_common.sh@10 -- # set +x 00:32:19.617 16:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.617 16:18:42 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:19.617 16:18:42 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:19.617 16:18:42 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:19.617 16:18:42 -- nvmf/common.sh@520 -- # config=() 00:32:19.617 16:18:42 -- nvmf/common.sh@520 -- # local subsystem config 00:32:19.617 16:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:19.618 16:18:42 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:19.618 16:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:19.618 { 00:32:19.618 "params": { 00:32:19.618 "name": "Nvme$subsystem", 00:32:19.618 "trtype": "$TEST_TRANSPORT", 00:32:19.618 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:19.618 "adrfam": "ipv4", 00:32:19.618 "trsvcid": "$NVMF_PORT", 00:32:19.618 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:19.618 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:19.618 "hdgst": ${hdgst:-false}, 00:32:19.618 "ddgst": ${ddgst:-false} 00:32:19.618 }, 00:32:19.618 "method": "bdev_nvme_attach_controller" 00:32:19.618 } 00:32:19.618 EOF 00:32:19.618 )") 00:32:19.618 16:18:42 -- target/dif.sh@82 -- # gen_fio_conf 00:32:19.618 16:18:42 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:19.618 16:18:42 -- target/dif.sh@54 -- # local file 00:32:19.618 16:18:42 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:19.618 16:18:42 -- target/dif.sh@56 -- # cat 00:32:19.618 16:18:42 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:19.618 16:18:42 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:19.618 16:18:42 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:19.618 16:18:42 -- common/autotest_common.sh@1330 -- # shift 00:32:19.618 16:18:42 -- nvmf/common.sh@542 -- # cat 00:32:19.618 16:18:42 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:19.618 16:18:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:19.618 16:18:42 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:19.618 16:18:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:19.618 16:18:42 -- target/dif.sh@72 -- # (( file <= files )) 00:32:19.618 16:18:42 -- target/dif.sh@73 -- # cat 00:32:19.618 16:18:42 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:19.618 16:18:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:19.618 16:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:19.618 16:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:19.618 { 00:32:19.618 "params": { 00:32:19.618 "name": "Nvme$subsystem", 00:32:19.618 "trtype": "$TEST_TRANSPORT", 00:32:19.618 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:19.618 "adrfam": "ipv4", 00:32:19.618 "trsvcid": "$NVMF_PORT", 00:32:19.618 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:19.618 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:19.618 "hdgst": ${hdgst:-false}, 00:32:19.618 "ddgst": ${ddgst:-false} 00:32:19.618 }, 00:32:19.618 "method": "bdev_nvme_attach_controller" 00:32:19.618 } 00:32:19.618 EOF 00:32:19.618 )") 00:32:19.618 16:18:42 -- nvmf/common.sh@542 -- # cat 00:32:19.618 16:18:42 -- target/dif.sh@72 -- # (( file++ )) 00:32:19.618 16:18:42 -- target/dif.sh@72 -- # (( file <= files )) 00:32:19.618 16:18:42 -- nvmf/common.sh@544 -- # jq . 00:32:19.618 16:18:42 -- nvmf/common.sh@545 -- # IFS=, 00:32:19.618 16:18:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:19.618 "params": { 00:32:19.618 "name": "Nvme0", 00:32:19.618 "trtype": "tcp", 00:32:19.618 "traddr": "10.0.0.2", 00:32:19.618 "adrfam": "ipv4", 00:32:19.618 "trsvcid": "4420", 00:32:19.618 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:19.618 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:19.618 "hdgst": false, 00:32:19.618 "ddgst": false 00:32:19.618 }, 00:32:19.618 "method": "bdev_nvme_attach_controller" 00:32:19.618 },{ 00:32:19.618 "params": { 00:32:19.618 "name": "Nvme1", 00:32:19.618 "trtype": "tcp", 00:32:19.618 "traddr": "10.0.0.2", 00:32:19.618 "adrfam": "ipv4", 00:32:19.618 "trsvcid": "4420", 00:32:19.618 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:19.618 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:19.618 "hdgst": false, 00:32:19.618 "ddgst": false 00:32:19.618 }, 00:32:19.618 "method": "bdev_nvme_attach_controller" 00:32:19.618 }' 00:32:19.618 16:18:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:19.618 16:18:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:19.618 16:18:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:19.618 16:18:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:19.618 16:18:42 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:19.618 16:18:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:19.618 16:18:43 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:19.618 16:18:43 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:19.618 16:18:43 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:19.618 16:18:43 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:19.909 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:19.909 ... 00:32:19.909 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:19.909 ... 00:32:19.909 fio-3.35 00:32:19.909 Starting 4 threads 00:32:19.909 EAL: No free 2048 kB hugepages reported on node 1 00:32:20.501 [2024-11-18 16:18:43.878241] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:20.501 [2024-11-18 16:18:43.878314] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:25.764 00:32:25.764 filename0: (groupid=0, jobs=1): err= 0: pid=1733040: Mon Nov 18 16:18:49 2024 00:32:25.764 read: IOPS=1910, BW=14.9MiB/s (15.7MB/s)(74.7MiB/5001msec) 00:32:25.764 slat (nsec): min=4728, max=64814, avg=19795.39, stdev=9308.72 00:32:25.764 clat (usec): min=767, max=7767, avg=4118.32, stdev=598.82 00:32:25.764 lat (usec): min=781, max=7781, avg=4138.12, stdev=598.79 00:32:25.764 clat percentiles (usec): 00:32:25.764 | 1.00th=[ 2540], 5.00th=[ 3294], 10.00th=[ 3523], 20.00th=[ 3818], 00:32:25.764 | 30.00th=[ 3949], 40.00th=[ 4015], 50.00th=[ 4113], 60.00th=[ 4178], 00:32:25.764 | 70.00th=[ 4228], 80.00th=[ 4359], 90.00th=[ 4621], 95.00th=[ 5080], 00:32:25.764 | 99.00th=[ 6325], 99.50th=[ 6783], 99.90th=[ 7504], 99.95th=[ 7570], 00:32:25.764 | 99.99th=[ 7767] 00:32:25.764 bw ( KiB/s): min=14509, max=15936, per=24.97%, avg=15283.22, stdev=477.85, samples=9 00:32:25.764 iops : min= 1813, max= 1992, avg=1910.33, stdev=59.86, samples=9 00:32:25.764 lat (usec) : 1000=0.04% 00:32:25.764 lat (msec) : 2=0.41%, 4=37.29%, 10=62.26% 00:32:25.764 cpu : usr=95.68%, sys=3.74%, ctx=17, majf=0, minf=116 00:32:25.764 IO depths : 1=0.1%, 2=13.7%, 4=58.3%, 8=28.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:25.764 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.764 complete : 0=0.0%, 4=92.5%, 8=7.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.764 issued rwts: total=9556,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:25.764 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:25.764 filename0: (groupid=0, jobs=1): err= 0: pid=1733041: Mon Nov 18 16:18:49 2024 00:32:25.764 read: IOPS=1887, BW=14.7MiB/s (15.5MB/s)(73.8MiB/5004msec) 00:32:25.764 slat (nsec): min=4625, max=68731, avg=16958.17, stdev=10335.96 00:32:25.764 clat (usec): min=756, max=7752, avg=4181.69, stdev=592.85 00:32:25.764 lat (usec): min=765, max=7777, avg=4198.65, stdev=592.46 00:32:25.764 clat percentiles (usec): 00:32:25.764 | 1.00th=[ 2573], 5.00th=[ 3425], 10.00th=[ 3687], 20.00th=[ 3884], 00:32:25.764 | 30.00th=[ 3982], 40.00th=[ 4047], 50.00th=[ 4146], 60.00th=[ 4228], 00:32:25.764 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4686], 95.00th=[ 5211], 00:32:25.764 | 99.00th=[ 6521], 99.50th=[ 6980], 99.90th=[ 7439], 99.95th=[ 7570], 00:32:25.764 | 99.99th=[ 7767] 00:32:25.764 bw ( KiB/s): min=14736, max=15312, per=24.67%, avg=15100.80, stdev=247.16, samples=10 00:32:25.764 iops : min= 1842, max= 1914, avg=1887.60, stdev=30.89, samples=10 00:32:25.764 lat (usec) : 1000=0.05% 00:32:25.764 lat (msec) : 2=0.33%, 4=33.11%, 10=66.51% 00:32:25.764 cpu : usr=95.92%, sys=3.62%, ctx=7, majf=0, minf=62 00:32:25.764 IO depths : 1=0.1%, 2=10.3%, 4=61.4%, 8=28.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:25.764 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.764 complete : 0=0.0%, 4=92.7%, 8=7.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.764 issued rwts: total=9445,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:25.764 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:25.764 filename1: (groupid=0, jobs=1): err= 0: pid=1733042: Mon Nov 18 16:18:49 2024 00:32:25.764 read: IOPS=1907, BW=14.9MiB/s (15.6MB/s)(74.5MiB/5001msec) 00:32:25.764 slat (nsec): min=4632, max=68620, avg=18492.96, stdev=10509.55 00:32:25.764 clat (usec): min=855, max=7583, avg=4128.46, stdev=609.49 00:32:25.764 lat (usec): min=872, max=7614, avg=4146.96, stdev=609.70 00:32:25.764 clat percentiles (usec): 00:32:25.764 | 1.00th=[ 2573], 5.00th=[ 3294], 10.00th=[ 3556], 20.00th=[ 3851], 00:32:25.764 | 30.00th=[ 3949], 40.00th=[ 4015], 50.00th=[ 4113], 60.00th=[ 4178], 00:32:25.764 | 70.00th=[ 4228], 80.00th=[ 4359], 90.00th=[ 4621], 95.00th=[ 5080], 00:32:25.764 | 99.00th=[ 6587], 99.50th=[ 6980], 99.90th=[ 7439], 99.95th=[ 7504], 00:32:25.764 | 99.99th=[ 7570] 00:32:25.764 bw ( KiB/s): min=14416, max=15664, per=24.89%, avg=15233.78, stdev=464.58, samples=9 00:32:25.764 iops : min= 1802, max= 1958, avg=1904.22, stdev=58.07, samples=9 00:32:25.764 lat (usec) : 1000=0.04% 00:32:25.764 lat (msec) : 2=0.43%, 4=37.57%, 10=61.96% 00:32:25.764 cpu : usr=95.66%, sys=3.86%, ctx=8, majf=0, minf=79 00:32:25.764 IO depths : 1=0.1%, 2=13.9%, 4=58.1%, 8=27.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:25.764 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.764 complete : 0=0.0%, 4=92.6%, 8=7.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.764 issued rwts: total=9540,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:25.764 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:25.764 filename1: (groupid=0, jobs=1): err= 0: pid=1733043: Mon Nov 18 16:18:49 2024 00:32:25.764 read: IOPS=1946, BW=15.2MiB/s (15.9MB/s)(76.1MiB/5003msec) 00:32:25.764 slat (nsec): min=6814, max=65642, avg=15850.66, stdev=9743.47 00:32:25.764 clat (usec): min=692, max=7503, avg=4058.19, stdev=581.05 00:32:25.764 lat (usec): min=706, max=7526, avg=4074.04, stdev=581.72 00:32:25.764 clat percentiles (usec): 00:32:25.764 | 1.00th=[ 2376], 5.00th=[ 3163], 10.00th=[ 3392], 20.00th=[ 3720], 00:32:25.764 | 30.00th=[ 3884], 40.00th=[ 3982], 50.00th=[ 4080], 60.00th=[ 4146], 00:32:25.764 | 70.00th=[ 4228], 80.00th=[ 4359], 90.00th=[ 4555], 95.00th=[ 4883], 00:32:25.764 | 99.00th=[ 6128], 99.50th=[ 6521], 99.90th=[ 7177], 99.95th=[ 7308], 00:32:25.764 | 99.99th=[ 7504] 00:32:25.764 bw ( KiB/s): min=14976, max=16864, per=25.44%, avg=15571.20, stdev=583.50, samples=10 00:32:25.764 iops : min= 1872, max= 2108, avg=1946.40, stdev=72.94, samples=10 00:32:25.764 lat (usec) : 750=0.01%, 1000=0.01% 00:32:25.764 lat (msec) : 2=0.32%, 4=40.68%, 10=58.99% 00:32:25.764 cpu : usr=95.64%, sys=3.74%, ctx=48, majf=0, minf=105 00:32:25.764 IO depths : 1=0.2%, 2=10.6%, 4=60.2%, 8=29.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:25.764 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.764 complete : 0=0.0%, 4=93.3%, 8=6.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.764 issued rwts: total=9738,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:25.764 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:25.764 00:32:25.764 Run status group 0 (all jobs): 00:32:25.764 READ: bw=59.8MiB/s (62.7MB/s), 14.7MiB/s-15.2MiB/s (15.5MB/s-15.9MB/s), io=299MiB (314MB), run=5001-5004msec 00:32:25.764 16:18:49 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:25.764 16:18:49 -- target/dif.sh@43 -- # local sub 00:32:25.764 16:18:49 -- target/dif.sh@45 -- # for sub in "$@" 00:32:25.764 16:18:49 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:25.764 16:18:49 -- target/dif.sh@36 -- # local sub_id=0 00:32:25.765 16:18:49 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:25.765 16:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:25.765 16:18:49 -- common/autotest_common.sh@10 -- # set +x 00:32:25.765 16:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:25.765 16:18:49 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:25.765 16:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:25.765 16:18:49 -- common/autotest_common.sh@10 -- # set +x 00:32:25.765 16:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:25.765 16:18:49 -- target/dif.sh@45 -- # for sub in "$@" 00:32:25.765 16:18:49 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:25.765 16:18:49 -- target/dif.sh@36 -- # local sub_id=1 00:32:25.765 16:18:49 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:25.765 16:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:25.765 16:18:49 -- common/autotest_common.sh@10 -- # set +x 00:32:25.765 16:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:25.765 16:18:49 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:25.765 16:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:25.765 16:18:49 -- common/autotest_common.sh@10 -- # set +x 00:32:25.765 16:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:25.765 00:32:25.765 real 0m24.220s 00:32:25.765 user 4m37.453s 00:32:25.765 sys 0m4.218s 00:32:25.765 16:18:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:25.765 16:18:49 -- common/autotest_common.sh@10 -- # set +x 00:32:25.765 ************************************ 00:32:25.765 END TEST fio_dif_rand_params 00:32:25.765 ************************************ 00:32:25.765 16:18:49 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:25.765 16:18:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:25.765 16:18:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:25.765 16:18:49 -- common/autotest_common.sh@10 -- # set +x 00:32:25.765 ************************************ 00:32:25.765 START TEST fio_dif_digest 00:32:25.765 ************************************ 00:32:26.023 16:18:49 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:32:26.023 16:18:49 -- target/dif.sh@123 -- # local NULL_DIF 00:32:26.023 16:18:49 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:26.023 16:18:49 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:26.023 16:18:49 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:26.023 16:18:49 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:26.023 16:18:49 -- target/dif.sh@127 -- # numjobs=3 00:32:26.023 16:18:49 -- target/dif.sh@127 -- # iodepth=3 00:32:26.023 16:18:49 -- target/dif.sh@127 -- # runtime=10 00:32:26.023 16:18:49 -- target/dif.sh@128 -- # hdgst=true 00:32:26.023 16:18:49 -- target/dif.sh@128 -- # ddgst=true 00:32:26.023 16:18:49 -- target/dif.sh@130 -- # create_subsystems 0 00:32:26.023 16:18:49 -- target/dif.sh@28 -- # local sub 00:32:26.023 16:18:49 -- target/dif.sh@30 -- # for sub in "$@" 00:32:26.023 16:18:49 -- target/dif.sh@31 -- # create_subsystem 0 00:32:26.023 16:18:49 -- target/dif.sh@18 -- # local sub_id=0 00:32:26.023 16:18:49 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:26.023 16:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:26.023 16:18:49 -- common/autotest_common.sh@10 -- # set +x 00:32:26.023 bdev_null0 00:32:26.023 16:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:26.023 16:18:49 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:26.023 16:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:26.023 16:18:49 -- common/autotest_common.sh@10 -- # set +x 00:32:26.023 16:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:26.023 16:18:49 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:26.023 16:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:26.023 16:18:49 -- common/autotest_common.sh@10 -- # set +x 00:32:26.023 16:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:26.023 16:18:49 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:26.023 16:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:26.023 16:18:49 -- common/autotest_common.sh@10 -- # set +x 00:32:26.023 [2024-11-18 16:18:49.387418] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:26.023 16:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:26.023 16:18:49 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:26.023 16:18:49 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:26.023 16:18:49 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:26.023 16:18:49 -- nvmf/common.sh@520 -- # config=() 00:32:26.023 16:18:49 -- nvmf/common.sh@520 -- # local subsystem config 00:32:26.023 16:18:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:26.023 16:18:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:26.023 { 00:32:26.023 "params": { 00:32:26.023 "name": "Nvme$subsystem", 00:32:26.023 "trtype": "$TEST_TRANSPORT", 00:32:26.023 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:26.023 "adrfam": "ipv4", 00:32:26.023 "trsvcid": "$NVMF_PORT", 00:32:26.023 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:26.023 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:26.023 "hdgst": ${hdgst:-false}, 00:32:26.023 "ddgst": ${ddgst:-false} 00:32:26.023 }, 00:32:26.023 "method": "bdev_nvme_attach_controller" 00:32:26.023 } 00:32:26.023 EOF 00:32:26.023 )") 00:32:26.023 16:18:49 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:26.023 16:18:49 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:26.023 16:18:49 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:26.023 16:18:49 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:26.023 16:18:49 -- target/dif.sh@82 -- # gen_fio_conf 00:32:26.023 16:18:49 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:26.023 16:18:49 -- target/dif.sh@54 -- # local file 00:32:26.023 16:18:49 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:26.024 16:18:49 -- common/autotest_common.sh@1330 -- # shift 00:32:26.024 16:18:49 -- target/dif.sh@56 -- # cat 00:32:26.024 16:18:49 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:26.024 16:18:49 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:26.024 16:18:49 -- nvmf/common.sh@542 -- # cat 00:32:26.024 16:18:49 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:26.024 16:18:49 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:26.024 16:18:49 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:26.024 16:18:49 -- target/dif.sh@72 -- # (( file <= files )) 00:32:26.024 16:18:49 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:26.024 16:18:49 -- nvmf/common.sh@544 -- # jq . 00:32:26.024 16:18:49 -- nvmf/common.sh@545 -- # IFS=, 00:32:26.024 16:18:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:26.024 "params": { 00:32:26.024 "name": "Nvme0", 00:32:26.024 "trtype": "tcp", 00:32:26.024 "traddr": "10.0.0.2", 00:32:26.024 "adrfam": "ipv4", 00:32:26.024 "trsvcid": "4420", 00:32:26.024 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:26.024 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:26.024 "hdgst": true, 00:32:26.024 "ddgst": true 00:32:26.024 }, 00:32:26.024 "method": "bdev_nvme_attach_controller" 00:32:26.024 }' 00:32:26.024 16:18:49 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:26.024 16:18:49 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:26.024 16:18:49 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:26.024 16:18:49 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:26.024 16:18:49 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:26.024 16:18:49 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:26.024 16:18:49 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:26.024 16:18:49 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:26.024 16:18:49 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:26.024 16:18:49 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:26.282 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:26.282 ... 00:32:26.282 fio-3.35 00:32:26.282 Starting 3 threads 00:32:26.282 EAL: No free 2048 kB hugepages reported on node 1 00:32:26.540 [2024-11-18 16:18:50.024040] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:26.540 [2024-11-18 16:18:50.024112] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:38.737 00:32:38.737 filename0: (groupid=0, jobs=1): err= 0: pid=1733938: Mon Nov 18 16:19:00 2024 00:32:38.737 read: IOPS=205, BW=25.7MiB/s (26.9MB/s)(258MiB/10046msec) 00:32:38.737 slat (nsec): min=4917, max=59848, avg=17728.39, stdev=3998.82 00:32:38.737 clat (usec): min=11553, max=51614, avg=14573.34, stdev=1475.90 00:32:38.737 lat (usec): min=11571, max=51630, avg=14591.07, stdev=1475.84 00:32:38.737 clat percentiles (usec): 00:32:38.737 | 1.00th=[12256], 5.00th=[13042], 10.00th=[13304], 20.00th=[13829], 00:32:38.737 | 30.00th=[14091], 40.00th=[14353], 50.00th=[14484], 60.00th=[14746], 00:32:38.737 | 70.00th=[15008], 80.00th=[15270], 90.00th=[15664], 95.00th=[16057], 00:32:38.737 | 99.00th=[16909], 99.50th=[17433], 99.90th=[23462], 99.95th=[49021], 00:32:38.737 | 99.99th=[51643] 00:32:38.737 bw ( KiB/s): min=25138, max=27392, per=32.89%, avg=26357.70, stdev=501.97, samples=20 00:32:38.737 iops : min= 196, max= 214, avg=205.90, stdev= 3.97, samples=20 00:32:38.737 lat (msec) : 20=99.85%, 50=0.10%, 100=0.05% 00:32:38.737 cpu : usr=95.61%, sys=3.82%, ctx=25, majf=0, minf=240 00:32:38.737 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:38.737 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.737 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.737 issued rwts: total=2062,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:38.737 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:38.737 filename0: (groupid=0, jobs=1): err= 0: pid=1733939: Mon Nov 18 16:19:00 2024 00:32:38.737 read: IOPS=206, BW=25.8MiB/s (27.1MB/s)(260MiB/10045msec) 00:32:38.737 slat (nsec): min=5026, max=43467, avg=17311.74, stdev=3765.13 00:32:38.737 clat (usec): min=10806, max=55112, avg=14467.24, stdev=1519.42 00:32:38.737 lat (usec): min=10837, max=55126, avg=14484.55, stdev=1519.45 00:32:38.737 clat percentiles (usec): 00:32:38.737 | 1.00th=[12125], 5.00th=[12911], 10.00th=[13173], 20.00th=[13698], 00:32:38.737 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14615], 00:32:38.737 | 70.00th=[14877], 80.00th=[15139], 90.00th=[15664], 95.00th=[16057], 00:32:38.737 | 99.00th=[16909], 99.50th=[17171], 99.90th=[19530], 99.95th=[49021], 00:32:38.737 | 99.99th=[55313] 00:32:38.737 bw ( KiB/s): min=25907, max=27136, per=33.15%, avg=26562.55, stdev=365.32, samples=20 00:32:38.737 iops : min= 202, max= 212, avg=207.50, stdev= 2.89, samples=20 00:32:38.737 lat (msec) : 20=99.90%, 50=0.05%, 100=0.05% 00:32:38.737 cpu : usr=93.53%, sys=4.90%, ctx=197, majf=0, minf=102 00:32:38.737 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:38.737 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.737 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.737 issued rwts: total=2077,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:38.737 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:38.737 filename0: (groupid=0, jobs=1): err= 0: pid=1733940: Mon Nov 18 16:19:00 2024 00:32:38.737 read: IOPS=214, BW=26.8MiB/s (28.1MB/s)(269MiB/10046msec) 00:32:38.737 slat (nsec): min=7525, max=78042, avg=17714.54, stdev=4112.15 00:32:38.737 clat (usec): min=10776, max=50523, avg=13975.87, stdev=1456.30 00:32:38.737 lat (usec): min=10788, max=50543, avg=13993.58, stdev=1456.30 00:32:38.737 clat percentiles (usec): 00:32:38.737 | 1.00th=[11600], 5.00th=[12387], 10.00th=[12649], 20.00th=[13173], 00:32:38.737 | 30.00th=[13435], 40.00th=[13698], 50.00th=[13960], 60.00th=[14222], 00:32:38.737 | 70.00th=[14484], 80.00th=[14746], 90.00th=[15139], 95.00th=[15533], 00:32:38.737 | 99.00th=[16319], 99.50th=[16909], 99.90th=[19792], 99.95th=[47449], 00:32:38.737 | 99.99th=[50594] 00:32:38.737 bw ( KiB/s): min=26880, max=28416, per=34.31%, avg=27494.40, stdev=442.63, samples=20 00:32:38.737 iops : min= 210, max= 222, avg=214.80, stdev= 3.46, samples=20 00:32:38.737 lat (msec) : 20=99.91%, 50=0.05%, 100=0.05% 00:32:38.737 cpu : usr=95.48%, sys=4.04%, ctx=15, majf=0, minf=192 00:32:38.737 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:38.737 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.737 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:38.737 issued rwts: total=2150,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:38.737 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:38.737 00:32:38.737 Run status group 0 (all jobs): 00:32:38.737 READ: bw=78.3MiB/s (82.1MB/s), 25.7MiB/s-26.8MiB/s (26.9MB/s-28.1MB/s), io=786MiB (824MB), run=10045-10046msec 00:32:38.737 16:19:00 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:38.737 16:19:00 -- target/dif.sh@43 -- # local sub 00:32:38.737 16:19:00 -- target/dif.sh@45 -- # for sub in "$@" 00:32:38.737 16:19:00 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:38.737 16:19:00 -- target/dif.sh@36 -- # local sub_id=0 00:32:38.737 16:19:00 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:38.737 16:19:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:38.737 16:19:00 -- common/autotest_common.sh@10 -- # set +x 00:32:38.737 16:19:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:38.737 16:19:00 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:38.737 16:19:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:38.737 16:19:00 -- common/autotest_common.sh@10 -- # set +x 00:32:38.737 16:19:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:38.737 00:32:38.737 real 0m11.037s 00:32:38.737 user 0m29.574s 00:32:38.737 sys 0m1.523s 00:32:38.737 16:19:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:38.737 16:19:00 -- common/autotest_common.sh@10 -- # set +x 00:32:38.737 ************************************ 00:32:38.737 END TEST fio_dif_digest 00:32:38.737 ************************************ 00:32:38.737 16:19:00 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:38.737 16:19:00 -- target/dif.sh@147 -- # nvmftestfini 00:32:38.737 16:19:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:38.737 16:19:00 -- nvmf/common.sh@116 -- # sync 00:32:38.737 16:19:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:38.737 16:19:00 -- nvmf/common.sh@119 -- # set +e 00:32:38.737 16:19:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:38.737 16:19:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:38.737 rmmod nvme_tcp 00:32:38.737 rmmod nvme_fabrics 00:32:38.737 rmmod nvme_keyring 00:32:38.737 16:19:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:38.737 16:19:00 -- nvmf/common.sh@123 -- # set -e 00:32:38.737 16:19:00 -- nvmf/common.sh@124 -- # return 0 00:32:38.737 16:19:00 -- nvmf/common.sh@477 -- # '[' -n 1727196 ']' 00:32:38.737 16:19:00 -- nvmf/common.sh@478 -- # killprocess 1727196 00:32:38.737 16:19:00 -- common/autotest_common.sh@936 -- # '[' -z 1727196 ']' 00:32:38.737 16:19:00 -- common/autotest_common.sh@940 -- # kill -0 1727196 00:32:38.737 16:19:00 -- common/autotest_common.sh@941 -- # uname 00:32:38.737 16:19:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:38.737 16:19:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1727196 00:32:38.737 16:19:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:38.737 16:19:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:38.737 16:19:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1727196' 00:32:38.737 killing process with pid 1727196 00:32:38.737 16:19:00 -- common/autotest_common.sh@955 -- # kill 1727196 00:32:38.737 16:19:00 -- common/autotest_common.sh@960 -- # wait 1727196 00:32:38.737 16:19:00 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:38.737 16:19:00 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:38.737 Waiting for block devices as requested 00:32:38.737 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:38.737 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:38.737 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:38.737 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:38.737 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:38.737 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:38.996 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:38.996 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:38.996 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:38.996 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:38.996 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:39.253 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:39.253 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:39.253 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:39.253 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:39.511 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:39.511 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:39.511 16:19:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:39.511 16:19:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:39.511 16:19:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:39.511 16:19:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:39.511 16:19:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:39.511 16:19:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:39.511 16:19:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:42.041 16:19:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:42.041 00:32:42.041 real 1m6.837s 00:32:42.041 user 6m35.452s 00:32:42.041 sys 0m14.245s 00:32:42.041 16:19:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:42.041 16:19:05 -- common/autotest_common.sh@10 -- # set +x 00:32:42.041 ************************************ 00:32:42.041 END TEST nvmf_dif 00:32:42.041 ************************************ 00:32:42.041 16:19:05 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:42.041 16:19:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:42.041 16:19:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:42.041 16:19:05 -- common/autotest_common.sh@10 -- # set +x 00:32:42.041 ************************************ 00:32:42.041 START TEST nvmf_abort_qd_sizes 00:32:42.041 ************************************ 00:32:42.041 16:19:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:42.041 * Looking for test storage... 00:32:42.041 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:42.041 16:19:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:42.041 16:19:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:42.041 16:19:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:42.041 16:19:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:42.041 16:19:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:42.041 16:19:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:42.041 16:19:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:42.041 16:19:05 -- scripts/common.sh@335 -- # IFS=.-: 00:32:42.041 16:19:05 -- scripts/common.sh@335 -- # read -ra ver1 00:32:42.041 16:19:05 -- scripts/common.sh@336 -- # IFS=.-: 00:32:42.041 16:19:05 -- scripts/common.sh@336 -- # read -ra ver2 00:32:42.041 16:19:05 -- scripts/common.sh@337 -- # local 'op=<' 00:32:42.041 16:19:05 -- scripts/common.sh@339 -- # ver1_l=2 00:32:42.041 16:19:05 -- scripts/common.sh@340 -- # ver2_l=1 00:32:42.041 16:19:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:42.041 16:19:05 -- scripts/common.sh@343 -- # case "$op" in 00:32:42.041 16:19:05 -- scripts/common.sh@344 -- # : 1 00:32:42.041 16:19:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:42.041 16:19:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:42.041 16:19:05 -- scripts/common.sh@364 -- # decimal 1 00:32:42.041 16:19:05 -- scripts/common.sh@352 -- # local d=1 00:32:42.041 16:19:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:42.041 16:19:05 -- scripts/common.sh@354 -- # echo 1 00:32:42.041 16:19:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:42.041 16:19:05 -- scripts/common.sh@365 -- # decimal 2 00:32:42.041 16:19:05 -- scripts/common.sh@352 -- # local d=2 00:32:42.041 16:19:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:42.041 16:19:05 -- scripts/common.sh@354 -- # echo 2 00:32:42.041 16:19:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:42.041 16:19:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:42.041 16:19:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:42.041 16:19:05 -- scripts/common.sh@367 -- # return 0 00:32:42.041 16:19:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:42.041 16:19:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:42.041 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:42.041 --rc genhtml_branch_coverage=1 00:32:42.041 --rc genhtml_function_coverage=1 00:32:42.041 --rc genhtml_legend=1 00:32:42.041 --rc geninfo_all_blocks=1 00:32:42.041 --rc geninfo_unexecuted_blocks=1 00:32:42.041 00:32:42.041 ' 00:32:42.041 16:19:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:42.041 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:42.041 --rc genhtml_branch_coverage=1 00:32:42.041 --rc genhtml_function_coverage=1 00:32:42.041 --rc genhtml_legend=1 00:32:42.041 --rc geninfo_all_blocks=1 00:32:42.041 --rc geninfo_unexecuted_blocks=1 00:32:42.041 00:32:42.041 ' 00:32:42.041 16:19:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:42.041 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:42.041 --rc genhtml_branch_coverage=1 00:32:42.041 --rc genhtml_function_coverage=1 00:32:42.041 --rc genhtml_legend=1 00:32:42.041 --rc geninfo_all_blocks=1 00:32:42.041 --rc geninfo_unexecuted_blocks=1 00:32:42.041 00:32:42.041 ' 00:32:42.041 16:19:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:42.041 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:42.041 --rc genhtml_branch_coverage=1 00:32:42.041 --rc genhtml_function_coverage=1 00:32:42.041 --rc genhtml_legend=1 00:32:42.041 --rc geninfo_all_blocks=1 00:32:42.041 --rc geninfo_unexecuted_blocks=1 00:32:42.041 00:32:42.041 ' 00:32:42.041 16:19:05 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:42.041 16:19:05 -- nvmf/common.sh@7 -- # uname -s 00:32:42.041 16:19:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:42.041 16:19:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:42.041 16:19:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:42.041 16:19:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:42.041 16:19:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:42.041 16:19:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:42.041 16:19:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:42.041 16:19:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:42.041 16:19:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:42.041 16:19:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:42.041 16:19:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:42.041 16:19:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:42.041 16:19:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:42.041 16:19:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:42.041 16:19:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:42.041 16:19:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:42.041 16:19:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:42.041 16:19:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:42.041 16:19:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:42.041 16:19:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:42.041 16:19:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:42.041 16:19:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:42.041 16:19:05 -- paths/export.sh@5 -- # export PATH 00:32:42.041 16:19:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:42.041 16:19:05 -- nvmf/common.sh@46 -- # : 0 00:32:42.041 16:19:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:42.041 16:19:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:42.042 16:19:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:42.042 16:19:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:42.042 16:19:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:42.042 16:19:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:42.042 16:19:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:42.042 16:19:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:42.042 16:19:05 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:42.042 16:19:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:42.042 16:19:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:42.042 16:19:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:42.042 16:19:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:42.042 16:19:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:42.042 16:19:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:42.042 16:19:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:42.042 16:19:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:42.042 16:19:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:42.042 16:19:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:42.042 16:19:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:42.042 16:19:05 -- common/autotest_common.sh@10 -- # set +x 00:32:43.942 16:19:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:43.942 16:19:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:43.942 16:19:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:43.942 16:19:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:43.942 16:19:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:43.942 16:19:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:43.942 16:19:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:43.942 16:19:07 -- nvmf/common.sh@294 -- # net_devs=() 00:32:43.942 16:19:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:43.942 16:19:07 -- nvmf/common.sh@295 -- # e810=() 00:32:43.942 16:19:07 -- nvmf/common.sh@295 -- # local -ga e810 00:32:43.942 16:19:07 -- nvmf/common.sh@296 -- # x722=() 00:32:43.942 16:19:07 -- nvmf/common.sh@296 -- # local -ga x722 00:32:43.942 16:19:07 -- nvmf/common.sh@297 -- # mlx=() 00:32:43.942 16:19:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:43.942 16:19:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:43.942 16:19:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:43.942 16:19:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:43.942 16:19:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:43.942 16:19:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:43.942 16:19:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:43.942 16:19:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:43.942 16:19:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:43.942 16:19:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:43.942 16:19:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:43.942 16:19:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:43.942 16:19:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:43.942 16:19:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:43.942 16:19:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:43.942 16:19:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:43.942 16:19:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:43.942 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:43.942 16:19:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:43.942 16:19:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:43.942 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:43.942 16:19:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:43.942 16:19:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:43.942 16:19:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:43.942 16:19:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:43.942 16:19:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:43.942 16:19:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:43.942 16:19:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:43.942 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:43.942 16:19:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:43.942 16:19:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:43.943 16:19:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:43.943 16:19:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:43.943 16:19:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:43.943 16:19:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:43.943 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:43.943 16:19:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:43.943 16:19:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:43.943 16:19:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:43.943 16:19:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:43.943 16:19:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:43.943 16:19:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:43.943 16:19:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:43.943 16:19:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:43.943 16:19:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:43.943 16:19:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:43.943 16:19:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:43.943 16:19:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:43.943 16:19:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:43.943 16:19:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:43.943 16:19:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:43.943 16:19:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:43.943 16:19:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:43.943 16:19:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:43.943 16:19:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:43.943 16:19:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:43.943 16:19:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:43.943 16:19:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:43.943 16:19:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:43.943 16:19:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:43.943 16:19:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:43.943 16:19:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:43.943 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:43.943 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.334 ms 00:32:43.943 00:32:43.943 --- 10.0.0.2 ping statistics --- 00:32:43.943 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:43.943 rtt min/avg/max/mdev = 0.334/0.334/0.334/0.000 ms 00:32:43.943 16:19:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:43.943 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:43.943 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:32:43.943 00:32:43.943 --- 10.0.0.1 ping statistics --- 00:32:43.943 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:43.943 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:32:43.943 16:19:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:43.943 16:19:07 -- nvmf/common.sh@410 -- # return 0 00:32:43.943 16:19:07 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:43.943 16:19:07 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:45.316 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:45.316 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:45.316 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:45.316 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:45.316 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:45.316 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:45.316 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:45.316 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:45.316 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:45.316 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:45.316 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:45.316 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:45.316 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:45.316 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:45.316 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:45.316 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:46.248 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:46.248 16:19:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:46.248 16:19:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:46.248 16:19:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:46.248 16:19:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:46.248 16:19:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:46.248 16:19:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:46.248 16:19:09 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:46.248 16:19:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:46.248 16:19:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:46.248 16:19:09 -- common/autotest_common.sh@10 -- # set +x 00:32:46.248 16:19:09 -- nvmf/common.sh@469 -- # nvmfpid=1738837 00:32:46.248 16:19:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:46.248 16:19:09 -- nvmf/common.sh@470 -- # waitforlisten 1738837 00:32:46.248 16:19:09 -- common/autotest_common.sh@829 -- # '[' -z 1738837 ']' 00:32:46.248 16:19:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:46.248 16:19:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:46.248 16:19:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:46.248 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:46.248 16:19:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:46.248 16:19:09 -- common/autotest_common.sh@10 -- # set +x 00:32:46.248 [2024-11-18 16:19:09.807942] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:32:46.248 [2024-11-18 16:19:09.808026] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:46.506 EAL: No free 2048 kB hugepages reported on node 1 00:32:46.506 [2024-11-18 16:19:09.873274] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:46.506 [2024-11-18 16:19:09.976831] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:46.506 [2024-11-18 16:19:09.976989] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:46.506 [2024-11-18 16:19:09.977007] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:46.506 [2024-11-18 16:19:09.977020] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:46.506 [2024-11-18 16:19:09.977077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:46.506 [2024-11-18 16:19:09.977137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:46.506 [2024-11-18 16:19:09.977186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:46.506 [2024-11-18 16:19:09.977189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:47.438 16:19:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:47.438 16:19:10 -- common/autotest_common.sh@862 -- # return 0 00:32:47.438 16:19:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:47.438 16:19:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:47.438 16:19:10 -- common/autotest_common.sh@10 -- # set +x 00:32:47.438 16:19:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:47.438 16:19:10 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:47.438 16:19:10 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:47.438 16:19:10 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:47.438 16:19:10 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:47.438 16:19:10 -- scripts/common.sh@312 -- # local nvmes 00:32:47.438 16:19:10 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:47.438 16:19:10 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:47.438 16:19:10 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:47.438 16:19:10 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:47.438 16:19:10 -- scripts/common.sh@322 -- # uname -s 00:32:47.439 16:19:10 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:47.439 16:19:10 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:47.439 16:19:10 -- scripts/common.sh@327 -- # (( 1 )) 00:32:47.439 16:19:10 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:47.439 16:19:10 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:47.439 16:19:10 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:47.439 16:19:10 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:47.439 16:19:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:47.439 16:19:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:47.439 16:19:10 -- common/autotest_common.sh@10 -- # set +x 00:32:47.439 ************************************ 00:32:47.439 START TEST spdk_target_abort 00:32:47.439 ************************************ 00:32:47.439 16:19:10 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:47.439 16:19:10 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:47.439 16:19:10 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:47.439 16:19:10 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:47.439 16:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:47.439 16:19:10 -- common/autotest_common.sh@10 -- # set +x 00:32:50.719 spdk_targetn1 00:32:50.719 16:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:50.719 16:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:50.719 16:19:13 -- common/autotest_common.sh@10 -- # set +x 00:32:50.719 [2024-11-18 16:19:13.660966] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:50.719 16:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:50.719 16:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:50.719 16:19:13 -- common/autotest_common.sh@10 -- # set +x 00:32:50.719 16:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:50.719 16:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:50.719 16:19:13 -- common/autotest_common.sh@10 -- # set +x 00:32:50.719 16:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:50.719 16:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:50.719 16:19:13 -- common/autotest_common.sh@10 -- # set +x 00:32:50.719 [2024-11-18 16:19:13.693246] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:50.719 16:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:50.719 16:19:13 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:50.719 EAL: No free 2048 kB hugepages reported on node 1 00:32:53.247 Initializing NVMe Controllers 00:32:53.247 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:53.247 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:53.247 Initialization complete. Launching workers. 00:32:53.247 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 11331, failed: 0 00:32:53.247 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1171, failed to submit 10160 00:32:53.247 success 766, unsuccess 405, failed 0 00:32:53.247 16:19:16 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:53.247 16:19:16 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:53.504 EAL: No free 2048 kB hugepages reported on node 1 00:32:56.780 Initializing NVMe Controllers 00:32:56.780 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:56.780 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:56.780 Initialization complete. Launching workers. 00:32:56.780 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8669, failed: 0 00:32:56.780 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1229, failed to submit 7440 00:32:56.780 success 333, unsuccess 896, failed 0 00:32:56.780 16:19:20 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:56.780 16:19:20 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:56.780 EAL: No free 2048 kB hugepages reported on node 1 00:33:00.058 Initializing NVMe Controllers 00:33:00.058 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:33:00.058 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:33:00.058 Initialization complete. Launching workers. 00:33:00.058 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32135, failed: 0 00:33:00.058 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2779, failed to submit 29356 00:33:00.058 success 515, unsuccess 2264, failed 0 00:33:00.058 16:19:23 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:33:00.058 16:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:00.058 16:19:23 -- common/autotest_common.sh@10 -- # set +x 00:33:00.058 16:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:00.058 16:19:23 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:33:00.058 16:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:33:00.058 16:19:23 -- common/autotest_common.sh@10 -- # set +x 00:33:01.430 16:19:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:33:01.430 16:19:24 -- target/abort_qd_sizes.sh@62 -- # killprocess 1738837 00:33:01.430 16:19:24 -- common/autotest_common.sh@936 -- # '[' -z 1738837 ']' 00:33:01.430 16:19:24 -- common/autotest_common.sh@940 -- # kill -0 1738837 00:33:01.430 16:19:24 -- common/autotest_common.sh@941 -- # uname 00:33:01.430 16:19:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:33:01.430 16:19:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1738837 00:33:01.430 16:19:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:33:01.430 16:19:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:33:01.430 16:19:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1738837' 00:33:01.430 killing process with pid 1738837 00:33:01.430 16:19:24 -- common/autotest_common.sh@955 -- # kill 1738837 00:33:01.430 16:19:24 -- common/autotest_common.sh@960 -- # wait 1738837 00:33:01.430 00:33:01.430 real 0m14.189s 00:33:01.430 user 0m56.547s 00:33:01.430 sys 0m2.421s 00:33:01.430 16:19:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:01.430 16:19:25 -- common/autotest_common.sh@10 -- # set +x 00:33:01.430 ************************************ 00:33:01.430 END TEST spdk_target_abort 00:33:01.430 ************************************ 00:33:01.689 16:19:25 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:33:01.689 16:19:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:01.689 16:19:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:01.689 16:19:25 -- common/autotest_common.sh@10 -- # set +x 00:33:01.689 ************************************ 00:33:01.689 START TEST kernel_target_abort 00:33:01.689 ************************************ 00:33:01.689 16:19:25 -- common/autotest_common.sh@1114 -- # kernel_target 00:33:01.689 16:19:25 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:33:01.689 16:19:25 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:33:01.689 16:19:25 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:33:01.689 16:19:25 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:33:01.689 16:19:25 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:33:01.689 16:19:25 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:01.689 16:19:25 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:33:01.689 16:19:25 -- nvmf/common.sh@627 -- # local block nvme 00:33:01.689 16:19:25 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:33:01.689 16:19:25 -- nvmf/common.sh@630 -- # modprobe nvmet 00:33:01.689 16:19:25 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:33:01.689 16:19:25 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:02.623 Waiting for block devices as requested 00:33:02.623 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:33:02.921 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:02.921 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:02.921 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:03.206 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:03.206 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:03.206 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:03.206 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:03.206 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:03.463 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:33:03.463 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:33:03.463 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:33:03.721 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:33:03.721 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:33:03.721 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:33:03.721 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:33:03.980 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:33:03.980 16:19:27 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:33:03.980 16:19:27 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:33:03.980 16:19:27 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:33:03.980 16:19:27 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:33:03.980 16:19:27 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:33:03.980 No valid GPT data, bailing 00:33:03.980 16:19:27 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:33:03.980 16:19:27 -- scripts/common.sh@393 -- # pt= 00:33:03.980 16:19:27 -- scripts/common.sh@394 -- # return 1 00:33:03.980 16:19:27 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:33:03.980 16:19:27 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:33:03.980 16:19:27 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:03.980 16:19:27 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:03.980 16:19:27 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:33:03.980 16:19:27 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:33:03.980 16:19:27 -- nvmf/common.sh@654 -- # echo 1 00:33:03.980 16:19:27 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:33:03.980 16:19:27 -- nvmf/common.sh@656 -- # echo 1 00:33:03.980 16:19:27 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:33:03.980 16:19:27 -- nvmf/common.sh@663 -- # echo tcp 00:33:03.980 16:19:27 -- nvmf/common.sh@664 -- # echo 4420 00:33:03.980 16:19:27 -- nvmf/common.sh@665 -- # echo ipv4 00:33:03.980 16:19:27 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:33:03.980 16:19:27 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:33:04.239 00:33:04.239 Discovery Log Number of Records 2, Generation counter 2 00:33:04.239 =====Discovery Log Entry 0====== 00:33:04.239 trtype: tcp 00:33:04.239 adrfam: ipv4 00:33:04.239 subtype: current discovery subsystem 00:33:04.239 treq: not specified, sq flow control disable supported 00:33:04.239 portid: 1 00:33:04.239 trsvcid: 4420 00:33:04.239 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:33:04.239 traddr: 10.0.0.1 00:33:04.239 eflags: none 00:33:04.239 sectype: none 00:33:04.239 =====Discovery Log Entry 1====== 00:33:04.239 trtype: tcp 00:33:04.239 adrfam: ipv4 00:33:04.239 subtype: nvme subsystem 00:33:04.239 treq: not specified, sq flow control disable supported 00:33:04.239 portid: 1 00:33:04.239 trsvcid: 4420 00:33:04.239 subnqn: kernel_target 00:33:04.239 traddr: 10.0.0.1 00:33:04.239 eflags: none 00:33:04.239 sectype: none 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@24 -- # local target r 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:04.239 16:19:27 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:04.239 EAL: No free 2048 kB hugepages reported on node 1 00:33:07.522 Initializing NVMe Controllers 00:33:07.522 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:07.522 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:07.522 Initialization complete. Launching workers. 00:33:07.522 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 47529, failed: 0 00:33:07.522 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 47529, failed to submit 0 00:33:07.522 success 0, unsuccess 47529, failed 0 00:33:07.522 16:19:30 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:07.522 16:19:30 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:07.522 EAL: No free 2048 kB hugepages reported on node 1 00:33:10.806 Initializing NVMe Controllers 00:33:10.806 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:10.806 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:10.806 Initialization complete. Launching workers. 00:33:10.806 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 87133, failed: 0 00:33:10.806 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 21958, failed to submit 65175 00:33:10.806 success 0, unsuccess 21958, failed 0 00:33:10.806 16:19:33 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:10.806 16:19:33 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:10.806 EAL: No free 2048 kB hugepages reported on node 1 00:33:14.091 Initializing NVMe Controllers 00:33:14.091 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:14.091 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:14.091 Initialization complete. Launching workers. 00:33:14.091 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79823, failed: 0 00:33:14.091 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19922, failed to submit 59901 00:33:14.091 success 0, unsuccess 19922, failed 0 00:33:14.091 16:19:36 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:33:14.091 16:19:36 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:33:14.091 16:19:36 -- nvmf/common.sh@677 -- # echo 0 00:33:14.091 16:19:36 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:33:14.091 16:19:36 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:14.091 16:19:36 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:33:14.091 16:19:36 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:14.091 16:19:36 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:33:14.091 16:19:36 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:33:14.091 00:33:14.091 real 0m11.982s 00:33:14.091 user 0m5.875s 00:33:14.091 sys 0m2.354s 00:33:14.091 16:19:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:14.091 16:19:37 -- common/autotest_common.sh@10 -- # set +x 00:33:14.091 ************************************ 00:33:14.091 END TEST kernel_target_abort 00:33:14.091 ************************************ 00:33:14.091 16:19:37 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:33:14.091 16:19:37 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:33:14.091 16:19:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:14.091 16:19:37 -- nvmf/common.sh@116 -- # sync 00:33:14.091 16:19:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:14.091 16:19:37 -- nvmf/common.sh@119 -- # set +e 00:33:14.091 16:19:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:14.091 16:19:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:14.091 rmmod nvme_tcp 00:33:14.091 rmmod nvme_fabrics 00:33:14.091 rmmod nvme_keyring 00:33:14.091 16:19:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:14.091 16:19:37 -- nvmf/common.sh@123 -- # set -e 00:33:14.091 16:19:37 -- nvmf/common.sh@124 -- # return 0 00:33:14.091 16:19:37 -- nvmf/common.sh@477 -- # '[' -n 1738837 ']' 00:33:14.091 16:19:37 -- nvmf/common.sh@478 -- # killprocess 1738837 00:33:14.091 16:19:37 -- common/autotest_common.sh@936 -- # '[' -z 1738837 ']' 00:33:14.091 16:19:37 -- common/autotest_common.sh@940 -- # kill -0 1738837 00:33:14.091 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1738837) - No such process 00:33:14.091 16:19:37 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1738837 is not found' 00:33:14.091 Process with pid 1738837 is not found 00:33:14.091 16:19:37 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:14.091 16:19:37 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:14.659 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:14.659 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:14.659 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:14.659 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:14.659 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:14.659 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:14.659 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:14.659 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:14.659 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:14.659 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:14.917 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:14.917 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:14.917 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:14.917 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:14.917 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:14.917 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:14.917 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:14.917 16:19:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:14.917 16:19:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:14.917 16:19:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:14.917 16:19:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:14.917 16:19:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:14.917 16:19:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:14.917 16:19:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:17.444 16:19:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:17.444 00:33:17.444 real 0m35.366s 00:33:17.444 user 1m4.791s 00:33:17.444 sys 0m8.211s 00:33:17.444 16:19:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:17.444 16:19:40 -- common/autotest_common.sh@10 -- # set +x 00:33:17.444 ************************************ 00:33:17.444 END TEST nvmf_abort_qd_sizes 00:33:17.444 ************************************ 00:33:17.444 16:19:40 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:33:17.444 16:19:40 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:33:17.444 16:19:40 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:17.444 16:19:40 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:17.444 16:19:40 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:33:17.444 16:19:40 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:33:17.444 16:19:40 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:33:17.444 16:19:40 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:17.444 16:19:40 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:17.444 16:19:40 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:17.444 16:19:40 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:17.444 16:19:40 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:33:17.444 16:19:40 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:33:17.444 16:19:40 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:17.444 16:19:40 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:17.444 16:19:40 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:33:17.444 16:19:40 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:33:17.444 16:19:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:17.444 16:19:40 -- common/autotest_common.sh@10 -- # set +x 00:33:17.444 16:19:40 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:33:17.444 16:19:40 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:33:17.444 16:19:40 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:33:17.444 16:19:40 -- common/autotest_common.sh@10 -- # set +x 00:33:18.818 INFO: APP EXITING 00:33:18.818 INFO: killing all VMs 00:33:18.818 INFO: killing vhost app 00:33:18.818 INFO: EXIT DONE 00:33:19.751 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:19.751 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:19.751 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:19.751 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:19.751 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:20.009 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:20.009 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:20.009 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:20.009 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:20.009 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:20.009 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:20.009 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:20.009 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:20.009 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:20.009 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:20.009 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:20.009 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:21.384 Cleaning 00:33:21.384 Removing: /var/run/dpdk/spdk0/config 00:33:21.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:21.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:21.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:21.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:21.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:21.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:21.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:21.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:21.384 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:21.384 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:21.384 Removing: /var/run/dpdk/spdk1/config 00:33:21.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:21.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:21.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:21.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:21.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:21.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:21.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:21.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:21.384 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:21.384 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:21.384 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:21.384 Removing: /var/run/dpdk/spdk2/config 00:33:21.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:21.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:21.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:21.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:21.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:21.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:21.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:21.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:21.384 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:21.384 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:21.384 Removing: /var/run/dpdk/spdk3/config 00:33:21.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:21.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:21.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:21.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:21.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:21.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:21.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:21.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:21.384 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:21.384 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:21.384 Removing: /var/run/dpdk/spdk4/config 00:33:21.384 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:21.384 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:21.384 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:21.384 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:21.385 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:21.385 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:21.385 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:21.385 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:21.385 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:21.385 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:21.385 Removing: /dev/shm/bdev_svc_trace.1 00:33:21.385 Removing: /dev/shm/nvmf_trace.0 00:33:21.385 Removing: /dev/shm/spdk_tgt_trace.pid1458476 00:33:21.385 Removing: /var/run/dpdk/spdk0 00:33:21.385 Removing: /var/run/dpdk/spdk1 00:33:21.385 Removing: /var/run/dpdk/spdk2 00:33:21.385 Removing: /var/run/dpdk/spdk3 00:33:21.385 Removing: /var/run/dpdk/spdk4 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1456755 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1457522 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1458476 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1458988 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1460335 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1461285 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1461485 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1461815 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1462158 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1462373 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1462530 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1462715 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1463002 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1463473 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1466025 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1466319 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1466622 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1466763 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1467074 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1467216 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1467534 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1467668 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1467963 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1468103 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1468274 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1468415 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1468793 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1468947 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1469164 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1469452 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1469479 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1469651 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1469806 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1469960 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1470100 00:33:21.385 Removing: /var/run/dpdk/spdk_pid1470378 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1470524 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1470687 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1470831 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1471103 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1471255 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1471412 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1471556 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1471830 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1471968 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1472139 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1472277 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1472518 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1472695 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1472859 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1473004 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1473208 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1473416 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1473585 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1473725 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1473906 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1474143 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1474300 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1474507 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1474746 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1474983 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1475136 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1475285 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1475812 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1476213 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1476379 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1476522 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1476813 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1476953 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1477106 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1477258 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1477534 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1477608 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1477840 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1480170 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1537632 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1540295 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1547422 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1550900 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1553291 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1553702 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1557728 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1557730 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1558301 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1558978 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1559654 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1560065 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1560068 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1560219 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1560354 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1560361 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1561029 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1561706 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1562270 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1562676 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1562802 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1562946 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1564111 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1564995 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1571114 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1571295 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1574087 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1577859 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1580096 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1586740 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1592280 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1593620 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1594307 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1605573 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1607810 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1610651 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1611866 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1613243 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1613446 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1613678 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1613829 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1614428 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1615887 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1616806 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1617262 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1620885 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1624466 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1628108 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1652691 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1655528 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1659365 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1660464 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1661707 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1664894 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1667333 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1671858 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1671861 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1674671 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1674815 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1675074 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1675359 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1675364 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1676474 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1677807 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1679024 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1680235 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1681457 00:33:21.643 Removing: /var/run/dpdk/spdk_pid1682672 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1686687 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1687031 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1688385 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1689247 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1693041 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1695704 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1699440 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1703073 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1706751 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1707173 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1707585 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1708032 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1708726 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1709242 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1709711 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1710264 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1712988 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1713204 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1717086 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1717268 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1719040 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1724200 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1724213 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1727391 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1729274 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1730674 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1731531 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1732857 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1733759 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1739280 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1739680 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1740083 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1741599 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1741975 00:33:21.644 Removing: /var/run/dpdk/spdk_pid1742387 00:33:21.644 Clean 00:33:21.902 killing process with pid 1428209 00:33:30.012 killing process with pid 1428206 00:33:30.012 killing process with pid 1428208 00:33:30.270 killing process with pid 1428207 00:33:30.270 16:19:53 -- common/autotest_common.sh@1446 -- # return 0 00:33:30.270 16:19:53 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:30.270 16:19:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:30.270 16:19:53 -- common/autotest_common.sh@10 -- # set +x 00:33:30.270 16:19:53 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:30.270 16:19:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:30.270 16:19:53 -- common/autotest_common.sh@10 -- # set +x 00:33:30.270 16:19:53 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:30.270 16:19:53 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:30.270 16:19:53 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:30.270 16:19:53 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:30.270 16:19:53 -- spdk/autotest.sh@383 -- # hostname 00:33:30.270 16:19:53 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:30.528 geninfo: WARNING: invalid characters removed from testname! 00:34:02.605 16:20:21 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:03.539 16:20:26 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:06.069 16:20:29 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:09.416 16:20:32 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:11.945 16:20:35 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:14.472 16:20:37 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:17.751 16:20:40 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:17.751 16:20:40 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:34:17.751 16:20:40 -- common/autotest_common.sh@1690 -- $ lcov --version 00:34:17.751 16:20:40 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:34:17.751 16:20:40 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:34:17.751 16:20:40 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:34:17.751 16:20:40 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:34:17.752 16:20:40 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:34:17.752 16:20:40 -- scripts/common.sh@335 -- $ IFS=.-: 00:34:17.752 16:20:40 -- scripts/common.sh@335 -- $ read -ra ver1 00:34:17.752 16:20:40 -- scripts/common.sh@336 -- $ IFS=.-: 00:34:17.752 16:20:40 -- scripts/common.sh@336 -- $ read -ra ver2 00:34:17.752 16:20:40 -- scripts/common.sh@337 -- $ local 'op=<' 00:34:17.752 16:20:40 -- scripts/common.sh@339 -- $ ver1_l=2 00:34:17.752 16:20:40 -- scripts/common.sh@340 -- $ ver2_l=1 00:34:17.752 16:20:40 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:34:17.752 16:20:40 -- scripts/common.sh@343 -- $ case "$op" in 00:34:17.752 16:20:40 -- scripts/common.sh@344 -- $ : 1 00:34:17.752 16:20:40 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:34:17.752 16:20:40 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:17.752 16:20:40 -- scripts/common.sh@364 -- $ decimal 1 00:34:17.752 16:20:40 -- scripts/common.sh@352 -- $ local d=1 00:34:17.752 16:20:40 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:34:17.752 16:20:40 -- scripts/common.sh@354 -- $ echo 1 00:34:17.752 16:20:40 -- scripts/common.sh@364 -- $ ver1[v]=1 00:34:17.752 16:20:40 -- scripts/common.sh@365 -- $ decimal 2 00:34:17.752 16:20:40 -- scripts/common.sh@352 -- $ local d=2 00:34:17.752 16:20:40 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:34:17.752 16:20:40 -- scripts/common.sh@354 -- $ echo 2 00:34:17.752 16:20:40 -- scripts/common.sh@365 -- $ ver2[v]=2 00:34:17.752 16:20:40 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:34:17.752 16:20:40 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:34:17.752 16:20:40 -- scripts/common.sh@367 -- $ return 0 00:34:17.752 16:20:40 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:17.752 16:20:40 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:34:17.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:17.752 --rc genhtml_branch_coverage=1 00:34:17.752 --rc genhtml_function_coverage=1 00:34:17.752 --rc genhtml_legend=1 00:34:17.752 --rc geninfo_all_blocks=1 00:34:17.752 --rc geninfo_unexecuted_blocks=1 00:34:17.752 00:34:17.752 ' 00:34:17.752 16:20:40 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:34:17.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:17.752 --rc genhtml_branch_coverage=1 00:34:17.752 --rc genhtml_function_coverage=1 00:34:17.752 --rc genhtml_legend=1 00:34:17.752 --rc geninfo_all_blocks=1 00:34:17.752 --rc geninfo_unexecuted_blocks=1 00:34:17.752 00:34:17.752 ' 00:34:17.752 16:20:40 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:34:17.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:17.752 --rc genhtml_branch_coverage=1 00:34:17.752 --rc genhtml_function_coverage=1 00:34:17.752 --rc genhtml_legend=1 00:34:17.752 --rc geninfo_all_blocks=1 00:34:17.752 --rc geninfo_unexecuted_blocks=1 00:34:17.752 00:34:17.752 ' 00:34:17.752 16:20:40 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:34:17.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:17.752 --rc genhtml_branch_coverage=1 00:34:17.752 --rc genhtml_function_coverage=1 00:34:17.752 --rc genhtml_legend=1 00:34:17.752 --rc geninfo_all_blocks=1 00:34:17.752 --rc geninfo_unexecuted_blocks=1 00:34:17.752 00:34:17.752 ' 00:34:17.752 16:20:40 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:17.752 16:20:40 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:17.752 16:20:40 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:17.752 16:20:40 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:17.752 16:20:40 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:17.752 16:20:40 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:17.752 16:20:40 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:17.752 16:20:40 -- paths/export.sh@5 -- $ export PATH 00:34:17.752 16:20:40 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:17.752 16:20:40 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:17.752 16:20:40 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:17.752 16:20:40 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731943240.XXXXXX 00:34:17.752 16:20:40 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731943240.nBhbJs 00:34:17.752 16:20:40 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:17.752 16:20:40 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:34:17.752 16:20:40 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:17.752 16:20:40 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:17.752 16:20:40 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:17.752 16:20:40 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:17.752 16:20:40 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:17.752 16:20:40 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:34:17.752 16:20:40 -- common/autotest_common.sh@10 -- $ set +x 00:34:17.752 16:20:40 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:17.752 16:20:40 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:17.752 16:20:40 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:17.752 16:20:40 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:17.752 16:20:40 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:17.752 16:20:40 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:17.752 16:20:40 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:17.752 16:20:40 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:17.752 16:20:40 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:17.752 16:20:40 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:17.752 16:20:40 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:17.752 + [[ -n 1373129 ]] 00:34:17.752 + sudo kill 1373129 00:34:17.762 [Pipeline] } 00:34:17.777 [Pipeline] // stage 00:34:17.783 [Pipeline] } 00:34:17.799 [Pipeline] // timeout 00:34:17.806 [Pipeline] } 00:34:17.821 [Pipeline] // catchError 00:34:17.827 [Pipeline] } 00:34:17.844 [Pipeline] // wrap 00:34:17.852 [Pipeline] } 00:34:17.866 [Pipeline] // catchError 00:34:17.876 [Pipeline] stage 00:34:17.879 [Pipeline] { (Epilogue) 00:34:17.894 [Pipeline] catchError 00:34:17.896 [Pipeline] { 00:34:17.911 [Pipeline] echo 00:34:17.913 Cleanup processes 00:34:17.920 [Pipeline] sh 00:34:18.203 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:18.203 1754690 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:18.216 [Pipeline] sh 00:34:18.498 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:18.498 ++ awk '{print $1}' 00:34:18.498 ++ grep -v 'sudo pgrep' 00:34:18.498 + sudo kill -9 00:34:18.498 + true 00:34:18.511 [Pipeline] sh 00:34:18.793 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:31.002 [Pipeline] sh 00:34:31.288 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:31.288 Artifacts sizes are good 00:34:31.302 [Pipeline] archiveArtifacts 00:34:31.309 Archiving artifacts 00:34:31.474 [Pipeline] sh 00:34:31.782 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:31.797 [Pipeline] cleanWs 00:34:31.807 [WS-CLEANUP] Deleting project workspace... 00:34:31.807 [WS-CLEANUP] Deferred wipeout is used... 00:34:31.814 [WS-CLEANUP] done 00:34:31.816 [Pipeline] } 00:34:31.834 [Pipeline] // catchError 00:34:31.846 [Pipeline] sh 00:34:32.127 + logger -p user.info -t JENKINS-CI 00:34:32.135 [Pipeline] } 00:34:32.149 [Pipeline] // stage 00:34:32.154 [Pipeline] } 00:34:32.168 [Pipeline] // node 00:34:32.173 [Pipeline] End of Pipeline 00:34:32.216 Finished: SUCCESS